-- Logs begin at Mon 2022-08-22 15:08:54 UTC, end at Mon 2022-08-22 16:19:44 UTC. -- Aug 22 15:47:50.139291 dv-cinder-854004-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 22 15:47:50.152933 dv-cinder-854004-1-smb devstack@keystone.service[81649]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 22 15:47:50.156172 dv-cinder-854004-1-smb devstack@keystone.service[81649]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 15:47:50 2022] *** Aug 22 15:47:50.156172 dv-cinder-854004-1-smb devstack@keystone.service[81649]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 15:47:50.156172 dv-cinder-854004-1-smb devstack@keystone.service[81649]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 15:47:50.156172 dv-cinder-854004-1-smb devstack@keystone.service[81649]: nodename: dv-cinder-854004-1-smb Aug 22 15:47:50.156172 dv-cinder-854004-1-smb devstack@keystone.service[81649]: machine: x86_64 Aug 22 15:47:50.156172 dv-cinder-854004-1-smb devstack@keystone.service[81649]: clock source: unix Aug 22 15:47:50.156172 dv-cinder-854004-1-smb devstack@keystone.service[81649]: pcre jit disabled Aug 22 15:47:50.156172 dv-cinder-854004-1-smb devstack@keystone.service[81649]: detected number of CPU cores: 4 Aug 22 15:47:50.156172 dv-cinder-854004-1-smb devstack@keystone.service[81649]: current working directory: / Aug 22 15:47:50.156172 dv-cinder-854004-1-smb devstack@keystone.service[81649]: detected binary path: /usr/bin/uwsgi-core Aug 22 15:47:50.156172 dv-cinder-854004-1-smb devstack@keystone.service[81649]: your processes number limit is 47680 Aug 22 15:47:50.156172 dv-cinder-854004-1-smb devstack@keystone.service[81649]: your memory page size is 4096 bytes Aug 22 15:47:50.156172 dv-cinder-854004-1-smb devstack@keystone.service[81649]: detected max file descriptor number: 2048 Aug 22 15:47:50.156172 dv-cinder-854004-1-smb devstack@keystone.service[81649]: lock engine: pthread robust mutexes Aug 22 15:47:50.157713 dv-cinder-854004-1-smb devstack@keystone.service[81649]: thunder lock: enabled Aug 22 15:47:50.157713 dv-cinder-854004-1-smb devstack@keystone.service[81649]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 22 15:47:50.157713 dv-cinder-854004-1-smb devstack@keystone.service[81649]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 15:47:50.223479 dv-cinder-854004-1-smb devstack@keystone.service[81649]: Python main interpreter initialized at 0x556de9c679c0 Aug 22 15:47:50.223479 dv-cinder-854004-1-smb devstack@keystone.service[81649]: python threads support enabled Aug 22 15:47:50.223479 dv-cinder-854004-1-smb devstack@keystone.service[81649]: your server socket listen backlog is limited to 100 connections Aug 22 15:47:50.223479 dv-cinder-854004-1-smb devstack@keystone.service[81649]: your mercy for graceful operations on workers is 90 seconds Aug 22 15:47:50.224318 dv-cinder-854004-1-smb devstack@keystone.service[81649]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 15:47:50.224449 dv-cinder-854004-1-smb devstack@keystone.service[81649]: *** Operational MODE: preforking *** Aug 22 15:47:50.225061 dv-cinder-854004-1-smb devstack@keystone.service[81649]: *** uWSGI is running in multiple interpreter mode *** Aug 22 15:47:50.225061 dv-cinder-854004-1-smb devstack@keystone.service[81649]: spawned uWSGI master process (pid: 81649) Aug 22 15:47:50.225308 dv-cinder-854004-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 22 15:47:50.226251 dv-cinder-854004-1-smb devstack@keystone.service[81649]: spawned uWSGI worker 1 (pid: 81660, cores: 1) Aug 22 15:47:50.226752 dv-cinder-854004-1-smb devstack@keystone.service[81649]: spawned uWSGI worker 2 (pid: 81661, cores: 1) Aug 22 15:47:50.230762 dv-cinder-854004-1-smb devstack@keystone.service[81649]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 15:47:54.719164 dv-cinder-854004-1-smb devstack@keystone.service[81661]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:47:54.719164 dv-cinder-854004-1-smb devstack@keystone.service[81661]: from cryptography.utils import int_from_bytes Aug 22 15:47:54.720456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:47:54.720456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: from cryptography.utils import int_from_bytes Aug 22 15:47:54.721798 dv-cinder-854004-1-smb devstack@keystone.service[81660]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:47:54.721798 dv-cinder-854004-1-smb devstack@keystone.service[81660]: from cryptography.utils import int_from_bytes Aug 22 15:47:54.722623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 15:47:54.722623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: from cryptography.utils import int_from_bytes Aug 22 15:47:54.773095 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 15:47:54.773379 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 15:47:54.773512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] command line args: [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 15:47:54.773704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 15:47:54.773878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ================================================================================ {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 15:47:54.774019 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 15:47:54.774186 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] admin_token = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.774306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 15:47:54.774436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] command line args: [] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 15:47:54.774557 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] config_dir = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.774557 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.774811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 15:47:54.774941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] config_source = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.775058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ================================================================================ {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 15:47:54.775196 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] debug = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.775373 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] admin_token = **** {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.775485 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.775713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] config_dir = [] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.775824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.775927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.776058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.776199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] config_source = [] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.776199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] debug = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.776486 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.776661 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.776859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.776983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.777138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] list_limit = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.777307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.777489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] log_config_append = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.777489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.777791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.777952 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] log_dir = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.778089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.778223 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] log_file = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.778400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] list_limit = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.778564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.778788 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] log_config_append = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.778919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.779058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.779058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] log_dir = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.779265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.779345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] log_file = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.779465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.779593 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.779771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.779771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.780043 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.780228 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.780364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.780491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.780619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.780619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.780875 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.781016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.781161 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.781282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.781535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.781682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.781805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.781983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.782116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.782303 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.782434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.782664 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.782824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.782951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.782951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.783166 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.783298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.783419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] publish_errors = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.783419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.783723 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.783885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.783885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.784196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.784320 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.784490 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] publish_errors = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.784633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.784811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.784951 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] standard_threads = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.785164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.785359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.785497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.785672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.785800 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.785987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.786204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.786419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] use_journal = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.786419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] use_json = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.786746 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] standard_threads = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.786874 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] use_stderr = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.787011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.787137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] use_syslog = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.787270 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.787392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.787515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.787648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.787757 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] use_journal = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.787757 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] use_json = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.788057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.788057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.788348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] use_stderr = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.788552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.788665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] use_syslog = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.788751 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.788922 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 15:47:54.789043 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.789156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.789273 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.789401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.789520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.789649 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.789769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.789870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.789991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.790172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.790307 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.790307 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.790691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.790820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.790931 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.791020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.791135 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.791277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.791396 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.791512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.791643 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.791763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.791887 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.792015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.792133 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.792253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.792372 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.792493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.792616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.792860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.792972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.793070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.793189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.793293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.793392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.793510 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.793620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.793743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.793869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.793969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.794078 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.794198 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.794198 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.794396 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.794499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.794644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.794763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.794898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.795010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.795121 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.795238 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.795365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.795502 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.795627 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.795764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.795897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.796120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.796243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.796385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.796503 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.796623 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.796756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.796886 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.797005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.797141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.797267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.797386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.797510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.797637 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.797762 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.797901 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.798036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.798158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.798158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.798393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.798521 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.798767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.798860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.798958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.798958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.799131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.799216 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.799297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.799370 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.799447 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.799519 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.799589 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.799656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.799784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.799784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.799982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.800065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.800176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.800295 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.800397 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.800472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.800551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.800657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.800761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.800839 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.800919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.800991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.801063 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.801180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.801289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.801438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.801563 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.801666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.801778 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.801879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.801983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.802091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.802211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.802328 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.802434 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.802552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.802694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.802811 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.802920 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.802994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.803063 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.803130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.803196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.803255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.803336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.803452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.803554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.803658 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.803734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.803804 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.803892 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.804017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.804122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.804232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.804348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.804456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.804553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.804660 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.804782 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.804887 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.804997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.805106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.805210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.805325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.805458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.805563 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.805563 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.805737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.805826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.805928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.806024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.806116 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.806205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.806293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.806384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.806491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.806586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.806790 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.806881 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.806975 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.807077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.807204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.807312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.807424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.807541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.807649 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.807757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.807896 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.808016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.808135 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.808250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.808375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.808501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.808735 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.808858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.808965 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.809086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.809205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.809321 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.809454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.809586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.809722 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.809838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.809940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.810063 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.810180 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.810295 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.810424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.810547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.810713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.810833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.810952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.811085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.811206 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.811308 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] auth.external = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.811426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.811529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.811592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.811659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.811722 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.811786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.811845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.811903 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] auth.password = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.811968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] auth.token = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812309 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812376 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812436 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] auth.external = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812794 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.812979 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.813037 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] credential.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.813102 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] auth.password = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.813187 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.813258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] auth.token = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.813327 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.813389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.813454 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.813558 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.813661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.813760 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.813886 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.813999 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.814118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.814235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.814353 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.814482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.814739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.814868 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.814988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.815125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] credential.caching = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.815248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.815376 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.815519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.815653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.815773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.815890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.816009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.816113 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.816233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.816337 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.816440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.816541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.816642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.816743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.816855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.816963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.817070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.817192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.817313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.817443 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.817569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.817569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.817779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.817885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.817987 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.818117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.818250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.818374 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.818500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.818636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.818761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.818887 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.819031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] federation.caching = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.819159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.819276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.819396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.819524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.819649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.819771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.819886 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.819996 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.820093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.820218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.820360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.820490 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.820605 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.820723 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.820845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.820995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.821227 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.821354 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.821484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.821611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.821731 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.821843 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.821967 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.822077 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity.caching = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.822182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.822302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.822415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.822533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.822774 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.822900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.823004 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.823111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.823241 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.823367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.823506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.823638 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.823762 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.823886 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.824012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.824138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.824280 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.824401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.824509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.824614 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.824717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.824815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.824933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.825038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.825145 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.825309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.825442 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.825566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.825703 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.825824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.825930 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.826034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.826138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.826244 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.826362 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.826362 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.826542 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.826669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.826778 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.826875 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.827016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.827143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.827253 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.827364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.827489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.827614 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.827753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.827863 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.827976 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.828083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.828190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.828303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.828428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.828546 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.828676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.828802 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.828926 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.829051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.829200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.829324 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.829452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.829580 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.829706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.829836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.829981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.830108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.830236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.830370 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.830500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.830730 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.830867 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.830992 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.831114 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.831236 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.831344 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.831449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.831569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.831676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.831781 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.831886 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.831996 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.832103 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.832234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.832234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.832460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.832567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.832671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.832788 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.832896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.833002 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.833093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.833184 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.833285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.833416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.833543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.833667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.833789 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.833911 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.834036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.834176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.834305 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.834430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.834555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.834555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.834768 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.834888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.834998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.835101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.835189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.835291 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.835401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.835520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.835636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.835742 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.835847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.835946 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.836065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.836189 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.836299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.836407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.836517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.836650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.836760 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.836873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.836984 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.837094 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.837199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.837301 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.837414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.837546 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.837665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.837783 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.837899 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.838017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.838017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.838245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.838372 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.838492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.838640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.838756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.838879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.839019 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.839142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.839265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.839384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.839502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.839622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.839751 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.839877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.840000 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.840121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.840237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.840355 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.840476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.840585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.840704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.840832 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.840949 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.841070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.841205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.841335 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.841460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.841582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.841704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.841821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.841957 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.842079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.842203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.842736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.842863 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.842983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.843114 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.843206 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] role.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.843300 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.843418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] role.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.843540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.843663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.843803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] resource.caching = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.843926 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.844045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.844171 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.844291 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.844416 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.844655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.844787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.844911 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.845038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.845167 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.845308 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.845454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.845561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.845694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.845818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.845976 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.846121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.846222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.846302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.846381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] role.caching = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.846460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.846521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] role.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.846609 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.846678 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.846738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.846797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.846797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.846917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.847002 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.847079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.847140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.847199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.847270 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.847344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.847455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.847561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.847638 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.847717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.847832 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.847933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.848070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.848158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.848228 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.848302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.848363 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.848423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.848492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.848593 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.848593 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.848786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.848871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.848933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.849002 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.849064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.849130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.849190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.849273 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.849273 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.849527 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.849660 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.849790 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.849918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.850047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.850189 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.850319 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.850446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.850571 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.850799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.850928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.851074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.851205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.851333 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.851460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.851586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.851711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.851852 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.851980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.852106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.852230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.852295 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.852355 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.852439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.852515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.852577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.852636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.852710 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.852770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.852839 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.852901 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.852960 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853019 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] token.caching = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853078 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853204 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853385 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853385 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853497 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853564 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853564 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.connection = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853740 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853740 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853916 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.853975 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.854046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.854107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.854223 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.854324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.854576 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.854679 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.854866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.855074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.855199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.855328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.855528 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.855675 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.855859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.connection = **** {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.855996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.856129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.856348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.856471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.856596 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.856826 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.856958 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.857083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.857207 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.857327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.857463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.857585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.857728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.857852 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.857978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.858198 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.858323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.858448 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.858698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.858828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.858955 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.859151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.859275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.859399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.859582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.859705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.859840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.860019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.860144 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.860267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 15:47:54.860450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 15:47:54.860764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 15:47:54.891482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:54.891804 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:54.892248 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:54.901514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:54.908500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:54.908870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:54.909157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:54.924857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:54.932316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:54.932563 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:54.958591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:54.958966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:54.992115 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.026225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.044368 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.044639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.063083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.063341 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.211422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.211726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.211726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.211932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.211932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.212131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.212131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.212367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.212453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.212516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.212576 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.212646 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.238163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.238411 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.238559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.238707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.238839 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.239000 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.239135 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.239270 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.239403 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.239403 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.239628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.239740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.239860 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.239860 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.251435 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.251966 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.265154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.265398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.265585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.265729 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.265870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.266038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.266260 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.266393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.266519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.266680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.266830 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.266959 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.266959 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.266959 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81660) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 15:47:55.284147 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.284453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 15:47:55.284589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.284730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 15:47:55.284861 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.284861 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 15:47:55.285104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.285246 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.285369 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 15:47:55.285499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.285628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.285750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.285892 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.286020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.286404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.286648 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.295762 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.296058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.296325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.296608 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.296771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.297091 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.297392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.297681 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.303822 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.305437 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.306865 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.307158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.307441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.307725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.308000 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.308322 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.308529 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.308663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.308868 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.309002 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.309087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.309192 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.309316 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.309410 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.309536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.309641 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.309832 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.310119 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.310400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.310837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.311127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.311404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.332477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.334024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.334304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.334964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.336538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.336833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.339253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.339553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.339835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.341722 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.342341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.342658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.346784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.347091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.349182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.349490 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.351081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.351376 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.351656 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.352000 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.352401 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.352676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.352944 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.353211 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.353763 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.354065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.354359 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.354677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.354962 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.355245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.355518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.355799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.370737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.371085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.373732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.374032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.374918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.378019 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.378264 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.378463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.381345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.381653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.382715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.385949 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.386185 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.389117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.389483 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.389689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.389689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.390099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.390377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.390702 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.392790 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.393105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.393393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.393724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.394009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.394466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.406837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.407204 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.407484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.407786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.410990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.411361 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.411596 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.411875 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.415188 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.417118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.417465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.419279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.420340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.420680 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.420909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.421121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.421337 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.421553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.421834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.423878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.424177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.424478 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.424783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.425066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.434048 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.434048 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.434626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.434866 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.435067 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.435366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.435710 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.436885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.437192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.437475 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.437762 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.438046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.438334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.438658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.452059 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.454453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.455272 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.457903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.458822 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.460432 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.461458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.462125 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.462414 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.462733 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.462976 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.464517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.464816 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.465111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.469674 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.471210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.472309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.473902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.474290 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.474644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.474928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.475208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.477150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.477455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.477791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.478083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.483393 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.483709 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.483955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.486421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.486758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.487041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.490884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.491306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.491588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.492175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.492175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.492753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.492753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.493102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.493286 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.493506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.493775 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.494031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.494307 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.494508 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81660) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 15:47:55.494765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.494977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.494977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.495348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.495559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.495834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.496069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.496341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.496620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.496909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.497183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.497446 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.497728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.497990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81660) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 15:47:55.529173 dv-cinder-854004-1-smb devstack@keystone.service[81661]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556de9c679c0 pid: 81661 (default app) Aug 22 15:47:55.532983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dad76-aef4-4246-a8cc-000263a822df None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:47:55.533351 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dad76-aef4-4246-a8cc-000263a822df None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:47:55.533561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dad76-aef4-4246-a8cc-000263a822df None None] PATH_INFO: `/v3` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:47:55.537924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Mon Aug 22 15:47:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:47:55.538372 dv-cinder-854004-1-smb devstack@keystone.service[81660]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556de9c679c0 pid: 81660 (default app) Aug 22 15:48:02.611590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa718a-4ee2-45b2-b020-62fab0105b6b None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:02.612100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa718a-4ee2-45b2-b020-62fab0105b6b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:02.612100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa718a-4ee2-45b2-b020-62fab0105b6b None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:02.613537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 2/2] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:48:02.623755 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49307665-2921-42a9-b835-88b55e0f3f4d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:02.624274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49307665-2921-42a9-b835-88b55e0f3f4d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:02.624380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49307665-2921-42a9-b835-88b55e0f3f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:02.697479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: INFO dbcounter [None req-49307665-2921-42a9-b835-88b55e0f3f4d None None] Registered counter for database keystone Aug 22 15:48:02.717617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG oslo_db.sqlalchemy.engines [None req-49307665-2921-42a9-b835-88b55e0f3f4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:48:02.724620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writer thread running {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:48:02.928164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG passlib.handlers.bcrypt [None req-49307665-2921-42a9-b835-88b55e0f3f4d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81660) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 15:48:02.928623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG passlib.handlers.bcrypt [None req-49307665-2921-42a9-b835-88b55e0f3f4d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81660) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 15:48:02.985291 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-49307665-2921-42a9-b835-88b55e0f3f4d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:02.987006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-49307665-2921-42a9-b835-88b55e0f3f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:03.151414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1/3] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 531 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 15:48:03.620473 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa718a-4ee2-45b2-b020-62fab0105b6b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:03.690917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: INFO dbcounter [None req-50fa718a-4ee2-45b2-b020-62fab0105b6b None None] Registered counter for database keystone Aug 22 15:48:03.714869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG oslo_db.sqlalchemy.engines [None req-50fa718a-4ee2-45b2-b020-62fab0105b6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 15:48:03.722355 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writer thread running {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 15:48:03.847296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa718a-4ee2-45b2-b020-62fab0105b6b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:03.852315 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e5571-9c7b-4192-b2ff-3bd00412f897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:03.852991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e5571-9c7b-4192-b2ff-3bd00412f897 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:03.853265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e5571-9c7b-4192-b2ff-3bd00412f897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:03.853531 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e5571-9c7b-4192-b2ff-3bd00412f897 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:03.863644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e5571-9c7b-4192-b2ff-3bd00412f897 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:03.916249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: WARNING keystone.common.rbac_enforcer.enforcer [None req-040e5571-9c7b-4192-b2ff-3bd00412f897 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 15:48:03.916503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e5571-9c7b-4192-b2ff-3bd00412f897 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:03.927627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 3/4] 10.222.0.77 () {58 vars in 1324 bytes} [Mon Aug 22 15:48:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 15:48:03.934156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49307665-2921-42a9-b835-88b55e0f3f4d None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:03.950911 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49307665-2921-42a9-b835-88b55e0f3f4d None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:03.955910 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa5b14-5c95-4212-9072-dffbedea6860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:03.957163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5b14-5c95-4212-9072-dffbedea6860 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:03.957749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5b14-5c95-4212-9072-dffbedea6860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:03.958044 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5b14-5c95-4212-9072-dffbedea6860 admin admin] PATH_INFO: `/v3/projects/29b6132ef8cb45a795d9be0f08083084` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:03.959789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa5b14-5c95-4212-9072-dffbedea6860 admin admin] RBAC: Authorizing `identity:get_project(project_id=29b6132ef8cb45a795d9be0f08083084)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:04.013000 dv-cinder-854004-1-smb devstack@keystone.service[81660]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1efa5b14-5c95-4212-9072-dffbedea6860 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 15:48:04.013333 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa5b14-5c95-4212-9072-dffbedea6860 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:04.018146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 2/5] 10.222.0.77 () {56 vars in 1207 bytes} [Mon Aug 22 15:48:03 2022] GET /identity/v3/projects/29b6132ef8cb45a795d9be0f08083084 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:05.925200 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dea582-2b78-43e5-8d88-bdaa4b241d78 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:05.925784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dea582-2b78-43e5-8d88-bdaa4b241d78 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:05.925784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dea582-2b78-43e5-8d88-bdaa4b241d78 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:05.932560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 4/6] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:05.941873 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f6e3d-fdd7-41aa-83c1-f95d3e7edb21 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:05.942635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f6e3d-fdd7-41aa-83c1-f95d3e7edb21 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:05.942635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f6e3d-fdd7-41aa-83c1-f95d3e7edb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:05.965459 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-bd2f6e3d-fdd7-41aa-83c1-f95d3e7edb21 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:05.967169 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bd2f6e3d-fdd7-41aa-83c1-f95d3e7edb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:05.976691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 3/7] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 22 15:48:06.245619 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dea582-2b78-43e5-8d88-bdaa4b241d78 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:06.261947 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dea582-2b78-43e5-8d88-bdaa4b241d78 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:06.266976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cb293-6b79-42fb-b6d0-fce189a5446b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:06.267683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cb293-6b79-42fb-b6d0-fce189a5446b admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:06.267966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cb293-6b79-42fb-b6d0-fce189a5446b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:06.268241 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cb293-6b79-42fb-b6d0-fce189a5446b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:06.277967 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cb293-6b79-42fb-b6d0-fce189a5446b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:06.279834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07cb293-6b79-42fb-b6d0-fce189a5446b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:06.289375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 5/8] 10.222.0.77 () {58 vars in 1324 bytes} [Mon Aug 22 15:48:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 15:48:06.295514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f6e3d-fdd7-41aa-83c1-f95d3e7edb21 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:06.305366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f6e3d-fdd7-41aa-83c1-f95d3e7edb21 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:06.310749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e9f5d-6345-4701-8ef6-7993ef5f18df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:06.311402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e9f5d-6345-4701-8ef6-7993ef5f18df admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:06.311681 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e9f5d-6345-4701-8ef6-7993ef5f18df admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:06.311950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e9f5d-6345-4701-8ef6-7993ef5f18df admin admin] PATH_INFO: `/v3/users/ee071968090a43639b3c920bae3fb546` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:06.313418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e9f5d-6345-4701-8ef6-7993ef5f18df admin admin] RBAC: Authorizing `identity:get_user(user_id=ee071968090a43639b3c920bae3fb546)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:06.315415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e9f5d-6345-4701-8ef6-7993ef5f18df admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:06.317047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 4/9] 10.222.0.77 () {56 vars in 1198 bytes} [Mon Aug 22 15:48:06 2022] GET /identity/v3/users/ee071968090a43639b3c920bae3fb546 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:08.405735 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0e8e-8596-408c-9641-418f4b72a9a7 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:08.406412 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0e8e-8596-408c-9641-418f4b72a9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:08.406540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0e8e-8596-408c-9641-418f4b72a9a7 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:08.408468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 6/10] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:08.410278 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961074c-2dc6-46f1-b521-7351af931dac None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:08.411016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961074c-2dc6-46f1-b521-7351af931dac None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:08.411016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961074c-2dc6-46f1-b521-7351af931dac None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:08.412278 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 5/11] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:08.415592 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a32afa-f2af-4f8f-8e60-07b54e8f4699 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:08.416004 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a32afa-f2af-4f8f-8e60-07b54e8f4699 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:08.416411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a32afa-f2af-4f8f-8e60-07b54e8f4699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:08.418373 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ac3ec-a67b-49c0-a77d-91b2d6f3de24 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:08.418693 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ac3ec-a67b-49c0-a77d-91b2d6f3de24 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:08.418974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ac3ec-a67b-49c0-a77d-91b2d6f3de24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:08.437917 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-5c5ac3ec-a67b-49c0-a77d-91b2d6f3de24 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:08.439317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5c5ac3ec-a67b-49c0-a77d-91b2d6f3de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:08.472614 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG passlib.handlers.bcrypt [None req-43a32afa-f2af-4f8f-8e60-07b54e8f4699 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81661) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 15:48:08.473258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG passlib.handlers.bcrypt [None req-43a32afa-f2af-4f8f-8e60-07b54e8f4699 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81661) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 15:48:08.519288 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-43a32afa-f2af-4f8f-8e60-07b54e8f4699 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:08.520938 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-43a32afa-f2af-4f8f-8e60-07b54e8f4699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:08.526634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 6/12] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:48:08.637441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 7/13] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:08.799345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ac3ec-a67b-49c0-a77d-91b2d6f3de24 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:08.824211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:08.908374 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ac3ec-a67b-49c0-a77d-91b2d6f3de24 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:08.924850 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a32afa-f2af-4f8f-8e60-07b54e8f4699 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:08.943358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8a53f-fc9a-4bb6-bf6e-42af375f09b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:08.943984 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8a53f-fc9a-4bb6-bf6e-42af375f09b1 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:08.944263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8a53f-fc9a-4bb6-bf6e-42af375f09b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:08.944536 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8a53f-fc9a-4bb6-bf6e-42af375f09b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:09.016234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8a53f-fc9a-4bb6-bf6e-42af375f09b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:09.018015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8a53f-fc9a-4bb6-bf6e-42af375f09b1 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:09.029199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a32afa-f2af-4f8f-8e60-07b54e8f4699 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:09.031784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:09.048745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:09.072791 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9649e1-e363-41ff-b4b7-552883f9c472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:09.073914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9649e1-e363-41ff-b4b7-552883f9c472 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:09.074226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9649e1-e363-41ff-b4b7-552883f9c472 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:09.074500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9649e1-e363-41ff-b4b7-552883f9c472 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:09.087536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9649e1-e363-41ff-b4b7-552883f9c472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-5d9649e1-e363-41ff-b4b7-552883f9c472 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:09.096343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:09.097356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:09.098425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:09.098425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:09.098425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:09.098425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:09.098425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:09.098425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:09.098425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:09.098425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:09.098425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:09.098425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:09.098425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:09.098425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:09.098425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 8/14] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:48:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:48:09.105876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9649e1-e363-41ff-b4b7-552883f9c472 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:09.156382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 7/15] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:09.162199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8a53f-fc9a-4bb6-bf6e-42af375f09b1 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:09.223016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9649e1-e363-41ff-b4b7-552883f9c472 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:09.270242 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a3520-dd54-4381-a749-f95d4748b3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:09.270872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a3520-dd54-4381-a749-f95d4748b3cb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:09.271334 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a3520-dd54-4381-a749-f95d4748b3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:09.271790 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a3520-dd54-4381-a749-f95d4748b3cb None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:09.272666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a3520-dd54-4381-a749-f95d4748b3cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:09.273208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a3520-dd54-4381-a749-f95d4748b3cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:09.275572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a3520-dd54-4381-a749-f95d4748b3cb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:09.278675 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8a53f-fc9a-4bb6-bf6e-42af375f09b1 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:09.291548 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 9/16] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:09.297746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a3520-dd54-4381-a749-f95d4748b3cb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:09.306281 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:09.320061 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66735f4a-6a72-46f9-8479-1692e25a1c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:09.320703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735f4a-6a72-46f9-8479-1692e25a1c76 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:09.320975 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735f4a-6a72-46f9-8479-1692e25a1c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:09.321240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735f4a-6a72-46f9-8479-1692e25a1c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:09.334735 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66735f4a-6a72-46f9-8479-1692e25a1c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:09.336261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66735f4a-6a72-46f9-8479-1692e25a1c76 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:09.336513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-66735f4a-6a72-46f9-8479-1692e25a1c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:48:09.356412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:09.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:48:09.358775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:48:09.358775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:48:09.358775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:09.358775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 8/17] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:09.364561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66735f4a-6a72-46f9-8479-1692e25a1c76 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:09.429258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a3520-dd54-4381-a749-f95d4748b3cb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:09.467036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6c389-c275-49fd-8d5f-741ff0a34fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:09.467683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6c389-c275-49fd-8d5f-741ff0a34fde None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:09.467937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6c389-c275-49fd-8d5f-741ff0a34fde None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:09.468210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6c389-c275-49fd-8d5f-741ff0a34fde None admin] PATH_INFO: `/v3/users/ee071968090a43639b3c920bae3fb546` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:09.469848 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6c389-c275-49fd-8d5f-741ff0a34fde None admin] RBAC: Authorizing `identity:get_user(user_id=ee071968090a43639b3c920bae3fb546)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:09.471377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6c389-c275-49fd-8d5f-741ff0a34fde None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:09.473284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 10/18] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:09 2022] GET /identity/v3/users/ee071968090a43639b3c920bae3fb546 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:09.479237 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6c389-c275-49fd-8d5f-741ff0a34fde None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:09.509114 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66735f4a-6a72-46f9-8479-1692e25a1c76 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:09.545874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065b640-35a8-414b-935e-615f652739da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:09.546487 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065b640-35a8-414b-935e-615f652739da None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:09.546791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065b640-35a8-414b-935e-615f652739da None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:09.547159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065b640-35a8-414b-935e-615f652739da None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:09.547766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065b640-35a8-414b-935e-615f652739da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:09.548066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065b640-35a8-414b-935e-615f652739da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:09.549475 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6065b640-35a8-414b-935e-615f652739da None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:09.567652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 9/19] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:09.579314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:09.588582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6c389-c275-49fd-8d5f-741ff0a34fde None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:09.635809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3781b-3385-4609-8e77-9683950d3044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:09.636465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3781b-3385-4609-8e77-9683950d3044 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:09.636744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3781b-3385-4609-8e77-9683950d3044 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:09.637012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3781b-3385-4609-8e77-9683950d3044 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:09.638218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3781b-3385-4609-8e77-9683950d3044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:09.639759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3781b-3385-4609-8e77-9683950d3044 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:09.641459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 11/20] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:09.647602 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065b640-35a8-414b-935e-615f652739da None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:09.685842 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:09.757509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065b640-35a8-414b-935e-615f652739da None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:09.792420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f178a8-486f-4555-97ae-70f0ce6a1a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:09.793053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f178a8-486f-4555-97ae-70f0ce6a1a5a None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:09.793312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f178a8-486f-4555-97ae-70f0ce6a1a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:09.793583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f178a8-486f-4555-97ae-70f0ce6a1a5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:09.794350 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f178a8-486f-4555-97ae-70f0ce6a1a5a None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.domain.id=default, user.id=ee071968090a43639b3c920bae3fb546) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:09.794676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f178a8-486f-4555-97ae-70f0ce6a1a5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:09.796208 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f178a8-486f-4555-97ae-70f0ce6a1a5a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:09.806331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 10/21] 10.222.0.77 () {56 vars in 1322 bytes} [Mon Aug 22 15:48:09 2022] GET /identity/v3/role_assignments?user.id=ee071968090a43639b3c920bae3fb546&scope.domain.id=default&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:11.779915 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8badd73-15d3-4b29-8a6d-b239ec85c990 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:11.781587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8badd73-15d3-4b29-8a6d-b239ec85c990 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:11.782350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8badd73-15d3-4b29-8a6d-b239ec85c990 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:11.785160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 12/22] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:11.792263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770e786-62d0-481a-bcd1-033f9d2a9527 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:11.793772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770e786-62d0-481a-bcd1-033f9d2a9527 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:11.794504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770e786-62d0-481a-bcd1-033f9d2a9527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:11.831788 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-a770e786-62d0-481a-bcd1-033f9d2a9527 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:11.834286 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a770e786-62d0-481a-bcd1-033f9d2a9527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:11.957215 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 11/23] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:12.394757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f9f79-dd8f-496e-bed4-742f5c617054 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:12.395040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f9f79-dd8f-496e-bed4-742f5c617054 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:12.395569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f9f79-dd8f-496e-bed4-742f5c617054 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:12.397137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 13/24] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:12.403000 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5ef4b-4fc4-415d-ad6c-a76c25080db6 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:12.403566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5ef4b-4fc4-415d-ad6c-a76c25080db6 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:12.404035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5ef4b-4fc4-415d-ad6c-a76c25080db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:12.414971 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca41b90-f7ab-416f-b2bc-5a4298e2dc38 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:12.415619 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca41b90-f7ab-416f-b2bc-5a4298e2dc38 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:12.416229 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca41b90-f7ab-416f-b2bc-5a4298e2dc38 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:12.417822 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 14/25] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:12.423938 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf87f9-2541-4890-94fb-06dc12ca64e9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:12.424531 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf87f9-2541-4890-94fb-06dc12ca64e9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:12.425000 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf87f9-2541-4890-94fb-06dc12ca64e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:12.439016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-22c5ef4b-4fc4-415d-ad6c-a76c25080db6 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:12.440619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-22c5ef4b-4fc4-415d-ad6c-a76c25080db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:12.468657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-bbdf87f9-2541-4890-94fb-06dc12ca64e9 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:12.470622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bbdf87f9-2541-4890-94fb-06dc12ca64e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:12.474956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:12.516741 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 12/26] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:12.517864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5ef4b-4fc4-415d-ad6c-a76c25080db6 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:12.663222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 15/27] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:48:12.665541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9135e-4351-4af3-befb-5e29bc3dccaa None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:12.666087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9135e-4351-4af3-befb-5e29bc3dccaa None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:12.666581 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9135e-4351-4af3-befb-5e29bc3dccaa None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:12.669132 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 16/28] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:12.684252 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070336bb-ec47-43ce-92c3-858444e7280b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:12.684579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070336bb-ec47-43ce-92c3-858444e7280b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:12.684792 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070336bb-ec47-43ce-92c3-858444e7280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:12.727811 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-070336bb-ec47-43ce-92c3-858444e7280b None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:12.729018 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-070336bb-ec47-43ce-92c3-858444e7280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:12.750838 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5ef4b-4fc4-415d-ad6c-a76c25080db6 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:12.848181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e50b5-4c64-49ff-b4ca-1b8c9743a5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:12.848961 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e50b5-4c64-49ff-b4ca-1b8c9743a5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:12.849181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e50b5-4c64-49ff-b4ca-1b8c9743a5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:12.849478 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e50b5-4c64-49ff-b4ca-1b8c9743a5e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:12.873292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e50b5-4c64-49ff-b4ca-1b8c9743a5e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:12.874907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e50b5-4c64-49ff-b4ca-1b8c9743a5e2 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-0f4e50b5-4c64-49ff-b4ca-1b8c9743a5e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:48:12.895351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:12.896282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:48:12.897077 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:48:12.897077 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:48:12.897077 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:12.899521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 13/29] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:12.900609 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e50b5-4c64-49ff-b4ca-1b8c9743a5e2 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:12.924710 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 17/30] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 22 15:48:12.926160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070336bb-ec47-43ce-92c3-858444e7280b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:12.933152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:13.002041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:13.032607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e50b5-4c64-49ff-b4ca-1b8c9743a5e2 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:13.078445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412d02e-e719-42e1-9a0e-d62e8a3bf371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:13.079222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412d02e-e719-42e1-9a0e-d62e8a3bf371 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:13.079513 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412d02e-e719-42e1-9a0e-d62e8a3bf371 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:13.079794 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412d02e-e719-42e1-9a0e-d62e8a3bf371 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:13.095011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412d02e-e719-42e1-9a0e-d62e8a3bf371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-3412d02e-e719-42e1-9a0e-d62e8a3bf371 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:13.103652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:13.104578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:13.105324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:13.105324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:13.105324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:13.105324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:13.105324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:13.105324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:13.105324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:13.105324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:13.105324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:13.105324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:13.105324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:13.105324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:13.105324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 14/31] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:48:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:13.113886 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412d02e-e719-42e1-9a0e-d62e8a3bf371 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:13.188950 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070336bb-ec47-43ce-92c3-858444e7280b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:13.221433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:13.280151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de7d1f-cb00-4c72-8a46-4fbe99faf877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:13.281196 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de7d1f-cb00-4c72-8a46-4fbe99faf877 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:13.281674 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de7d1f-cb00-4c72-8a46-4fbe99faf877 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:13.282139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de7d1f-cb00-4c72-8a46-4fbe99faf877 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:13.283030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de7d1f-cb00-4c72-8a46-4fbe99faf877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:13.283529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de7d1f-cb00-4c72-8a46-4fbe99faf877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:13.284966 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412d02e-e719-42e1-9a0e-d62e8a3bf371 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:13.285263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de7d1f-cb00-4c72-8a46-4fbe99faf877 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:13.346585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 18/32] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:13.347170 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de7d1f-cb00-4c72-8a46-4fbe99faf877 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:13.359618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa8669-d31f-412d-9b9c-3115edbb3e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:13.360683 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa8669-d31f-412d-9b9c-3115edbb3e60 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:13.361161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa8669-d31f-412d-9b9c-3115edbb3e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:13.361641 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa8669-d31f-412d-9b9c-3115edbb3e60 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:13.363174 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa8669-d31f-412d-9b9c-3115edbb3e60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:13.364123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa8669-d31f-412d-9b9c-3115edbb3e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:13.367417 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa8669-d31f-412d-9b9c-3115edbb3e60 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:13.389705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 15/33] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:13.391205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa8669-d31f-412d-9b9c-3115edbb3e60 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:13.469515 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:13.499397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de7d1f-cb00-4c72-8a46-4fbe99faf877 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:13.525364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa8669-d31f-412d-9b9c-3115edbb3e60 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:13.548580 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec5f7a-a9c1-4741-bc90-05527a7fc251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:13.549213 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec5f7a-a9c1-4741-bc90-05527a7fc251 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:13.549491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec5f7a-a9c1-4741-bc90-05527a7fc251 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:13.549762 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec5f7a-a9c1-4741-bc90-05527a7fc251 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:13.550448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec5f7a-a9c1-4741-bc90-05527a7fc251 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:13.551921 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec5f7a-a9c1-4741-bc90-05527a7fc251 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:13.583507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:13.594544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b304f7a-fc6d-481f-a002-4e90519f5411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:13.597026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b304f7a-fc6d-481f-a002-4e90519f5411 None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:13.597372 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b304f7a-fc6d-481f-a002-4e90519f5411 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:13.597667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b304f7a-fc6d-481f-a002-4e90519f5411 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:13.598369 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b304f7a-fc6d-481f-a002-4e90519f5411 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:13.600426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b304f7a-fc6d-481f-a002-4e90519f5411 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:13.682634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 19/34] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Aug 22 15:48:13 2022] POST /identity/v3/roles => generated 219 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:13.682634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec5f7a-a9c1-4741-bc90-05527a7fc251 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:13.722959 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 16/35] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Aug 22 15:48:13 2022] POST /identity/v3/roles => generated 225 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:13.731914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b304f7a-fc6d-481f-a002-4e90519f5411 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:13.896501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec5f7a-a9c1-4741-bc90-05527a7fc251 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:13.942059 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80cd8c-3833-4386-9743-09d5e1b77deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:13.943721 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80cd8c-3833-4386-9743-09d5e1b77deb None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:13.944414 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80cd8c-3833-4386-9743-09d5e1b77deb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:13.944828 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80cd8c-3833-4386-9743-09d5e1b77deb None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:13.945681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80cd8c-3833-4386-9743-09d5e1b77deb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:13.948078 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80cd8c-3833-4386-9743-09d5e1b77deb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:13.949251 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b304f7a-fc6d-481f-a002-4e90519f5411 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:13.977555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:13.998782 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 20/36] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 22 15:48:13 2022] POST /identity/v3/projects => generated 301 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:14.000328 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3428e6e-6ff4-4b87-843b-e60617bc98c8 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:14.000615 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3428e6e-6ff4-4b87-843b-e60617bc98c8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:14.000891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3428e6e-6ff4-4b87-843b-e60617bc98c8 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:14.002519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 21/37] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:14.003738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1f786-ce64-4c15-9a47-e4971f02685a None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:14.004021 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1f786-ce64-4c15-9a47-e4971f02685a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:14.004361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1f786-ce64-4c15-9a47-e4971f02685a None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:14.005027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f20d0f-2f36-4d8a-a410-a73dbee2d2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:14.006133 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f20d0f-2f36-4d8a-a410-a73dbee2d2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:14.006686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f20d0f-2f36-4d8a-a410-a73dbee2d2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:14.007156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f20d0f-2f36-4d8a-a410-a73dbee2d2d8 None admin] PATH_INFO: `/v3/users/ee071968090a43639b3c920bae3fb546` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:14.009586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f20d0f-2f36-4d8a-a410-a73dbee2d2d8 None admin] RBAC: Authorizing `identity:get_user(user_id=ee071968090a43639b3c920bae3fb546)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:14.010211 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 22/38] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:14.012124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9889-f2c1-4bf1-a935-2b44db8fbfed None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:14.012409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9889-f2c1-4bf1-a935-2b44db8fbfed None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:14.012690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9889-f2c1-4bf1-a935-2b44db8fbfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:14.012795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f20d0f-2f36-4d8a-a410-a73dbee2d2d8 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:14.016037 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 17/39] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:13 2022] GET /identity/v3/users/ee071968090a43639b3c920bae3fb546 => generated 247 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:14.018559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf333-a3eb-4f82-9304-4204da2cd4c2 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:14.019076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf333-a3eb-4f82-9304-4204da2cd4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:14.019551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf333-a3eb-4f82-9304-4204da2cd4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:14.036753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-812e9889-f2c1-4bf1-a935-2b44db8fbfed None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:14.038409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-812e9889-f2c1-4bf1-a935-2b44db8fbfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:14.051573 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-d5ccf333-a3eb-4f82-9304-4204da2cd4c2 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:14.053689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d5ccf333-a3eb-4f82-9304-4204da2cd4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:14.135977 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 23/40] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:14.138642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9889-f2c1-4bf1-a935-2b44db8fbfed None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:14.253791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:14.266791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 18/41] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:14.293365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9889-f2c1-4bf1-a935-2b44db8fbfed None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:14.323830 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:14.339590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432c15d-b58c-4f41-8067-f607b76494db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:14.341021 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432c15d-b58c-4f41-8067-f607b76494db None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:14.341659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432c15d-b58c-4f41-8067-f607b76494db None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:14.341937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432c15d-b58c-4f41-8067-f607b76494db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:14.343432 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432c15d-b58c-4f41-8067-f607b76494db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:14.345093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432c15d-b58c-4f41-8067-f607b76494db None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:14.346964 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 24/42] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:14.352436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccf333-a3eb-4f82-9304-4204da2cd4c2 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:14.407672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432c15d-b58c-4f41-8067-f607b76494db None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:14.518524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccf333-a3eb-4f82-9304-4204da2cd4c2 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:14.529030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432c15d-b58c-4f41-8067-f607b76494db None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:14.570692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7b1d9-7f20-4edb-bd76-c881f8cc6c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:14.572266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7b1d9-7f20-4edb-bd76-c881f8cc6c10 None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:14.573152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7b1d9-7f20-4edb-bd76-c881f8cc6c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:14.574164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7b1d9-7f20-4edb-bd76-c881f8cc6c10 None admin] PATH_INFO: `/v3/domains/default/users/ee071968090a43639b3c920bae3fb546/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:14.578217 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7b1d9-7f20-4edb-bd76-c881f8cc6c10 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ee071968090a43639b3c920bae3fb546, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:14.581214 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7b1d9-7f20-4edb-bd76-c881f8cc6c10 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:14.582084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c6dc4-b037-4162-a369-41ef1dfedc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:14.582808 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c6dc4-b037-4162-a369-41ef1dfedc91 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:14.583087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c6dc4-b037-4162-a369-41ef1dfedc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:14.583359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c6dc4-b037-4162-a369-41ef1dfedc91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:14.584493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c6dc4-b037-4162-a369-41ef1dfedc91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:14.586322 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c6dc4-b037-4162-a369-41ef1dfedc91 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:14.588367 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 25/43] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:14.594574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c6dc4-b037-4162-a369-41ef1dfedc91 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:14.607068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 19/44] 10.222.0.77 () {58 vars in 1361 bytes} [Mon Aug 22 15:48:14 2022] PUT /identity/v3/domains/default/users/ee071968090a43639b3c920bae3fb546/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:48:14.608649 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7b1d9-7f20-4edb-bd76-c881f8cc6c10 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:14.687780 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:14.692598 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:14.760862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c6dc4-b037-4162-a369-41ef1dfedc91 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:14.772831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7b1d9-7f20-4edb-bd76-c881f8cc6c10 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:14.821179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70805b-4689-4e82-bc1b-6076e297e31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:14.821890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70805b-4689-4e82-bc1b-6076e297e31a None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:14.822304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70805b-4689-4e82-bc1b-6076e297e31a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:14.822784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70805b-4689-4e82-bc1b-6076e297e31a None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:14.823479 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70805b-4689-4e82-bc1b-6076e297e31a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:14.824918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70805b-4689-4e82-bc1b-6076e297e31a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:14.839895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421507bf-9348-46fb-883c-641817a6777f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:14.840941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421507bf-9348-46fb-883c-641817a6777f None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:14.841357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 26/45] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Aug 22 15:48:14 2022] POST /identity/v3/roles => generated 223 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:14.841474 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421507bf-9348-46fb-883c-641817a6777f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:14.841903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421507bf-9348-46fb-883c-641817a6777f None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:14.843073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421507bf-9348-46fb-883c-641817a6777f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:14.845859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421507bf-9348-46fb-883c-641817a6777f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:14.899353 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 20/46] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 22 15:48:14 2022] POST /identity/v3/projects => generated 312 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:16.567673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ce5cb-6f0e-4d67-835a-e009bdcb2fbf None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:16.568235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ce5cb-6f0e-4d67-835a-e009bdcb2fbf None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:16.568235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ce5cb-6f0e-4d67-835a-e009bdcb2fbf None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:16.569606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 27/47] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:16.575526 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368cb31-f562-4f94-a0cd-5db84575030d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:16.575994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368cb31-f562-4f94-a0cd-5db84575030d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:16.576114 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368cb31-f562-4f94-a0cd-5db84575030d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:16.595756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-3368cb31-f562-4f94-a0cd-5db84575030d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:16.596857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3368cb31-f562-4f94-a0cd-5db84575030d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:16.667368 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 21/48] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:16.838385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e5b43-2628-438b-9e82-7d0560adf508 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:16.838730 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e5b43-2628-438b-9e82-7d0560adf508 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:16.838985 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e5b43-2628-438b-9e82-7d0560adf508 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:16.840433 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 28/49] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:16.845704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb89e1-4d62-4b7b-ad91-56480819b44a None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:16.846051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb89e1-4d62-4b7b-ad91-56480819b44a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:16.846269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb89e1-4d62-4b7b-ad91-56480819b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:16.865020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-b0fb89e1-4d62-4b7b-ad91-56480819b44a None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:16.866223 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-b0fb89e1-4d62-4b7b-ad91-56480819b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:16.892802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:16.933056 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e5b43-2628-438b-9e82-7d0560adf508 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:16.936446 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 22/50] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:17.042987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e5b43-2628-438b-9e82-7d0560adf508 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:17.071741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:17.088020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86619cd3-b005-4ba8-b67f-e6a8c465f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:17.088657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86619cd3-b005-4ba8-b67f-e6a8c465f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:17.088942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86619cd3-b005-4ba8-b67f-e6a8c465f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:17.089219 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86619cd3-b005-4ba8-b67f-e6a8c465f7a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:17.100674 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86619cd3-b005-4ba8-b67f-e6a8c465f7a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-86619cd3-b005-4ba8-b67f-e6a8c465f7a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:17.105361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:17.106191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:17.106976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:17.106976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:17.106976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:17.106976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:17.106976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:17.106976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:17.106976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:17.106976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:17.106976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:17.106976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:17.106976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:17.106976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:17.106976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 29/51] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:48:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:17.113705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb89e1-4d62-4b7b-ad91-56480819b44a None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:17.200271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86619cd3-b005-4ba8-b67f-e6a8c465f7a4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:17.215553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb89e1-4d62-4b7b-ad91-56480819b44a None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:17.251622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb259c1-f7a7-4c82-be77-8c648db9fe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:17.252228 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb259c1-f7a7-4c82-be77-8c648db9fe83 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:17.252499 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb259c1-f7a7-4c82-be77-8c648db9fe83 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:17.252775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb259c1-f7a7-4c82-be77-8c648db9fe83 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:17.253460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb259c1-f7a7-4c82-be77-8c648db9fe83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:17.253760 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb259c1-f7a7-4c82-be77-8c648db9fe83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:17.255242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb259c1-f7a7-4c82-be77-8c648db9fe83 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:17.263920 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 23/52] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:17.269482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb259c1-f7a7-4c82-be77-8c648db9fe83 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:17.295569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:17.308996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86619cd3-b005-4ba8-b67f-e6a8c465f7a4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:17.343900 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc3ea8-05a9-4c57-af69-d25e3381ded3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:17.344536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc3ea8-05a9-4c57-af69-d25e3381ded3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:17.344817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc3ea8-05a9-4c57-af69-d25e3381ded3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:17.345134 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc3ea8-05a9-4c57-af69-d25e3381ded3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:17.346214 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc3ea8-05a9-4c57-af69-d25e3381ded3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:17.347740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc3ea8-05a9-4c57-af69-d25e3381ded3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:17.349480 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 30/53] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:17.355045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc3ea8-05a9-4c57-af69-d25e3381ded3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:17.369918 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb259c1-f7a7-4c82-be77-8c648db9fe83 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:17.403109 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:17.405719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549904c0-d790-4ad7-b64d-fe89eb50ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:17.406404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549904c0-d790-4ad7-b64d-fe89eb50ed59 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:17.406815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549904c0-d790-4ad7-b64d-fe89eb50ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:17.407123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549904c0-d790-4ad7-b64d-fe89eb50ed59 None admin] PATH_INFO: `/v3/users/ee071968090a43639b3c920bae3fb546` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:17.408291 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549904c0-d790-4ad7-b64d-fe89eb50ed59 None admin] RBAC: Authorizing `identity:get_user(user_id=ee071968090a43639b3c920bae3fb546)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:17.409771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549904c0-d790-4ad7-b64d-fe89eb50ed59 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:17.411605 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 24/54] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:17 2022] GET /identity/v3/users/ee071968090a43639b3c920bae3fb546 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:17.416960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549904c0-d790-4ad7-b64d-fe89eb50ed59 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:17.455523 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc3ea8-05a9-4c57-af69-d25e3381ded3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:17.487925 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8718e-0a77-425e-84f4-5cf169e347b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:17.488528 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8718e-0a77-425e-84f4-5cf169e347b1 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:17.488804 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8718e-0a77-425e-84f4-5cf169e347b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:17.489074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8718e-0a77-425e-84f4-5cf169e347b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:17.489710 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8718e-0a77-425e-84f4-5cf169e347b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:17.491206 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8718e-0a77-425e-84f4-5cf169e347b1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:17.508247 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:17.517967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549904c0-d790-4ad7-b64d-fe89eb50ed59 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:17.518518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 31/55] 10.222.0.77 () {60 vars in 1140 bytes} [Mon Aug 22 15:48:17 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:48:17.557746 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e26c6-b5f5-4c12-9bc8-c80905120ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:17.558404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e26c6-b5f5-4c12-9bc8-c80905120ace None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:17.558792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e26c6-b5f5-4c12-9bc8-c80905120ace None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:17.559036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e26c6-b5f5-4c12-9bc8-c80905120ace None admin] PATH_INFO: `/v3/domains/default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:17.560245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e26c6-b5f5-4c12-9bc8-c80905120ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:17.561773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e26c6-b5f5-4c12-9bc8-c80905120ace None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:17.568727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 25/56] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:17.569909 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8718e-0a77-425e-84f4-5cf169e347b1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:17.674872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:17.678038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8718e-0a77-425e-84f4-5cf169e347b1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:17.715379 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165db0c-4df0-41db-a458-c72aa310d924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:17.715988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165db0c-4df0-41db-a458-c72aa310d924 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:17.716264 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165db0c-4df0-41db-a458-c72aa310d924 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:17.716502 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165db0c-4df0-41db-a458-c72aa310d924 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:17.717256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165db0c-4df0-41db-a458-c72aa310d924 None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.domain.id=default, user.id=ee071968090a43639b3c920bae3fb546) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:17.717543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165db0c-4df0-41db-a458-c72aa310d924 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:17.719030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165db0c-4df0-41db-a458-c72aa310d924 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:17.727944 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 32/57] 10.222.0.77 () {56 vars in 1322 bytes} [Mon Aug 22 15:48:17 2022] GET /identity/v3/role_assignments?user.id=ee071968090a43639b3c920bae3fb546&scope.domain.id=default&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:19.444912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d31a1-a219-44bd-8822-66d9a43094d9 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:19.445427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d31a1-a219-44bd-8822-66d9a43094d9 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:19.445512 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d31a1-a219-44bd-8822-66d9a43094d9 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:19.447482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 26/58] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:19.452952 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352609a-bb9c-4816-8a20-2750712b6846 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:19.453326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352609a-bb9c-4816-8a20-2750712b6846 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:19.453504 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352609a-bb9c-4816-8a20-2750712b6846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:19.473600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0352609a-bb9c-4816-8a20-2750712b6846 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:19.474863 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0352609a-bb9c-4816-8a20-2750712b6846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:19.555637 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 33/59] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:19.825256 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d31a1-a219-44bd-8822-66d9a43094d9 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:19.952738 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d31a1-a219-44bd-8822-66d9a43094d9 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:19.994176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce08c6-af55-4a67-875f-ad982eb1c364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:19.994845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce08c6-af55-4a67-875f-ad982eb1c364 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:19.995128 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce08c6-af55-4a67-875f-ad982eb1c364 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:19.995493 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce08c6-af55-4a67-875f-ad982eb1c364 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:19.996746 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce08c6-af55-4a67-875f-ad982eb1c364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:19.998208 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce08c6-af55-4a67-875f-ad982eb1c364 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:19.999825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 27/60] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:20.006229 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352609a-bb9c-4816-8a20-2750712b6846 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:20.108802 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:20.116994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352609a-bb9c-4816-8a20-2750712b6846 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:20.154057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02e4ed-4aee-4780-9587-d28e2eb41a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:20.154689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e4ed-4aee-4780-9587-d28e2eb41a44 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:20.154974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e4ed-4aee-4780-9587-d28e2eb41a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:20.155244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e4ed-4aee-4780-9587-d28e2eb41a44 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:20.155897 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02e4ed-4aee-4780-9587-d28e2eb41a44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:20.157371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02e4ed-4aee-4780-9587-d28e2eb41a44 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:20.187396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 34/61] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:48:20 2022] POST /identity/v3/users => generated 275 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:23.245622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde5fe7-4ae5-4c47-be42-25467e72a97f None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:23.246705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde5fe7-4ae5-4c47-be42-25467e72a97f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:23.247184 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde5fe7-4ae5-4c47-be42-25467e72a97f None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:23.249113 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 28/62] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:23.260715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228dfb4-5722-49f1-aa75-3276c3075a4f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:23.261663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228dfb4-5722-49f1-aa75-3276c3075a4f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:23.262130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228dfb4-5722-49f1-aa75-3276c3075a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:23.288001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5228dfb4-5722-49f1-aa75-3276c3075a4f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:23.289627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5228dfb4-5722-49f1-aa75-3276c3075a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:23.380616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 35/63] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:23.525597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c966d-9ec5-4b5f-9f0e-d8dc973e685d None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:23.525817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c966d-9ec5-4b5f-9f0e-d8dc973e685d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:23.526145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c966d-9ec5-4b5f-9f0e-d8dc973e685d None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:23.527590 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 29/64] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:23.542145 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcae4f9-5b80-47f8-b2da-2e8c50144d2e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:23.542531 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcae4f9-5b80-47f8-b2da-2e8c50144d2e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:23.542791 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcae4f9-5b80-47f8-b2da-2e8c50144d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:23.562243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3fcae4f9-5b80-47f8-b2da-2e8c50144d2e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:23.563502 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3fcae4f9-5b80-47f8-b2da-2e8c50144d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:23.611647 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea0256-53f8-4718-a85e-b414b73578c5 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:23.612014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea0256-53f8-4718-a85e-b414b73578c5 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:23.612211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea0256-53f8-4718-a85e-b414b73578c5 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:23.613923 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 30/65] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:23.635505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1510a4-e5dd-4dcc-89b7-eb8306c6ad16 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:23.635802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1510a4-e5dd-4dcc-89b7-eb8306c6ad16 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:23.636065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1510a4-e5dd-4dcc-89b7-eb8306c6ad16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:23.646491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 36/66] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:23.668410 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-fd1510a4-e5dd-4dcc-89b7-eb8306c6ad16 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:23.669687 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-fd1510a4-e5dd-4dcc-89b7-eb8306c6ad16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:23.697611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:23.712636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcae4f9-5b80-47f8-b2da-2e8c50144d2e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:23.734984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:23.784664 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 31/67] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:48:23.867064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7de6f8-5413-4973-ba34-d430cc85fc74 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:23.867399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7de6f8-5413-4973-ba34-d430cc85fc74 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:23.867634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7de6f8-5413-4973-ba34-d430cc85fc74 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:23.870055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 32/68] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:23.884396 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff8744-538f-4070-a4a2-27639b4f2830 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:23.884704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff8744-538f-4070-a4a2-27639b4f2830 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:23.884950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff8744-538f-4070-a4a2-27639b4f2830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:23.906865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-20ff8744-538f-4070-a4a2-27639b4f2830 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:23.908519 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-20ff8744-538f-4070-a4a2-27639b4f2830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:23.913569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcae4f9-5b80-47f8-b2da-2e8c50144d2e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:23.981638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251d8f3-95fd-43cb-9ff8-ac95e9c7fa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:23.982299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251d8f3-95fd-43cb-9ff8-ac95e9c7fa5c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:23.982582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251d8f3-95fd-43cb-9ff8-ac95e9c7fa5c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:23.982898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251d8f3-95fd-43cb-9ff8-ac95e9c7fa5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:23.995291 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 33/69] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:48:23.995472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251d8f3-95fd-43cb-9ff8-ac95e9c7fa5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:23.995974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff8744-538f-4070-a4a2-27639b4f2830 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-5251d8f3-95fd-43cb-9ff8-ac95e9c7fa5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:24.008411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:24.009392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:24.010168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:24.010168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:24.010168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:24.010168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:24.010168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:24.010168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:24.010168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:24.010168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:24.010168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:24.010168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:24.010168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:24.010168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:24.010168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 37/70] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:48:24.018724 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251d8f3-95fd-43cb-9ff8-ac95e9c7fa5c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:24.092191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:24.106495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff8744-538f-4070-a4a2-27639b4f2830 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:24.131912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:24.146105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a7d4d-6e23-46a6-b44a-7c68521a4e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:24.147053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a7d4d-6e23-46a6-b44a-7c68521a4e84 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:24.147343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a7d4d-6e23-46a6-b44a-7c68521a4e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:24.147728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a7d4d-6e23-46a6-b44a-7c68521a4e84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:24.161680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a7d4d-6e23-46a6-b44a-7c68521a4e84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:24.166240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251d8f3-95fd-43cb-9ff8-ac95e9c7fa5c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-a94a7d4d-6e23-46a6-b44a-7c68521a4e84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:24.166797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:24.175143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:24.176054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:24.176054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:24.176054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:24.176054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:24.176054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:24.176054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:24.176054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:24.176054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:24.176054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:24.176054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:24.176054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:24.176054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:24.176054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 34/71] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:48:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:24.176054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6d5e7-63c2-4384-9623-c3e27ded2e91 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:24.177036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6d5e7-63c2-4384-9623-c3e27ded2e91 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:24.177036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6d5e7-63c2-4384-9623-c3e27ded2e91 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:24.177036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 35/72] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:24.177036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6d5e7-63c2-4384-9623-c3e27ded2e91 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:24.335459 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6d5e7-63c2-4384-9623-c3e27ded2e91 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:24.344612 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71f6ba-cddb-4da5-9def-bc044c58fd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:24.345160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71f6ba-cddb-4da5-9def-bc044c58fd65 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:24.345443 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71f6ba-cddb-4da5-9def-bc044c58fd65 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:24.345713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71f6ba-cddb-4da5-9def-bc044c58fd65 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:24.346421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71f6ba-cddb-4da5-9def-bc044c58fd65 None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:24.346760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71f6ba-cddb-4da5-9def-bc044c58fd65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:24.348306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71f6ba-cddb-4da5-9def-bc044c58fd65 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:24.357706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 38/73] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:24.362525 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9b1cd-a965-4bcd-952d-3e406e2a2a72 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:24.362525 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9b1cd-a965-4bcd-952d-3e406e2a2a72 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:24.362525 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9b1cd-a965-4bcd-952d-3e406e2a2a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:24.377654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd394b7-83b6-4ec5-bae1-9e61b6867eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:24.378304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd394b7-83b6-4ec5-bae1-9e61b6867eca None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:24.378583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd394b7-83b6-4ec5-bae1-9e61b6867eca None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:24.378888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd394b7-83b6-4ec5-bae1-9e61b6867eca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:24.381299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3de9b1cd-a965-4bcd-952d-3e406e2a2a72 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:24.382542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3de9b1cd-a965-4bcd-952d-3e406e2a2a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:24.399548 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd394b7-83b6-4ec5-bae1-9e61b6867eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-dbd394b7-83b6-4ec5-bae1-9e61b6867eca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:24.404522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:24.405604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:24.407851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:24.407851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:24.407851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:24.407851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:24.407851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:24.407851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:24.407851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:24.407851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:24.407851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:24.407851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:24.407851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:24.407851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:24.407851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 36/74] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:24.407851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd394b7-83b6-4ec5-bae1-9e61b6867eca None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:24.419127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:24.462431 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 39/75] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:24.463349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9b1cd-a965-4bcd-952d-3e406e2a2a72 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:24.530116 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd394b7-83b6-4ec5-bae1-9e61b6867eca None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:24.539318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:24.574538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37450a-9c67-4da4-b712-e55d83ee80d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:24.575169 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37450a-9c67-4da4-b712-e55d83ee80d3 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:24.575451 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37450a-9c67-4da4-b712-e55d83ee80d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:24.575719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37450a-9c67-4da4-b712-e55d83ee80d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:24.576392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37450a-9c67-4da4-b712-e55d83ee80d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:24.576687 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37450a-9c67-4da4-b712-e55d83ee80d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:24.578412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37450a-9c67-4da4-b712-e55d83ee80d3 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:24.590836 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 37/76] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:24.596166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37450a-9c67-4da4-b712-e55d83ee80d3 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:24.598303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9b1cd-a965-4bcd-952d-3e406e2a2a72 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:24.658299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5521b-aae8-4487-b5ed-44bb56fd4198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:24.659069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5521b-aae8-4487-b5ed-44bb56fd4198 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:24.659424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5521b-aae8-4487-b5ed-44bb56fd4198 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:24.659714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5521b-aae8-4487-b5ed-44bb56fd4198 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:24.674511 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5521b-aae8-4487-b5ed-44bb56fd4198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-0ee5521b-aae8-4487-b5ed-44bb56fd4198 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:24.681836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:24.682796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:24.683648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:24.683648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:24.683648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:24.683648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:24.683648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:24.683648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:24.683648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:24.683648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:24.683648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:24.683648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:24.683648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:48:24.683648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:24.684226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 40/77] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:48:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:24.687590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5521b-aae8-4487-b5ed-44bb56fd4198 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:24.693879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:24.737927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37450a-9c67-4da4-b712-e55d83ee80d3 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:24.774102 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f421e7-a7af-4c98-bc5a-cd0cd10abf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:24.774805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f421e7-a7af-4c98-bc5a-cd0cd10abf9b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:24.775090 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f421e7-a7af-4c98-bc5a-cd0cd10abf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:24.775367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f421e7-a7af-4c98-bc5a-cd0cd10abf9b None admin] PATH_INFO: `/v3/users/7844dee1bb874523a45debbded632cde` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:24.788826 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f421e7-a7af-4c98-bc5a-cd0cd10abf9b None admin] RBAC: Authorizing `identity:get_user(user_id=7844dee1bb874523a45debbded632cde)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:24.790355 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f421e7-a7af-4c98-bc5a-cd0cd10abf9b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:24.792383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 38/78] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:24 2022] GET /identity/v3/users/7844dee1bb874523a45debbded632cde => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:24.792947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f421e7-a7af-4c98-bc5a-cd0cd10abf9b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:24.798026 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5521b-aae8-4487-b5ed-44bb56fd4198 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:24.820304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:24.832498 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14650703-a5cd-471b-9bde-91dc6805dba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:24.833488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14650703-a5cd-471b-9bde-91dc6805dba5 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:24.833488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14650703-a5cd-471b-9bde-91dc6805dba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:24.833665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14650703-a5cd-471b-9bde-91dc6805dba5 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:24.834306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14650703-a5cd-471b-9bde-91dc6805dba5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:24.834629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14650703-a5cd-471b-9bde-91dc6805dba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:24.836024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14650703-a5cd-471b-9bde-91dc6805dba5 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:24.844643 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 41/79] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:24.845460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14650703-a5cd-471b-9bde-91dc6805dba5 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:24.899379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f421e7-a7af-4c98-bc5a-cd0cd10abf9b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:24.926813 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:24.935608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2ab3c-9a4d-4fc5-839d-88a6b2122b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:24.936250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2ab3c-9a4d-4fc5-839d-88a6b2122b00 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:24.936526 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2ab3c-9a4d-4fc5-839d-88a6b2122b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:24.936797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2ab3c-9a4d-4fc5-839d-88a6b2122b00 None admin] PATH_INFO: `/v3/users/ee071968090a43639b3c920bae3fb546` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:24.938175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2ab3c-9a4d-4fc5-839d-88a6b2122b00 None admin] RBAC: Authorizing `identity:get_user(user_id=ee071968090a43639b3c920bae3fb546)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:24.939682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2ab3c-9a4d-4fc5-839d-88a6b2122b00 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:24.941288 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 39/80] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:24 2022] GET /identity/v3/users/ee071968090a43639b3c920bae3fb546 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:24.942063 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2ab3c-9a4d-4fc5-839d-88a6b2122b00 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:24.946963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14650703-a5cd-471b-9bde-91dc6805dba5 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:24.984792 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38824e-3ff4-4cc5-95a1-42e09923901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:24.985421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38824e-3ff4-4cc5-95a1-42e09923901a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:24.985723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38824e-3ff4-4cc5-95a1-42e09923901a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:24.985997 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38824e-3ff4-4cc5-95a1-42e09923901a None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:24.986705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38824e-3ff4-4cc5-95a1-42e09923901a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:24.987006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38824e-3ff4-4cc5-95a1-42e09923901a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:24.988409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38824e-3ff4-4cc5-95a1-42e09923901a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:24.997361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 42/81] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:48:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:24.998217 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38824e-3ff4-4cc5-95a1-42e09923901a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:25.049108 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2ab3c-9a4d-4fc5-839d-88a6b2122b00 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:25.052083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:25.086559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f505e-2a11-434b-9058-d3f3e68bdf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:25.087595 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f505e-2a11-434b-9058-d3f3e68bdf76 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:25.087873 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f505e-2a11-434b-9058-d3f3e68bdf76 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:25.088150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f505e-2a11-434b-9058-d3f3e68bdf76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:25.089324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f505e-2a11-434b-9058-d3f3e68bdf76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:25.090847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f505e-2a11-434b-9058-d3f3e68bdf76 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:25.092462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 40/82] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:25.093241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f505e-2a11-434b-9058-d3f3e68bdf76 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:25.107291 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38824e-3ff4-4cc5-95a1-42e09923901a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:25.142311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176e28b-e57f-44d3-8416-9dbffdc4d716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:25.142955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176e28b-e57f-44d3-8416-9dbffdc4d716 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:25.143232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176e28b-e57f-44d3-8416-9dbffdc4d716 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:25.143507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176e28b-e57f-44d3-8416-9dbffdc4d716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:25.156219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:25.196355 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f505e-2a11-434b-9058-d3f3e68bdf76 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:25.234060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176e28b-e57f-44d3-8416-9dbffdc4d716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:25.235723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176e28b-e57f-44d3-8416-9dbffdc4d716 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:25.238296 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc93a1d-97fe-446c-88c4-0ac9f1db781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:25.239109 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc93a1d-97fe-446c-88c4-0ac9f1db781b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:25.239422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc93a1d-97fe-446c-88c4-0ac9f1db781b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:25.239820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc93a1d-97fe-446c-88c4-0ac9f1db781b None admin] PATH_INFO: `/v3/users/7844dee1bb874523a45debbded632cde` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:25.241164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc93a1d-97fe-446c-88c4-0ac9f1db781b None admin] RBAC: Authorizing `identity:get_user(user_id=7844dee1bb874523a45debbded632cde)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:25.243239 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc93a1d-97fe-446c-88c4-0ac9f1db781b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:25.245284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 41/83] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:25 2022] GET /identity/v3/users/7844dee1bb874523a45debbded632cde => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:25.246903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc93a1d-97fe-446c-88c4-0ac9f1db781b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:25.293409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:25.358189 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 43/84] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:25.359327 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176e28b-e57f-44d3-8416-9dbffdc4d716 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:25.372973 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc93a1d-97fe-446c-88c4-0ac9f1db781b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:25.403347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:25.410283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5b803-e9b1-4151-aadf-e3d78c6f7902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:25.410860 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5b803-e9b1-4151-aadf-e3d78c6f7902 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:25.411236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5b803-e9b1-4151-aadf-e3d78c6f7902 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:25.411613 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5b803-e9b1-4151-aadf-e3d78c6f7902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:25.463340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176e28b-e57f-44d3-8416-9dbffdc4d716 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:25.487068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5b803-e9b1-4151-aadf-e3d78c6f7902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:25.488578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5b803-e9b1-4151-aadf-e3d78c6f7902 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:25.510845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b85e94-2cab-4fa7-b286-34998cb52330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:25.511483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85e94-2cab-4fa7-b286-34998cb52330 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:25.511759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85e94-2cab-4fa7-b286-34998cb52330 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:25.512065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85e94-2cab-4fa7-b286-34998cb52330 None admin] PATH_INFO: `/v3/users/7844dee1bb874523a45debbded632cde` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:25.513206 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b85e94-2cab-4fa7-b286-34998cb52330 None admin] RBAC: Authorizing `identity:get_user(user_id=7844dee1bb874523a45debbded632cde)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:25.514749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b85e94-2cab-4fa7-b286-34998cb52330 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:25.516326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 44/85] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:25 2022] GET /identity/v3/users/7844dee1bb874523a45debbded632cde => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:25.517066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b85e94-2cab-4fa7-b286-34998cb52330 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:25.541973 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:25.601726 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 42/86] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:25.603084 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5b803-e9b1-4151-aadf-e3d78c6f7902 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:25.637460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b85e94-2cab-4fa7-b286-34998cb52330 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:25.651250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:25.674558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324033a-5f7c-4579-b219-01ed4d2a692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:25.675218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324033a-5f7c-4579-b219-01ed4d2a692d None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:25.675481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324033a-5f7c-4579-b219-01ed4d2a692d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:25.675759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324033a-5f7c-4579-b219-01ed4d2a692d None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:25.676440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324033a-5f7c-4579-b219-01ed4d2a692d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:25.677895 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324033a-5f7c-4579-b219-01ed4d2a692d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:25.702223 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 45/87] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:48:25 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:25.703140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324033a-5f7c-4579-b219-01ed4d2a692d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:25.752429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5b803-e9b1-4151-aadf-e3d78c6f7902 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:25.803877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:25.804923 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8426-56bb-4819-8fed-f5c2f5833665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:25.805701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8426-56bb-4819-8fed-f5c2f5833665 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:25.806043 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8426-56bb-4819-8fed-f5c2f5833665 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:25.806380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8426-56bb-4819-8fed-f5c2f5833665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:25.863508 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324033a-5f7c-4579-b219-01ed4d2a692d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:25.920698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cef83-6087-427e-a0cc-c67e7eced27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:25.920904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cef83-6087-427e-a0cc-c67e7eced27d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:25.921332 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cef83-6087-427e-a0cc-c67e7eced27d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:25.921731 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cef83-6087-427e-a0cc-c67e7eced27d None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:25.923437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cef83-6087-427e-a0cc-c67e7eced27d None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:25.923577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df8426-56bb-4819-8fed-f5c2f5833665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:25.925042 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cef83-6087-427e-a0cc-c67e7eced27d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:25.926019 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df8426-56bb-4819-8fed-f5c2f5833665 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:25.927488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 46/88] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:25 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:25.927650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cef83-6087-427e-a0cc-c67e7eced27d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:25.974204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:26.076611 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cef83-6087-427e-a0cc-c67e7eced27d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:26.081052 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 43/89] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:26.082404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8426-56bb-4819-8fed-f5c2f5833665 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:26.127044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68131886-babb-4c87-a5f8-f8479d80eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:26.128111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68131886-babb-4c87-a5f8-f8479d80eea5 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:26.128629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68131886-babb-4c87-a5f8-f8479d80eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:26.129140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68131886-babb-4c87-a5f8-f8479d80eea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:26.143564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:26.208598 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8426-56bb-4819-8fed-f5c2f5833665 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:26.215131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68131886-babb-4c87-a5f8-f8479d80eea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:26.216647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68131886-babb-4c87-a5f8-f8479d80eea5 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:26.242341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:26.249051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1af65-bf75-4ecb-b01a-217e688c93fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:26.250043 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1af65-bf75-4ecb-b01a-217e688c93fb None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:26.250547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1af65-bf75-4ecb-b01a-217e688c93fb None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:26.251083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1af65-bf75-4ecb-b01a-217e688c93fb None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:26.252624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1af65-bf75-4ecb-b01a-217e688c93fb None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:26.254414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce1af65-bf75-4ecb-b01a-217e688c93fb None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:26.256404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 44/90] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:26 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:26.257431 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1af65-bf75-4ecb-b01a-217e688c93fb None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:26.324772 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 47/91] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:26.325768 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68131886-babb-4c87-a5f8-f8479d80eea5 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:26.371047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:26.408774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1af65-bf75-4ecb-b01a-217e688c93fb None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:26.442366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68131886-babb-4c87-a5f8-f8479d80eea5 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:26.464773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfa3f0-c6fb-431b-b47b-117b866e3e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:26.465738 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfa3f0-c6fb-431b-b47b-117b866e3e67 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:26.466216 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfa3f0-c6fb-431b-b47b-117b866e3e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:26.466726 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfa3f0-c6fb-431b-b47b-117b866e3e67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:26.467670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfa3f0-c6fb-431b-b47b-117b866e3e67 None admin] RBAC: Adding query filter params (role.id=f866ebebacd841168b26ac7ec2c7461b, scope.project.id=25b73a36dde84c9d97a80501da4f16d0, user.id=7844dee1bb874523a45debbded632cde) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:26.468198 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfa3f0-c6fb-431b-b47b-117b866e3e67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:26.469868 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfa3f0-c6fb-431b-b47b-117b866e3e67 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:26.476115 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 45/92] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:26 2022] GET /identity/v3/role_assignments?user.id=7844dee1bb874523a45debbded632cde&scope.project.id=25b73a36dde84c9d97a80501da4f16d0&role.id=f866ebebacd841168b26ac7ec2c7461b => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:26.477276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfa3f0-c6fb-431b-b47b-117b866e3e67 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:26.493984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073c29e-6d28-4326-8c49-c22e8af43eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:26.494694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c29e-6d28-4326-8c49-c22e8af43eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:26.494981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c29e-6d28-4326-8c49-c22e8af43eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:26.495257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c29e-6d28-4326-8c49-c22e8af43eb6 None admin] PATH_INFO: `/v3/projects/c04ba4146576497da42624a6ecb68d3c` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:26.499541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073c29e-6d28-4326-8c49-c22e8af43eb6 None admin] RBAC: Authorizing `identity:get_project(project_id=c04ba4146576497da42624a6ecb68d3c)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:26.501115 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073c29e-6d28-4326-8c49-c22e8af43eb6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:26.503262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 48/93] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:26 2022] GET /identity/v3/projects/c04ba4146576497da42624a6ecb68d3c => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:26.504062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073c29e-6d28-4326-8c49-c22e8af43eb6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:26.552164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:26.633414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfa3f0-c6fb-431b-b47b-117b866e3e67 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:26.709394 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24d368-878b-4e1d-a36b-ed5c3df8fc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:26.711708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24d368-878b-4e1d-a36b-ed5c3df8fc86 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:26.711958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24d368-878b-4e1d-a36b-ed5c3df8fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:26.712237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24d368-878b-4e1d-a36b-ed5c3df8fc86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:26.713097 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24d368-878b-4e1d-a36b-ed5c3df8fc86 None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=25b73a36dde84c9d97a80501da4f16d0, user.id=ee071968090a43639b3c920bae3fb546) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:26.713447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24d368-878b-4e1d-a36b-ed5c3df8fc86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:26.715084 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24d368-878b-4e1d-a36b-ed5c3df8fc86 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:26.721608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 46/94] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:26 2022] GET /identity/v3/role_assignments?user.id=ee071968090a43639b3c920bae3fb546&scope.project.id=25b73a36dde84c9d97a80501da4f16d0&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:26.722391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24d368-878b-4e1d-a36b-ed5c3df8fc86 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:26.734944 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073c29e-6d28-4326-8c49-c22e8af43eb6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:26.746917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:26.807172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc802973-f517-4a72-a031-cc52d409a14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:26.807840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc802973-f517-4a72-a031-cc52d409a14e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:26.808121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc802973-f517-4a72-a031-cc52d409a14e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:26.808395 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc802973-f517-4a72-a031-cc52d409a14e None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:26.810693 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc802973-f517-4a72-a031-cc52d409a14e None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:26.812290 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc802973-f517-4a72-a031-cc52d409a14e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:26.814180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 49/95] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:26 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:26.820335 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc802973-f517-4a72-a031-cc52d409a14e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:26.935956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24d368-878b-4e1d-a36b-ed5c3df8fc86 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:26.996022 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:27.013390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c87f7-cf61-4216-912c-ece523044cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:27.014024 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c87f7-cf61-4216-912c-ece523044cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:27.014308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c87f7-cf61-4216-912c-ece523044cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:27.014587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c87f7-cf61-4216-912c-ece523044cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:27.017018 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc802973-f517-4a72-a031-cc52d409a14e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:27.019597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c87f7-cf61-4216-912c-ece523044cb7 None admin] RBAC: Adding query filter params (role.id=f866ebebacd841168b26ac7ec2c7461b, scope.project.id=c04ba4146576497da42624a6ecb68d3c, user.id=7844dee1bb874523a45debbded632cde) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:27.019928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c87f7-cf61-4216-912c-ece523044cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:27.021471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c87f7-cf61-4216-912c-ece523044cb7 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:27.031470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 47/96] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:26 2022] GET /identity/v3/role_assignments?user.id=7844dee1bb874523a45debbded632cde&scope.project.id=c04ba4146576497da42624a6ecb68d3c&role.id=f866ebebacd841168b26ac7ec2c7461b => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:27.094334 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c18cd-053f-4322-8369-3cdd8cb94e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:27.095001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c18cd-053f-4322-8369-3cdd8cb94e73 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:27.095284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c18cd-053f-4322-8369-3cdd8cb94e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:27.095559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c18cd-053f-4322-8369-3cdd8cb94e73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:27.096323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c18cd-053f-4322-8369-3cdd8cb94e73 None admin] RBAC: Adding query filter params (role.id=64aca4dbf153454d8abb3af690d90c76, scope.project.id=25b73a36dde84c9d97a80501da4f16d0, user.id=7844dee1bb874523a45debbded632cde) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:27.096638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c18cd-053f-4322-8369-3cdd8cb94e73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:27.098257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c18cd-053f-4322-8369-3cdd8cb94e73 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:27.107574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 50/97] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:26 2022] GET /identity/v3/role_assignments?user.id=7844dee1bb874523a45debbded632cde&scope.project.id=25b73a36dde84c9d97a80501da4f16d0&role.id=64aca4dbf153454d8abb3af690d90c76 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:28.496805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d37120-354d-4fe5-9080-0e25b9fa8eeb None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:28.497318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d37120-354d-4fe5-9080-0e25b9fa8eeb None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:28.498047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d37120-354d-4fe5-9080-0e25b9fa8eeb None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:28.500022 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 48/98] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:28.505894 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c7d1e-89fc-4980-bc1d-26257b78dd3a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:28.506410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c7d1e-89fc-4980-bc1d-26257b78dd3a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:28.506483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c7d1e-89fc-4980-bc1d-26257b78dd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:28.534390 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5f7c7d1e-89fc-4980-bc1d-26257b78dd3a None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:28.535678 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5f7c7d1e-89fc-4980-bc1d-26257b78dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:28.573693 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:28.622763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 51/99] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:28.993742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d37120-354d-4fe5-9080-0e25b9fa8eeb None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:29.026402 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73548832-8a8d-4637-b376-f2e203742500 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:29.026719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73548832-8a8d-4637-b376-f2e203742500 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:29.026998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73548832-8a8d-4637-b376-f2e203742500 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:29.028359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 52/100] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:29.035890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ae552-07fc-433b-940e-68ce8b7e6ec1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:29.036420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ae552-07fc-433b-940e-68ce8b7e6ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:29.036886 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ae552-07fc-433b-940e-68ce8b7e6ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:29.064754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2c5ae552-07fc-433b-940e-68ce8b7e6ec1 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:29.066273 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2c5ae552-07fc-433b-940e-68ce8b7e6ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:29.161205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 53/101] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:29.189351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d37120-354d-4fe5-9080-0e25b9fa8eeb None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:29.236446 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db83f1-d7e8-4c42-b780-6b2e4d1e37b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:29.237439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db83f1-d7e8-4c42-b780-6b2e4d1e37b2 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:29.237906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db83f1-d7e8-4c42-b780-6b2e4d1e37b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:29.238386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db83f1-d7e8-4c42-b780-6b2e4d1e37b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:29.243266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db83f1-d7e8-4c42-b780-6b2e4d1e37b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:29.245032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db83f1-d7e8-4c42-b780-6b2e4d1e37b2 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:29.246877 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 49/102] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:29.252535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ae552-07fc-433b-940e-68ce8b7e6ec1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:29.361335 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a366f-68ad-4f50-b05f-3799312d8100 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:29.361940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a366f-68ad-4f50-b05f-3799312d8100 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:29.362398 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a366f-68ad-4f50-b05f-3799312d8100 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:29.363951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 50/103] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:48:29.369125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9b754-6d42-4917-b196-2256afb6bbad None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:29.369683 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9b754-6d42-4917-b196-2256afb6bbad None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:29.370140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9b754-6d42-4917-b196-2256afb6bbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:29.377568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:29.396150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ae552-07fc-433b-940e-68ce8b7e6ec1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:29.409742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-72c9b754-6d42-4917-b196-2256afb6bbad None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:29.411299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-72c9b754-6d42-4917-b196-2256afb6bbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:29.467544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718076f-3c17-4b06-90f8-800406c49857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:29.468509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718076f-3c17-4b06-90f8-800406c49857 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:29.468976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718076f-3c17-4b06-90f8-800406c49857 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:29.469996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718076f-3c17-4b06-90f8-800406c49857 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:29.470924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718076f-3c17-4b06-90f8-800406c49857 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:29.472817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718076f-3c17-4b06-90f8-800406c49857 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:29.526298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 54/104] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 22 15:48:29 2022] POST /identity/v3/projects => generated 302 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:29.526907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:29.534988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718076f-3c17-4b06-90f8-800406c49857 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:29.553505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 51/105] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 22 15:48:29.560316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25667994-f1f5-421b-b634-d3b929c35b9d None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:29.560627 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25667994-f1f5-421b-b634-d3b929c35b9d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:29.561038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25667994-f1f5-421b-b634-d3b929c35b9d None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:29.564682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 52/106] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:29.574104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7db19-b7c8-4508-9671-d2d47296a208 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:29.574104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7db19-b7c8-4508-9671-d2d47296a208 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:29.574104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7db19-b7c8-4508-9671-d2d47296a208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:29.603817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-91a7db19-b7c8-4508-9671-d2d47296a208 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:29.607865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-91a7db19-b7c8-4508-9671-d2d47296a208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:29.701530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 53/107] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:29.766694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718076f-3c17-4b06-90f8-800406c49857 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:29.820477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91256632-5b79-4ec6-b7b0-9d7de7c587a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:29.821061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91256632-5b79-4ec6-b7b0-9d7de7c587a3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:29.821344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91256632-5b79-4ec6-b7b0-9d7de7c587a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:29.821620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91256632-5b79-4ec6-b7b0-9d7de7c587a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:29.843795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91256632-5b79-4ec6-b7b0-9d7de7c587a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-91256632-5b79-4ec6-b7b0-9d7de7c587a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:29.849575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:29.850406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:29.851267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:29.851267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:29.851267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:29.851267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:29.851267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:29.851267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:29.851267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:29.851267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:29.851267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:29.851267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:29.851267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:29.851267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:29.851267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 55/108] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:48:29.857922 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7db19-b7c8-4508-9671-d2d47296a208 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:29.879800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91256632-5b79-4ec6-b7b0-9d7de7c587a3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:29.899299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:30.069462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7db19-b7c8-4508-9671-d2d47296a208 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:30.075304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91256632-5b79-4ec6-b7b0-9d7de7c587a3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:30.109117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:30.123808 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961963-eb0b-4a2b-b15e-fafd741a2a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:30.124452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961963-eb0b-4a2b-b15e-fafd741a2a90 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:30.124826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961963-eb0b-4a2b-b15e-fafd741a2a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:30.125100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961963-eb0b-4a2b-b15e-fafd741a2a90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:30.133119 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182800b-69f6-4ca1-8215-b90faff3a4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:30.133587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182800b-69f6-4ca1-8215-b90faff3a4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:30.134699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182800b-69f6-4ca1-8215-b90faff3a4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:30.134699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182800b-69f6-4ca1-8215-b90faff3a4f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:30.135462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182800b-69f6-4ca1-8215-b90faff3a4f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:30.136122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182800b-69f6-4ca1-8215-b90faff3a4f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:30.138450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182800b-69f6-4ca1-8215-b90faff3a4f1 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:30.141472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961963-eb0b-4a2b-b15e-fafd741a2a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-cf961963-eb0b-4a2b-b15e-fafd741a2a90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:30.148816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:30.150493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:30.153507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:30.153507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:30.153507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:30.153507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:30.153507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:30.153507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:30.153507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:30.153507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:30.153507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:30.153507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:30.153507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:30.153507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:30.153507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 56/109] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:30.155330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 54/110] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:30.155587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e8fe4-baed-449f-9c9c-8577b5766790 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:30.155587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e8fe4-baed-449f-9c9c-8577b5766790 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:30.156043 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182800b-69f6-4ca1-8215-b90faff3a4f1 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:30.156260 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e8fe4-baed-449f-9c9c-8577b5766790 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:30.156260 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 57/111] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:30.159839 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e8fe4-baed-449f-9c9c-8577b5766790 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:30.242469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:30.280819 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e8fe4-baed-449f-9c9c-8577b5766790 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:30.284396 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182800b-69f6-4ca1-8215-b90faff3a4f1 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:30.320932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8f188-11c0-4381-b3cc-6adcc4084d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:30.321579 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f188-11c0-4381-b3cc-6adcc4084d77 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:30.322193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f188-11c0-4381-b3cc-6adcc4084d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:30.322193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f188-11c0-4381-b3cc-6adcc4084d77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:30.334554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8f188-11c0-4381-b3cc-6adcc4084d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:30.338356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c64dc-67f2-4388-bfb6-e6f2f102f951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:30.339221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c64dc-67f2-4388-bfb6-e6f2f102f951 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:30.339691 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c64dc-67f2-4388-bfb6-e6f2f102f951 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-fad8f188-11c0-4381-b3cc-6adcc4084d77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:30.340053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:30.340869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:30.341617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:30.341617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:30.341617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:30.341617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:30.341617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:30.341617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:30.341617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:30.341617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:30.341617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:30.341617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:30.341617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:30.341617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:30.341617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 55/112] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:48:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:30.342247 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8f188-11c0-4381-b3cc-6adcc4084d77 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:30.347617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c64dc-67f2-4388-bfb6-e6f2f102f951 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:30.347617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c64dc-67f2-4388-bfb6-e6f2f102f951 None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:30.347617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c64dc-67f2-4388-bfb6-e6f2f102f951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:30.347617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c64dc-67f2-4388-bfb6-e6f2f102f951 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:30.359417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 58/113] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:30.361020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989fc5d-6054-4671-ae61-521d989c100d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:30.361516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989fc5d-6054-4671-ae61-521d989c100d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:30.362023 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989fc5d-6054-4671-ae61-521d989c100d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:30.383554 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6989fc5d-6054-4671-ae61-521d989c100d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:30.385112 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6989fc5d-6054-4671-ae61-521d989c100d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:30.392110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:30.452424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8f188-11c0-4381-b3cc-6adcc4084d77 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:30.457941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 59/114] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:30.459083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989fc5d-6054-4671-ae61-521d989c100d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:30.516604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f9279-d434-451b-86b5-601e9ad872cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:30.517263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f9279-d434-451b-86b5-601e9ad872cd None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:30.517548 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f9279-d434-451b-86b5-601e9ad872cd None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:30.517823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f9279-d434-451b-86b5-601e9ad872cd None admin] PATH_INFO: `/v3/users/11cdbd3e04ed45dc8210e024fdb817b0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:30.526292 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:30.552151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f9279-d434-451b-86b5-601e9ad872cd None admin] RBAC: Authorizing `identity:get_user(user_id=11cdbd3e04ed45dc8210e024fdb817b0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:30.553727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f9279-d434-451b-86b5-601e9ad872cd None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:30.555475 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 56/115] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:30 2022] GET /identity/v3/users/11cdbd3e04ed45dc8210e024fdb817b0 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:30.556301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f9279-d434-451b-86b5-601e9ad872cd None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:30.570729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989fc5d-6054-4671-ae61-521d989c100d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:30.622406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05a26e-9adf-4d8b-9507-4f8518b56ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:30.623080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05a26e-9adf-4d8b-9507-4f8518b56ada None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:30.623362 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05a26e-9adf-4d8b-9507-4f8518b56ada None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:30.623630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05a26e-9adf-4d8b-9507-4f8518b56ada None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:30.624585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05a26e-9adf-4d8b-9507-4f8518b56ada None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:30.624891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05a26e-9adf-4d8b-9507-4f8518b56ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:30.626559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05a26e-9adf-4d8b-9507-4f8518b56ada None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:30.638409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 60/116] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:30.643642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05a26e-9adf-4d8b-9507-4f8518b56ada None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:30.690257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:30.695233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f9279-d434-451b-86b5-601e9ad872cd None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:30.742516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6ee89-5e92-41db-ae0f-008ad2570a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:30.743545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6ee89-5e92-41db-ae0f-008ad2570a02 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:30.744014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6ee89-5e92-41db-ae0f-008ad2570a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:30.744475 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6ee89-5e92-41db-ae0f-008ad2570a02 None admin] PATH_INFO: `/v3/users/7844dee1bb874523a45debbded632cde` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:30.745850 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6ee89-5e92-41db-ae0f-008ad2570a02 None admin] RBAC: Authorizing `identity:get_user(user_id=7844dee1bb874523a45debbded632cde)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:30.747676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6ee89-5e92-41db-ae0f-008ad2570a02 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:30.749586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 57/117] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:30 2022] GET /identity/v3/users/7844dee1bb874523a45debbded632cde => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:30.750999 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af98199-288c-46ac-905f-1716aea4e4ee None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:30.751524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af98199-288c-46ac-905f-1716aea4e4ee None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:30.751986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af98199-288c-46ac-905f-1716aea4e4ee None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:30.753422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 58/118] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:30.754292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af98199-288c-46ac-905f-1716aea4e4ee None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:30.768499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05a26e-9adf-4d8b-9507-4f8518b56ada None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:30.797402 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:30.808958 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51d328-8c4b-426b-b1b8-983f001a2b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:30.809714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51d328-8c4b-426b-b1b8-983f001a2b93 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:30.810007 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51d328-8c4b-426b-b1b8-983f001a2b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:30.810662 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51d328-8c4b-426b-b1b8-983f001a2b93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:30.876863 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af98199-288c-46ac-905f-1716aea4e4ee None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:30.904500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51d328-8c4b-426b-b1b8-983f001a2b93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:30.906443 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51d328-8c4b-426b-b1b8-983f001a2b93 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:30.919746 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e3c39-5ddd-42d3-9cb1-e385c9c4cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:30.920398 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e3c39-5ddd-42d3-9cb1-e385c9c4cdeb None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:30.920676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e3c39-5ddd-42d3-9cb1-e385c9c4cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:30.920952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e3c39-5ddd-42d3-9cb1-e385c9c4cdeb None admin] PATH_INFO: `/v3/users/ee071968090a43639b3c920bae3fb546` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:30.922110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e3c39-5ddd-42d3-9cb1-e385c9c4cdeb None admin] RBAC: Authorizing `identity:get_user(user_id=ee071968090a43639b3c920bae3fb546)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:30.923702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e3c39-5ddd-42d3-9cb1-e385c9c4cdeb None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:30.925356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 59/119] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:30 2022] GET /identity/v3/users/ee071968090a43639b3c920bae3fb546 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:30.925356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e3c39-5ddd-42d3-9cb1-e385c9c4cdeb None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:30.968984 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:31.038430 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 61/120] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:31.039743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5f183-6dd7-4dc1-b339-aa854bd897a4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:31.040032 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5f183-6dd7-4dc1-b339-aa854bd897a4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:31.040310 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5f183-6dd7-4dc1-b339-aa854bd897a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:31.059073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-ffe5f183-6dd7-4dc1-b339-aa854bd897a4 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:31.060293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ffe5f183-6dd7-4dc1-b339-aa854bd897a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:31.064381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e3c39-5ddd-42d3-9cb1-e385c9c4cdeb None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:31.080148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:31.103979 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13915d68-a12e-4d3f-b608-caf9f9a6e2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:31.104616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13915d68-a12e-4d3f-b608-caf9f9a6e2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:31.104901 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13915d68-a12e-4d3f-b608-caf9f9a6e2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:31.105177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13915d68-a12e-4d3f-b608-caf9f9a6e2f3 None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:31.106640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13915d68-a12e-4d3f-b608-caf9f9a6e2f3 None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:31.107806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13915d68-a12e-4d3f-b608-caf9f9a6e2f3 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:31.114123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 60/121] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:30 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:31.114123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13915d68-a12e-4d3f-b608-caf9f9a6e2f3 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:31.142711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 62/122] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:31.142711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5f183-6dd7-4dc1-b339-aa854bd897a4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:31.236338 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13915d68-a12e-4d3f-b608-caf9f9a6e2f3 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:31.239607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:31.275774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea233a25-d7c6-4794-ac1a-7f12b2b0b03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:31.276604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea233a25-d7c6-4794-ac1a-7f12b2b0b03f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:31.276983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea233a25-d7c6-4794-ac1a-7f12b2b0b03f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:31.277297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5f183-6dd7-4dc1-b339-aa854bd897a4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:31.277405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea233a25-d7c6-4794-ac1a-7f12b2b0b03f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:31.292005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea233a25-d7c6-4794-ac1a-7f12b2b0b03f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-ea233a25-d7c6-4794-ac1a-7f12b2b0b03f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:31.301821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:31.302779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:31.303799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:31.303799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:31.303799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:31.303799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:31.303799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:31.303799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:31.303799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:31.303799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:31.303799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:31.303799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:31.303799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:48:31.303799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:31.305319 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 61/123] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:48:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:31.306168 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea233a25-d7c6-4794-ac1a-7f12b2b0b03f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:31.333911 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fdb02-6402-4bb3-8f4f-bde81abc1927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:31.335558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fdb02-6402-4bb3-8f4f-bde81abc1927 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:31.335978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fdb02-6402-4bb3-8f4f-bde81abc1927 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:31.336735 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fdb02-6402-4bb3-8f4f-bde81abc1927 None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:31.339116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fdb02-6402-4bb3-8f4f-bde81abc1927 None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:31.341542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fdb02-6402-4bb3-8f4f-bde81abc1927 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:31.349258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 63/124] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:31 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:31.349258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fdb02-6402-4bb3-8f4f-bde81abc1927 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:31.378045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:31.436232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea233a25-d7c6-4794-ac1a-7f12b2b0b03f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:31.458182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fdb02-6402-4bb3-8f4f-bde81abc1927 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:31.473823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556c79c-7de9-4277-b538-de40043e36fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:31.474467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556c79c-7de9-4277-b538-de40043e36fb None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:31.474773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556c79c-7de9-4277-b538-de40043e36fb None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:31.475108 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556c79c-7de9-4277-b538-de40043e36fb None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:31.476242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556c79c-7de9-4277-b538-de40043e36fb None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:31.477697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556c79c-7de9-4277-b538-de40043e36fb None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:31.479380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 62/125] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:31 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:31.480145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556c79c-7de9-4277-b538-de40043e36fb None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:31.500677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359cc96-ce2a-453e-b801-096b094f5d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:31.501351 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359cc96-ce2a-453e-b801-096b094f5d61 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:31.501643 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359cc96-ce2a-453e-b801-096b094f5d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:31.501905 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359cc96-ce2a-453e-b801-096b094f5d61 None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0/users/7844dee1bb874523a45debbded632cde/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:31.503849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359cc96-ce2a-453e-b801-096b094f5d61 None admin] RBAC: Authorizing `identity:create_grant(project_id=25b73a36dde84c9d97a80501da4f16d0, user_id=7844dee1bb874523a45debbded632cde, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:31.505298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359cc96-ce2a-453e-b801-096b094f5d61 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:31.516833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:31.521474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 64/126] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:48:31 2022] PUT /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0/users/7844dee1bb874523a45debbded632cde/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:48:31.527620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359cc96-ce2a-453e-b801-096b094f5d61 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:31.605586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556c79c-7de9-4277-b538-de40043e36fb None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:31.644786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:31.647665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbce66f-ff78-415d-b130-90a3ffbaeca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:31.648604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbce66f-ff78-415d-b130-90a3ffbaeca4 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:31.649083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbce66f-ff78-415d-b130-90a3ffbaeca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:31.649550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbce66f-ff78-415d-b130-90a3ffbaeca4 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:31.650433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbce66f-ff78-415d-b130-90a3ffbaeca4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:31.651023 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbce66f-ff78-415d-b130-90a3ffbaeca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:31.652792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbce66f-ff78-415d-b130-90a3ffbaeca4 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:31.656672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359cc96-ce2a-453e-b801-096b094f5d61 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:31.663024 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 63/127] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:48:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:31.664266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbce66f-ff78-415d-b130-90a3ffbaeca4 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:31.701776 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588549c3-eb17-4894-bd1f-ecc9c871ce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:31.702464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588549c3-eb17-4894-bd1f-ecc9c871ce1a None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:31.702777 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588549c3-eb17-4894-bd1f-ecc9c871ce1a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:31.703056 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588549c3-eb17-4894-bd1f-ecc9c871ce1a None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0/users/ee071968090a43639b3c920bae3fb546/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:31.705268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588549c3-eb17-4894-bd1f-ecc9c871ce1a None admin] RBAC: Authorizing `identity:create_grant(project_id=25b73a36dde84c9d97a80501da4f16d0, user_id=ee071968090a43639b3c920bae3fb546, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:31.706808 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588549c3-eb17-4894-bd1f-ecc9c871ce1a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:31.723983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 65/128] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:48:31 2022] PUT /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0/users/ee071968090a43639b3c920bae3fb546/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:48:31.724764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588549c3-eb17-4894-bd1f-ecc9c871ce1a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:31.789580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:31.799566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbce66f-ff78-415d-b130-90a3ffbaeca4 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:31.838541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19519f8-6cc0-4893-a99e-ed5b63c9bde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:31.839632 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19519f8-6cc0-4893-a99e-ed5b63c9bde0 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:31.840107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19519f8-6cc0-4893-a99e-ed5b63c9bde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:31.840600 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19519f8-6cc0-4893-a99e-ed5b63c9bde0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:31.844188 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588549c3-eb17-4894-bd1f-ecc9c871ce1a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:31.853106 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19519f8-6cc0-4893-a99e-ed5b63c9bde0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-d19519f8-6cc0-4893-a99e-ed5b63c9bde0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:31.858947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:31.859819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:31.860568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:31.860568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:31.860568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:31.860568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:31.860568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:31.860568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:31.860568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:31.860568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:31.860568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:31.860568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:31.860568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:31.860568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:31.862941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 64/129] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:31.863989 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19519f8-6cc0-4893-a99e-ed5b63c9bde0 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:31.884463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3524c5-1491-4393-a73f-957ace1c9e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:31.885102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3524c5-1491-4393-a73f-957ace1c9e5c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:31.885430 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3524c5-1491-4393-a73f-957ace1c9e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:31.885711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3524c5-1491-4393-a73f-957ace1c9e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:31.886656 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3524c5-1491-4393-a73f-957ace1c9e5c None admin] RBAC: Adding query filter params (role.id=4d7a14112b4142d8a641585adf39cc07, scope.project.id=25b73a36dde84c9d97a80501da4f16d0, user.id=11cdbd3e04ed45dc8210e024fdb817b0) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:31.886981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3524c5-1491-4393-a73f-957ace1c9e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:31.888696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3524c5-1491-4393-a73f-957ace1c9e5c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:31.895988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 66/130] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:31 2022] GET /identity/v3/role_assignments?user.id=11cdbd3e04ed45dc8210e024fdb817b0&scope.project.id=25b73a36dde84c9d97a80501da4f16d0&role.id=4d7a14112b4142d8a641585adf39cc07 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:31.904013 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3524c5-1491-4393-a73f-957ace1c9e5c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:31.914787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:31.997333 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19519f8-6cc0-4893-a99e-ed5b63c9bde0 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:32.044051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff32b99-6c88-417c-a7ea-22390e62cd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:32.045288 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff32b99-6c88-417c-a7ea-22390e62cd71 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:32.046438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff32b99-6c88-417c-a7ea-22390e62cd71 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:32.047237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff32b99-6c88-417c-a7ea-22390e62cd71 None admin] PATH_INFO: `/v3/users/7844dee1bb874523a45debbded632cde` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:32.049216 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff32b99-6c88-417c-a7ea-22390e62cd71 None admin] RBAC: Authorizing `identity:get_user(user_id=7844dee1bb874523a45debbded632cde)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:32.052864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff32b99-6c88-417c-a7ea-22390e62cd71 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:32.056471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 65/131] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:31 2022] GET /identity/v3/users/7844dee1bb874523a45debbded632cde => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:32.058541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09879e34-0b1f-4d8f-bb59-477cdff3cf38 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:32.059152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09879e34-0b1f-4d8f-bb59-477cdff3cf38 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:32.059774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09879e34-0b1f-4d8f-bb59-477cdff3cf38 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:32.061800 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 66/132] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:32.063829 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09879e34-0b1f-4d8f-bb59-477cdff3cf38 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:32.087503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3524c5-1491-4393-a73f-957ace1c9e5c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:32.103084 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:32.130384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03d363-dd08-4b27-a592-d266ba27756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:32.131439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03d363-dd08-4b27-a592-d266ba27756d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:32.131927 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03d363-dd08-4b27-a592-d266ba27756d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:32.132388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03d363-dd08-4b27-a592-d266ba27756d None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:32.133409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03d363-dd08-4b27-a592-d266ba27756d None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:32.134028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03d363-dd08-4b27-a592-d266ba27756d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:32.135727 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03d363-dd08-4b27-a592-d266ba27756d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:32.146556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 67/133] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:32.148257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5570baa-4099-448d-9f47-9a1bb2057c2e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:32.148757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5570baa-4099-448d-9f47-9a1bb2057c2e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:32.149311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5570baa-4099-448d-9f47-9a1bb2057c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:32.174922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e5570baa-4099-448d-9f47-9a1bb2057c2e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:32.176479 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e5570baa-4099-448d-9f47-9a1bb2057c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:32.200006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09879e34-0b1f-4d8f-bb59-477cdff3cf38 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:32.241049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8660c3-5613-4b4d-93e6-a40e017e4146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:32.242198 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8660c3-5613-4b4d-93e6-a40e017e4146 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:32.242791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8660c3-5613-4b4d-93e6-a40e017e4146 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:32.243268 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8660c3-5613-4b4d-93e6-a40e017e4146 None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:32.245516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8660c3-5613-4b4d-93e6-a40e017e4146 None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:32.248801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8660c3-5613-4b4d-93e6-a40e017e4146 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:32.251285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:32.252086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 67/134] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:32 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:32.256386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8660c3-5613-4b4d-93e6-a40e017e4146 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:32.259249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 68/135] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:32.275931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5570baa-4099-448d-9f47-9a1bb2057c2e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:32.367915 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:32.377694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8660c3-5613-4b4d-93e6-a40e017e4146 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:32.456796 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456280e7-391c-4a9c-b246-6a0287739b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:32.457456 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456280e7-391c-4a9c-b246-6a0287739b29 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:32.457743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456280e7-391c-4a9c-b246-6a0287739b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:32.458017 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456280e7-391c-4a9c-b246-6a0287739b29 None admin] PATH_INFO: `/v3/users/7844dee1bb874523a45debbded632cde` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:32.463534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456280e7-391c-4a9c-b246-6a0287739b29 None admin] RBAC: Authorizing `identity:get_user(user_id=7844dee1bb874523a45debbded632cde)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:32.465074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456280e7-391c-4a9c-b246-6a0287739b29 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:32.467159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 68/136] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:32 2022] GET /identity/v3/users/7844dee1bb874523a45debbded632cde => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:32.473542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5570baa-4099-448d-9f47-9a1bb2057c2e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:32.478728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456280e7-391c-4a9c-b246-6a0287739b29 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:32.544644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dcbfe-5cc9-4f14-badc-9e3d8e8044a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:32.546106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dcbfe-5cc9-4f14-badc-9e3d8e8044a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:32.546617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dcbfe-5cc9-4f14-badc-9e3d8e8044a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:32.547085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dcbfe-5cc9-4f14-badc-9e3d8e8044a1 None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0/users/7844dee1bb874523a45debbded632cde/roles/64aca4dbf153454d8abb3af690d90c76` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:32.549657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dcbfe-5cc9-4f14-badc-9e3d8e8044a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=25b73a36dde84c9d97a80501da4f16d0, user_id=7844dee1bb874523a45debbded632cde, role_id=64aca4dbf153454d8abb3af690d90c76)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:32.559654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dcbfe-5cc9-4f14-badc-9e3d8e8044a1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:32.578307 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 69/137] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:48:32 2022] PUT /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0/users/7844dee1bb874523a45debbded632cde/roles/64aca4dbf153454d8abb3af690d90c76 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:48:32.643963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456280e7-391c-4a9c-b246-6a0287739b29 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:32.692345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9dcde-aea1-438c-99a2-61058fd17adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:32.693064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9dcde-aea1-438c-99a2-61058fd17adb None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:32.693382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9dcde-aea1-438c-99a2-61058fd17adb None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:32.693709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9dcde-aea1-438c-99a2-61058fd17adb None admin] PATH_INFO: `/v3/projects/c04ba4146576497da42624a6ecb68d3c` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:32.694962 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9dcde-aea1-438c-99a2-61058fd17adb None admin] RBAC: Authorizing `identity:get_project(project_id=c04ba4146576497da42624a6ecb68d3c)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:32.696473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9dcde-aea1-438c-99a2-61058fd17adb None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:32.698206 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 69/138] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:32 2022] GET /identity/v3/projects/c04ba4146576497da42624a6ecb68d3c => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:32.704493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dcbfe-5cc9-4f14-badc-9e3d8e8044a1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:32.727258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9dcde-aea1-438c-99a2-61058fd17adb None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:32.773373 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:32.826306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:32.893057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dcbfe-5cc9-4f14-badc-9e3d8e8044a1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:32.903420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9dcde-aea1-438c-99a2-61058fd17adb None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:32.952698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaef927-7877-4b43-b755-f902b1339053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:32.953346 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaef927-7877-4b43-b755-f902b1339053 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:32.953630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaef927-7877-4b43-b755-f902b1339053 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:32.953903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaef927-7877-4b43-b755-f902b1339053 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:32.957305 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fb9ce-e65f-4165-9ac6-f41dc175b1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:32.957980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fb9ce-e65f-4165-9ac6-f41dc175b1b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:32.958261 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fb9ce-e65f-4165-9ac6-f41dc175b1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:32.958534 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fb9ce-e65f-4165-9ac6-f41dc175b1b1 None admin] PATH_INFO: `/v3/projects/c04ba4146576497da42624a6ecb68d3c/users/7844dee1bb874523a45debbded632cde/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:32.960104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaef927-7877-4b43-b755-f902b1339053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:32.961596 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaef927-7877-4b43-b755-f902b1339053 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:32.964573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fb9ce-e65f-4165-9ac6-f41dc175b1b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c04ba4146576497da42624a6ecb68d3c, user_id=7844dee1bb874523a45debbded632cde, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:32.966024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fb9ce-e65f-4165-9ac6-f41dc175b1b1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:32.968541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 70/139] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:32.969378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaef927-7877-4b43-b755-f902b1339053 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:32.995714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 70/140] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:48:32 2022] PUT /identity/v3/projects/c04ba4146576497da42624a6ecb68d3c/users/7844dee1bb874523a45debbded632cde/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:48:33.116352 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:33.131149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaef927-7877-4b43-b755-f902b1339053 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:33.178570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfeda9-4047-4ff3-89d4-0c9b3077c129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:33.179236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfeda9-4047-4ff3-89d4-0c9b3077c129 None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:33.179521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfeda9-4047-4ff3-89d4-0c9b3077c129 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:33.179810 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfeda9-4047-4ff3-89d4-0c9b3077c129 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:33.180485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfeda9-4047-4ff3-89d4-0c9b3077c129 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:33.182122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfeda9-4047-4ff3-89d4-0c9b3077c129 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:33.227856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 71/141] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:48:32 2022] POST /identity/v3/users => generated 283 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:34.171307 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6059b-eef5-4971-86ac-ddcdafc84b09 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:34.171815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6059b-eef5-4971-86ac-ddcdafc84b09 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:34.171918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6059b-eef5-4971-86ac-ddcdafc84b09 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:34.173407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 71/142] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:34.181275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b825b93-5cec-4f9d-a993-24406da60158 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:34.181736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b825b93-5cec-4f9d-a993-24406da60158 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:34.181806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b825b93-5cec-4f9d-a993-24406da60158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:34.203832 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-9b825b93-5cec-4f9d-a993-24406da60158 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:34.205044 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9b825b93-5cec-4f9d-a993-24406da60158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:34.291190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 72/143] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:34.416461 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1b536-7c68-44f2-a2b7-0448a8ab1cae None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:34.416747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1b536-7c68-44f2-a2b7-0448a8ab1cae None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:34.417027 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1b536-7c68-44f2-a2b7-0448a8ab1cae None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:34.418384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 72/144] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:34.424040 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147fb47-0ba4-45e9-a183-0954f3c75548 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:34.424255 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147fb47-0ba4-45e9-a183-0954f3c75548 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:34.424525 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147fb47-0ba4-45e9-a183-0954f3c75548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:34.447241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-b147fb47-0ba4-45e9-a183-0954f3c75548 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:34.448437 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-b147fb47-0ba4-45e9-a183-0954f3c75548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:34.528125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 73/145] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:34.756503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55f91a-06fc-4403-a33d-0ae98168fac5 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:34.756836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55f91a-06fc-4403-a33d-0ae98168fac5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:34.757023 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55f91a-06fc-4403-a33d-0ae98168fac5 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:34.758324 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 73/146] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:34.776706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144bd90-4b03-42c4-880c-21371a7534e9 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:34.777011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144bd90-4b03-42c4-880c-21371a7534e9 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:34.777262 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144bd90-4b03-42c4-880c-21371a7534e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:34.799680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-0144bd90-4b03-42c4-880c-21371a7534e9 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:34.800883 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0144bd90-4b03-42c4-880c-21371a7534e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:34.807736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:34.905463 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 74/147] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:34.973771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55f91a-06fc-4403-a33d-0ae98168fac5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:35.093378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55f91a-06fc-4403-a33d-0ae98168fac5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:35.101885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144bd90-4b03-42c4-880c-21371a7534e9 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:35.121883 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:35.142896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee8232-3590-43e4-beaa-5ad827508440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:35.143537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee8232-3590-43e4-beaa-5ad827508440 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:35.143817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee8232-3590-43e4-beaa-5ad827508440 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:35.144092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee8232-3590-43e4-beaa-5ad827508440 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:35.167536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee8232-3590-43e4-beaa-5ad827508440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-4fee8232-3590-43e4-beaa-5ad827508440 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:35.172561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:35.173878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:35.174684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:35.174684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:35.174684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:35.174684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:35.174684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:35.174684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:35.174684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:35.174684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:35.174684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:35.174684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:35.174684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:35.174684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:35.174684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 74/148] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:48:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:35.179548 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee8232-3590-43e4-beaa-5ad827508440 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:35.260561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144bd90-4b03-42c4-880c-21371a7534e9 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:35.315582 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979246ed-cfc9-43cb-9073-3521ba2ac880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:35.316616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979246ed-cfc9-43cb-9073-3521ba2ac880 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:35.317088 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979246ed-cfc9-43cb-9073-3521ba2ac880 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:35.317700 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979246ed-cfc9-43cb-9073-3521ba2ac880 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:35.337677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:35.344032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979246ed-cfc9-43cb-9073-3521ba2ac880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-979246ed-cfc9-43cb-9073-3521ba2ac880 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:35.349275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:35.350122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:35.350964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:35.350964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:35.350964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:35.350964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:35.350964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:35.350964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:35.350964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:35.350964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:35.350964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:35.350964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:35.350964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:35.350964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:35.353228 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 75/149] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:48:35.358979 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979246ed-cfc9-43cb-9073-3521ba2ac880 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:35.382052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee8232-3590-43e4-beaa-5ad827508440 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:35.441700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9b5f3-73dc-4dc6-a2de-c30b32094707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:35.442340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9b5f3-73dc-4dc6-a2de-c30b32094707 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:35.442704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9b5f3-73dc-4dc6-a2de-c30b32094707 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:35.442980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9b5f3-73dc-4dc6-a2de-c30b32094707 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:35.443663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9b5f3-73dc-4dc6-a2de-c30b32094707 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:35.443962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9b5f3-73dc-4dc6-a2de-c30b32094707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:35.445460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9b5f3-73dc-4dc6-a2de-c30b32094707 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:35.460257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 75/150] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:35.460961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9b5f3-73dc-4dc6-a2de-c30b32094707 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:35.499005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979246ed-cfc9-43cb-9073-3521ba2ac880 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:35.533160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:35.537575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408fcd3-26c2-4bc3-9606-b48c5fb5794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:35.538873 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408fcd3-26c2-4bc3-9606-b48c5fb5794c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:35.539378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408fcd3-26c2-4bc3-9606-b48c5fb5794c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:35.540231 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408fcd3-26c2-4bc3-9606-b48c5fb5794c None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:35.541150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408fcd3-26c2-4bc3-9606-b48c5fb5794c None admin] RBAC: Adding query filter params (name=member) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:35.541639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408fcd3-26c2-4bc3-9606-b48c5fb5794c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:35.543413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408fcd3-26c2-4bc3-9606-b48c5fb5794c None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:35.553236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 76/151] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:35.554398 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408fcd3-26c2-4bc3-9606-b48c5fb5794c None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:35.628458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:35.648121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9b5f3-73dc-4dc6-a2de-c30b32094707 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:35.667089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408fcd3-26c2-4bc3-9606-b48c5fb5794c None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:35.704294 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe046c25-2547-41d2-96b4-e62a26d907a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:35.705332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe046c25-2547-41d2-96b4-e62a26d907a8 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:35.705803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe046c25-2547-41d2-96b4-e62a26d907a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:35.706250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe046c25-2547-41d2-96b4-e62a26d907a8 None admin] PATH_INFO: `/v3/users/ee071968090a43639b3c920bae3fb546` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:35.707656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe046c25-2547-41d2-96b4-e62a26d907a8 None admin] RBAC: Authorizing `identity:get_user(user_id=ee071968090a43639b3c920bae3fb546)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:35.709868 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe046c25-2547-41d2-96b4-e62a26d907a8 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:35.711879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 77/152] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:35 2022] GET /identity/v3/users/ee071968090a43639b3c920bae3fb546 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:35.713037 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe046c25-2547-41d2-96b4-e62a26d907a8 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:35.716791 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca7e9c-6b33-43e5-ada6-55f77d7c29fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:35.718400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca7e9c-6b33-43e5-ada6-55f77d7c29fd None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:35.718400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca7e9c-6b33-43e5-ada6-55f77d7c29fd None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:35.718400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca7e9c-6b33-43e5-ada6-55f77d7c29fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:35.743371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca7e9c-6b33-43e5-ada6-55f77d7c29fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7eca7e9c-6b33-43e5-ada6-55f77d7c29fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:35.749668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:35.750560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:35.751366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:35.751366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:35.751366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:35.751366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:35.751366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:35.751366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:35.751366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:35.751366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:35.751366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:35.751366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:35.751366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:35.751366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:35.751366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 76/153] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:35.752174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8bcf2-782f-4985-bc46-633cea9a03c1 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:35.752174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8bcf2-782f-4985-bc46-633cea9a03c1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:35.752471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8bcf2-782f-4985-bc46-633cea9a03c1 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:35.753669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 77/154] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:35.754373 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8bcf2-782f-4985-bc46-633cea9a03c1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:35.831036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe046c25-2547-41d2-96b4-e62a26d907a8 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:35.880960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:35.890520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0f6a2-8683-4a3a-bfbb-6eec4f4a9fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:35.891692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0f6a2-8683-4a3a-bfbb-6eec4f4a9fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:35.892196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0f6a2-8683-4a3a-bfbb-6eec4f4a9fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:35.892680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0f6a2-8683-4a3a-bfbb-6eec4f4a9fe5 None admin] PATH_INFO: `/v3/users/7844dee1bb874523a45debbded632cde` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:35.894437 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0f6a2-8683-4a3a-bfbb-6eec4f4a9fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=7844dee1bb874523a45debbded632cde)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:35.896758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0f6a2-8683-4a3a-bfbb-6eec4f4a9fe5 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:35.900221 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 78/155] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:35 2022] GET /identity/v3/users/7844dee1bb874523a45debbded632cde => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:35.902700 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23943046-2b20-4594-afe7-540715b13db2 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:35.903653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23943046-2b20-4594-afe7-540715b13db2 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:35.904405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23943046-2b20-4594-afe7-540715b13db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:35.931682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-23943046-2b20-4594-afe7-540715b13db2 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:35.933280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-23943046-2b20-4594-afe7-540715b13db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:35.960183 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:35.968153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8bcf2-782f-4985-bc46-633cea9a03c1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:36.009249 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 79/156] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:36.010562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23943046-2b20-4594-afe7-540715b13db2 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:36.032826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced1a02-7ec5-4c21-96ac-7c612530fb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:36.033695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced1a02-7ec5-4c21-96ac-7c612530fb82 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:36.033882 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced1a02-7ec5-4c21-96ac-7c612530fb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:36.034106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced1a02-7ec5-4c21-96ac-7c612530fb82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:36.126059 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23943046-2b20-4594-afe7-540715b13db2 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:36.159070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:36.167214 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555514e-8299-45fb-8299-1f70bc0d368e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:36.168261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555514e-8299-45fb-8299-1f70bc0d368e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:36.168734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555514e-8299-45fb-8299-1f70bc0d368e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:36.169224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555514e-8299-45fb-8299-1f70bc0d368e None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:36.170121 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555514e-8299-45fb-8299-1f70bc0d368e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:36.170644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555514e-8299-45fb-8299-1f70bc0d368e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:36.172267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555514e-8299-45fb-8299-1f70bc0d368e None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:36.172783 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced1a02-7ec5-4c21-96ac-7c612530fb82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:36.174280 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced1a02-7ec5-4c21-96ac-7c612530fb82 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:36.182919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 80/157] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:36.184137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555514e-8299-45fb-8299-1f70bc0d368e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:36.292381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555514e-8299-45fb-8299-1f70bc0d368e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:36.353997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe63b66-6980-488b-b9f1-ce15440bda31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:36.355054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe63b66-6980-488b-b9f1-ce15440bda31 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:36.355533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe63b66-6980-488b-b9f1-ce15440bda31 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:36.356013 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe63b66-6980-488b-b9f1-ce15440bda31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:36.397858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:36.406449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 78/158] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:36.408111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced1a02-7ec5-4c21-96ac-7c612530fb82 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:36.486970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:36.509466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe63b66-6980-488b-b9f1-ce15440bda31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:36.511017 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe63b66-6980-488b-b9f1-ce15440bda31 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:36.597618 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced1a02-7ec5-4c21-96ac-7c612530fb82 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:36.672873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ca60f-bdf5-408c-88d8-1d691afe59e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:36.673538 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ca60f-bdf5-408c-88d8-1d691afe59e2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:36.673815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ca60f-bdf5-408c-88d8-1d691afe59e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:36.674085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ca60f-bdf5-408c-88d8-1d691afe59e2 None admin] PATH_INFO: `/v3/users/11cdbd3e04ed45dc8210e024fdb817b0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:36.679622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ca60f-bdf5-408c-88d8-1d691afe59e2 None admin] RBAC: Authorizing `identity:get_user(user_id=11cdbd3e04ed45dc8210e024fdb817b0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:36.681126 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ca60f-bdf5-408c-88d8-1d691afe59e2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:36.683169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 79/159] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:36 2022] GET /identity/v3/users/11cdbd3e04ed45dc8210e024fdb817b0 => generated 289 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:36.683958 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ca60f-bdf5-408c-88d8-1d691afe59e2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:36.738282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 81/160] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:36.739138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe63b66-6980-488b-b9f1-ce15440bda31 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:36.840688 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:36.852449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:36.860551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe63b66-6980-488b-b9f1-ce15440bda31 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:36.897197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600169b2-97e3-4610-ac70-2eeac0b6901d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:36.897838 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600169b2-97e3-4610-ac70-2eeac0b6901d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:36.898121 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600169b2-97e3-4610-ac70-2eeac0b6901d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:36.898395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600169b2-97e3-4610-ac70-2eeac0b6901d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:36.909828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600169b2-97e3-4610-ac70-2eeac0b6901d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-600169b2-97e3-4610-ac70-2eeac0b6901d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:36.914653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:36.915553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:36.916328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:36.916328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:36.916328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:36.916328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:36.916328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:36.916328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:36.916328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:36.916328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:36.916328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:36.916328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:36.916328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:48:36.916328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:36.916328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 82/161] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:48:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:36.917449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600169b2-97e3-4610-ac70-2eeac0b6901d None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:36.930440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ca60f-bdf5-408c-88d8-1d691afe59e2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:36.969420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676f9c6-8ad6-477c-b351-bc5961cc6744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:36.970107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676f9c6-8ad6-477c-b351-bc5961cc6744 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:36.970386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676f9c6-8ad6-477c-b351-bc5961cc6744 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:36.970696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676f9c6-8ad6-477c-b351-bc5961cc6744 None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:36.971882 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676f9c6-8ad6-477c-b351-bc5961cc6744 None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:36.973433 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676f9c6-8ad6-477c-b351-bc5961cc6744 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:36.975180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 80/162] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:36 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:36.975968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676f9c6-8ad6-477c-b351-bc5961cc6744 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:37.074133 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600169b2-97e3-4610-ac70-2eeac0b6901d None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:37.157761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210e28-682b-4fd1-877d-40df1578e42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:37.159992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210e28-682b-4fd1-877d-40df1578e42b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:37.160714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210e28-682b-4fd1-877d-40df1578e42b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:37.162642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210e28-682b-4fd1-877d-40df1578e42b None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:37.164348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f210e28-682b-4fd1-877d-40df1578e42b None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:37.166386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f210e28-682b-4fd1-877d-40df1578e42b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:37.170974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 83/163] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:36 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:37.174255 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb63ed-2d7c-4fa1-8a32-44d084a4364b None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:37.175868 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb63ed-2d7c-4fa1-8a32-44d084a4364b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:37.176482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb63ed-2d7c-4fa1-8a32-44d084a4364b None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:37.179155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 84/164] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:37.181972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb63ed-2d7c-4fa1-8a32-44d084a4364b None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:37.188300 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676f9c6-8ad6-477c-b351-bc5961cc6744 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:37.222460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:37.263428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a7b08-dd93-4b63-bc31-b981e996760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:37.264069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a7b08-dd93-4b63-bc31-b981e996760c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:37.264340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a7b08-dd93-4b63-bc31-b981e996760c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:37.264607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a7b08-dd93-4b63-bc31-b981e996760c None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:37.267405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a7b08-dd93-4b63-bc31-b981e996760c None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:37.268878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a7b08-dd93-4b63-bc31-b981e996760c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:37.270658 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 81/165] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:36 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:37.271429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a7b08-dd93-4b63-bc31-b981e996760c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:37.275657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:37.343289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb63ed-2d7c-4fa1-8a32-44d084a4364b None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:37.382824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c74ebd-8f9c-48b9-a75b-e66663668b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:37.383846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c74ebd-8f9c-48b9-a75b-e66663668b54 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:37.384389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c74ebd-8f9c-48b9-a75b-e66663668b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:37.384866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c74ebd-8f9c-48b9-a75b-e66663668b54 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:37.385882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c74ebd-8f9c-48b9-a75b-e66663668b54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:37.386416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c74ebd-8f9c-48b9-a75b-e66663668b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:37.388100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c74ebd-8f9c-48b9-a75b-e66663668b54 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:37.398302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 85/166] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:48:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:37.403981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c74ebd-8f9c-48b9-a75b-e66663668b54 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:37.487317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a7b08-dd93-4b63-bc31-b981e996760c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:37.499874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:37.521609 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c74ebd-8f9c-48b9-a75b-e66663668b54 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:37.555064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3f60d-02c7-4e7f-82a7-1c6d78d80675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:37.555763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3f60d-02c7-4e7f-82a7-1c6d78d80675 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:37.556040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3f60d-02c7-4e7f-82a7-1c6d78d80675 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:37.556326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3f60d-02c7-4e7f-82a7-1c6d78d80675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:37.557053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3f60d-02c7-4e7f-82a7-1c6d78d80675 None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=25b73a36dde84c9d97a80501da4f16d0, user.id=ee071968090a43639b3c920bae3fb546) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:37.557453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3f60d-02c7-4e7f-82a7-1c6d78d80675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:37.559475 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3f60d-02c7-4e7f-82a7-1c6d78d80675 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:37.560840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382b962-62b6-45e0-a56b-c8172ba06025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:37.561754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382b962-62b6-45e0-a56b-c8172ba06025 None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:37.562231 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382b962-62b6-45e0-a56b-c8172ba06025 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:37.562723 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382b962-62b6-45e0-a56b-c8172ba06025 None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0/users/11cdbd3e04ed45dc8210e024fdb817b0/roles/4d7a14112b4142d8a641585adf39cc07` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:37.565150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382b962-62b6-45e0-a56b-c8172ba06025 None admin] RBAC: Authorizing `identity:create_grant(project_id=25b73a36dde84c9d97a80501da4f16d0, user_id=11cdbd3e04ed45dc8210e024fdb817b0, role_id=4d7a14112b4142d8a641585adf39cc07)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:37.567105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382b962-62b6-45e0-a56b-c8172ba06025 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:37.568310 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 82/167] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:37 2022] GET /identity/v3/role_assignments?user.id=ee071968090a43639b3c920bae3fb546&scope.project.id=25b73a36dde84c9d97a80501da4f16d0&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:37.569378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141496e-d64f-480d-b872-809c915e6804 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:37.569654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141496e-d64f-480d-b872-809c915e6804 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:37.569920 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141496e-d64f-480d-b872-809c915e6804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:37.600489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e141496e-d64f-480d-b872-809c915e6804 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:37.601378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 86/168] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:48:37 2022] PUT /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0/users/11cdbd3e04ed45dc8210e024fdb817b0/roles/4d7a14112b4142d8a641585adf39cc07 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:48:37.601696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e141496e-d64f-480d-b872-809c915e6804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:37.602752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382b962-62b6-45e0-a56b-c8172ba06025 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:37.712938 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:37.728908 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 83/169] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:37.734104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141496e-d64f-480d-b872-809c915e6804 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:37.861878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382b962-62b6-45e0-a56b-c8172ba06025 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:37.952118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616129e-c391-4748-813d-ab8b00d16398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:37.952870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616129e-c391-4748-813d-ab8b00d16398 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:37.953182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616129e-c391-4748-813d-ab8b00d16398 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:37.953564 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616129e-c391-4748-813d-ab8b00d16398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:37.954393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616129e-c391-4748-813d-ab8b00d16398 None admin] RBAC: Adding query filter params (role.id=f866ebebacd841168b26ac7ec2c7461b, scope.project.id=25b73a36dde84c9d97a80501da4f16d0, user.id=7844dee1bb874523a45debbded632cde) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:37.954726 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616129e-c391-4748-813d-ab8b00d16398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:37.957024 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616129e-c391-4748-813d-ab8b00d16398 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:37.965435 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 87/170] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:37 2022] GET /identity/v3/role_assignments?user.id=7844dee1bb874523a45debbded632cde&scope.project.id=25b73a36dde84c9d97a80501da4f16d0&role.id=f866ebebacd841168b26ac7ec2c7461b => generated 608 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:37.969715 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5f097-e146-4cc4-bb66-e2e0a47134f7 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:37.969990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5f097-e146-4cc4-bb66-e2e0a47134f7 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:37.970428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5f097-e146-4cc4-bb66-e2e0a47134f7 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:37.972990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 88/171] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:37.974666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141496e-d64f-480d-b872-809c915e6804 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:37.980365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c77077-9cef-4431-8fbf-ac5f7c4de8f2 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:37.981008 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c77077-9cef-4431-8fbf-ac5f7c4de8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:37.981478 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c77077-9cef-4431-8fbf-ac5f7c4de8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:37.993336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:38.012300 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-74c77077-9cef-4431-8fbf-ac5f7c4de8f2 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:38.014040 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-74c77077-9cef-4431-8fbf-ac5f7c4de8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:38.046539 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b4146-843f-4eab-ab94-316492e7312e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:38.047399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b4146-843f-4eab-ab94-316492e7312e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:38.047683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b4146-843f-4eab-ab94-316492e7312e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:38.047954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b4146-843f-4eab-ab94-316492e7312e None admin] PATH_INFO: `/v3/users/7844dee1bb874523a45debbded632cde` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:38.050172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b4146-843f-4eab-ab94-316492e7312e None admin] RBAC: Authorizing `identity:get_user(user_id=7844dee1bb874523a45debbded632cde)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:38.051368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b4146-843f-4eab-ab94-316492e7312e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:38.054143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 84/172] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:37 2022] GET /identity/v3/users/7844dee1bb874523a45debbded632cde => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:38.055547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517264d-e914-4605-841c-494067d9ecae None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:38.055842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517264d-e914-4605-841c-494067d9ecae None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:38.056136 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517264d-e914-4605-841c-494067d9ecae None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:38.057904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 85/173] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:38.065317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517264d-e914-4605-841c-494067d9ecae None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:38.163659 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 89/174] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:38.165711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a5c7a-8c92-4097-a183-64dd9941c3ba None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:38.166192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a5c7a-8c92-4097-a183-64dd9941c3ba None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:38.166650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a5c7a-8c92-4097-a183-64dd9941c3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:38.196006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-cf6a5c7a-8c92-4097-a183-64dd9941c3ba None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:38.198384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-cf6a5c7a-8c92-4097-a183-64dd9941c3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:38.263675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:38.341042 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517264d-e914-4605-841c-494067d9ecae None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:38.364878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 90/175] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:38.407707 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac7438-5617-4a67-a40f-a54c80409f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:38.408607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac7438-5617-4a67-a40f-a54c80409f4b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:38.409040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac7438-5617-4a67-a40f-a54c80409f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:38.409466 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac7438-5617-4a67-a40f-a54c80409f4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:38.479839 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a5c7a-8c92-4097-a183-64dd9941c3ba None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:38.507741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac7438-5617-4a67-a40f-a54c80409f4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:38.509480 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac7438-5617-4a67-a40f-a54c80409f4b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:38.588611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:38.615175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:38.657594 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a5c7a-8c92-4097-a183-64dd9941c3ba None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:38.700080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 86/176] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:38.701260 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac7438-5617-4a67-a40f-a54c80409f4b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:38.729111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cbf05-6945-40d8-9fa3-8890fd917e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:38.730097 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cbf05-6945-40d8-9fa3-8890fd917e57 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:38.730329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cbf05-6945-40d8-9fa3-8890fd917e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:38.730628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cbf05-6945-40d8-9fa3-8890fd917e57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:38.744895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cbf05-6945-40d8-9fa3-8890fd917e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-9a7cbf05-6945-40d8-9fa3-8890fd917e57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:38.749698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:38.750787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:38.751686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:38.751686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:38.751686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:38.751686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:38.751686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:38.751686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:38.751686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:38.751686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:38.751686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:38.751686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:38.751686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:38.751686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:38.751686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 91/177] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:48:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:38.752506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cbf05-6945-40d8-9fa3-8890fd917e57 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:38.827152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac7438-5617-4a67-a40f-a54c80409f4b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:38.863847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cbf05-6945-40d8-9fa3-8890fd917e57 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:38.864244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710d449-e63d-4ebd-afca-c80ee6fbd9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:38.864885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710d449-e63d-4ebd-afca-c80ee6fbd9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:38.865198 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710d449-e63d-4ebd-afca-c80ee6fbd9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:38.865459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710d449-e63d-4ebd-afca-c80ee6fbd9f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:38.878350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710d449-e63d-4ebd-afca-c80ee6fbd9f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c710d449-e63d-4ebd-afca-c80ee6fbd9f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:38.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:38.884195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:38.884982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:38.884982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:38.884982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:38.884982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:38.884982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:38.884982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:38.884982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:38.884982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:38.884982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:38.884982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:38.884982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:38.884982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:38.884982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 87/178] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:38.886071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710d449-e63d-4ebd-afca-c80ee6fbd9f8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:38.899222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:38.911297 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036c3e0-379f-44c1-bfe5-390add468184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:38.911941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036c3e0-379f-44c1-bfe5-390add468184 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:38.912217 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036c3e0-379f-44c1-bfe5-390add468184 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:38.912489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036c3e0-379f-44c1-bfe5-390add468184 None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:38.913667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036c3e0-379f-44c1-bfe5-390add468184 None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:38.915194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036c3e0-379f-44c1-bfe5-390add468184 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:38.916859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 92/179] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:38 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:38.918036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3100-d294-4af3-b01a-6566a1064a97 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:38.918317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3100-d294-4af3-b01a-6566a1064a97 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:38.918609 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3100-d294-4af3-b01a-6566a1064a97 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:38.919082 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:38.920054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 93/180] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:38.922623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b3100-d294-4af3-b01a-6566a1064a97 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:39.013474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710d449-e63d-4ebd-afca-c80ee6fbd9f8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:39.036221 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b3100-d294-4af3-b01a-6566a1064a97 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:39.056479 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b68bb5-cc3c-4ed8-8d77-fd494fb36ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:39.057452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b68bb5-cc3c-4ed8-8d77-fd494fb36ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:39.057733 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b68bb5-cc3c-4ed8-8d77-fd494fb36ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:39.058007 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b68bb5-cc3c-4ed8-8d77-fd494fb36ad9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:39.059151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b68bb5-cc3c-4ed8-8d77-fd494fb36ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:39.060620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b68bb5-cc3c-4ed8-8d77-fd494fb36ad9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:39.062540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 88/181] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:39.063104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b68bb5-cc3c-4ed8-8d77-fd494fb36ad9 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:39.083415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198243b-2c9f-4c71-acfe-b1c2e4d1626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:39.084053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198243b-2c9f-4c71-acfe-b1c2e4d1626d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:39.084339 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198243b-2c9f-4c71-acfe-b1c2e4d1626d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:39.084604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198243b-2c9f-4c71-acfe-b1c2e4d1626d None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:39.085279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198243b-2c9f-4c71-acfe-b1c2e4d1626d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:39.085573 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198243b-2c9f-4c71-acfe-b1c2e4d1626d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:39.087590 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198243b-2c9f-4c71-acfe-b1c2e4d1626d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:39.101655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 94/182] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:39.103321 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28681e-df6c-4c07-ac00-ac3b7644c9ca None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:39.103608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28681e-df6c-4c07-ac00-ac3b7644c9ca None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:39.103903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28681e-df6c-4c07-ac00-ac3b7644c9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:39.122798 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-9b28681e-df6c-4c07-ac00-ac3b7644c9ca None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:39.123871 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9b28681e-df6c-4c07-ac00-ac3b7644c9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:39.169686 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:39.178171 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b68bb5-cc3c-4ed8-8d77-fd494fb36ad9 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:39.182575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:39.203268 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 95/183] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:39.211929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28681e-df6c-4c07-ac00-ac3b7644c9ca None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:39.220475 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc36b7-5e6c-4e5c-9946-e960f1a6b795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:39.221287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc36b7-5e6c-4e5c-9946-e960f1a6b795 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:39.221620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc36b7-5e6c-4e5c-9946-e960f1a6b795 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:39.222046 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc36b7-5e6c-4e5c-9946-e960f1a6b795 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:39.223244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc36b7-5e6c-4e5c-9946-e960f1a6b795 None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:39.223763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc36b7-5e6c-4e5c-9946-e960f1a6b795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:39.225733 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc36b7-5e6c-4e5c-9946-e960f1a6b795 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:39.235924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 89/184] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:39.241058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc36b7-5e6c-4e5c-9946-e960f1a6b795 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:39.335322 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28681e-df6c-4c07-ac00-ac3b7644c9ca None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:39.360498 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc36b7-5e6c-4e5c-9946-e960f1a6b795 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:39.384434 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669a116-37f3-4fb9-aa8a-76ddef0cb376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:39.386315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669a116-37f3-4fb9-aa8a-76ddef0cb376 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:39.387051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669a116-37f3-4fb9-aa8a-76ddef0cb376 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:39.387511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669a116-37f3-4fb9-aa8a-76ddef0cb376 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:39.389090 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669a116-37f3-4fb9-aa8a-76ddef0cb376 None admin] RBAC: Adding query filter params (role.id=64aca4dbf153454d8abb3af690d90c76, scope.project.id=25b73a36dde84c9d97a80501da4f16d0, user.id=7844dee1bb874523a45debbded632cde) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:39.389865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669a116-37f3-4fb9-aa8a-76ddef0cb376 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:39.392165 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669a116-37f3-4fb9-aa8a-76ddef0cb376 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:39.399546 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064860e2-4207-4aad-8f40-cafcfb1cee66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:39.400170 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064860e2-4207-4aad-8f40-cafcfb1cee66 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:39.400452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064860e2-4207-4aad-8f40-cafcfb1cee66 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:39.400783 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064860e2-4207-4aad-8f40-cafcfb1cee66 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:39.401377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064860e2-4207-4aad-8f40-cafcfb1cee66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:39.401879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 96/185] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:39 2022] GET /identity/v3/role_assignments?user.id=7844dee1bb874523a45debbded632cde&scope.project.id=25b73a36dde84c9d97a80501da4f16d0&role.id=64aca4dbf153454d8abb3af690d90c76 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:39.402922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064860e2-4207-4aad-8f40-cafcfb1cee66 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:39.404203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669a116-37f3-4fb9-aa8a-76ddef0cb376 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:39.431183 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 90/186] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:48:39 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:39.432029 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064860e2-4207-4aad-8f40-cafcfb1cee66 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:39.449735 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:39.474131 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:39.550531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669a116-37f3-4fb9-aa8a-76ddef0cb376 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:39.554249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064860e2-4207-4aad-8f40-cafcfb1cee66 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:39.593010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d5505-7a59-4b21-bbc7-3395858b565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:39.593980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d5505-7a59-4b21-bbc7-3395858b565e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:39.594431 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d5505-7a59-4b21-bbc7-3395858b565e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:39.594987 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d5505-7a59-4b21-bbc7-3395858b565e None admin] PATH_INFO: `/v3/users/d87bda8d8cf54e6dad3732fb8f9b748f` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:39.595572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b20a15-5e13-4e14-9137-ff26c3f5bc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:39.596419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b20a15-5e13-4e14-9137-ff26c3f5bc74 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:39.596701 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b20a15-5e13-4e14-9137-ff26c3f5bc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:39.596979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b20a15-5e13-4e14-9137-ff26c3f5bc74 None admin] PATH_INFO: `/v3/users/7844dee1bb874523a45debbded632cde` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:39.598347 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b20a15-5e13-4e14-9137-ff26c3f5bc74 None admin] RBAC: Authorizing `identity:get_user(user_id=7844dee1bb874523a45debbded632cde)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:39.599884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b20a15-5e13-4e14-9137-ff26c3f5bc74 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:39.601918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 91/187] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:39 2022] GET /identity/v3/users/7844dee1bb874523a45debbded632cde => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:39.602755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b20a15-5e13-4e14-9137-ff26c3f5bc74 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:39.613454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d5505-7a59-4b21-bbc7-3395858b565e None admin] RBAC: Authorizing `identity:get_user(user_id=d87bda8d8cf54e6dad3732fb8f9b748f)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:39.615400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d5505-7a59-4b21-bbc7-3395858b565e None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:39.617721 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 97/188] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:39 2022] GET /identity/v3/users/d87bda8d8cf54e6dad3732fb8f9b748f => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:39.618898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d5505-7a59-4b21-bbc7-3395858b565e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:39.728419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:39.756525 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b20a15-5e13-4e14-9137-ff26c3f5bc74 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:39.769233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d5505-7a59-4b21-bbc7-3395858b565e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:39.778496 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:39.808797 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45303b-a6c6-43e1-8525-b3e9070c391f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:39.809778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45303b-a6c6-43e1-8525-b3e9070c391f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:39.810012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45303b-a6c6-43e1-8525-b3e9070c391f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:39.810430 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45303b-a6c6-43e1-8525-b3e9070c391f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:39.816851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fcf54-4550-4c45-8510-e6bc4f42eb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:39.817684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fcf54-4550-4c45-8510-e6bc4f42eb6b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:39.819047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fcf54-4550-4c45-8510-e6bc4f42eb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:39.819462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fcf54-4550-4c45-8510-e6bc4f42eb6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:39.828863 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45303b-a6c6-43e1-8525-b3e9070c391f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-5f45303b-a6c6-43e1-8525-b3e9070c391f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:39.837360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:39.838519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:39.839540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:39.839540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:39.839540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:39.839540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:39.839540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:39.839540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:39.839540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:39.839540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:39.839540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:39.839540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:39.839540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:48:39.839540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:39.839540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 92/189] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:48:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:39.839540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45303b-a6c6-43e1-8525-b3e9070c391f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:39.930561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fcf54-4550-4c45-8510-e6bc4f42eb6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:39.932197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fcf54-4550-4c45-8510-e6bc4f42eb6b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:39.983065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45303b-a6c6-43e1-8525-b3e9070c391f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:40.032336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bab51a-80d0-4dfc-9186-06a12d4b004e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:40.033089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab51a-80d0-4dfc-9186-06a12d4b004e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:40.033464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab51a-80d0-4dfc-9186-06a12d4b004e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:40.034033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bab51a-80d0-4dfc-9186-06a12d4b004e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:40.048876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:40.084676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 98/190] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:40.085887 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fcf54-4550-4c45-8510-e6bc4f42eb6b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:40.100715 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:40.160088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bab51a-80d0-4dfc-9186-06a12d4b004e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:40.161961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bab51a-80d0-4dfc-9186-06a12d4b004e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:40.207032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fcf54-4550-4c45-8510-e6bc4f42eb6b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:40.259230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231edec4-99b6-4643-a70f-aeff12adad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:40.259845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231edec4-99b6-4643-a70f-aeff12adad48 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:40.260117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231edec4-99b6-4643-a70f-aeff12adad48 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:40.260382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231edec4-99b6-4643-a70f-aeff12adad48 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:40.261057 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231edec4-99b6-4643-a70f-aeff12adad48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:40.261351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231edec4-99b6-4643-a70f-aeff12adad48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:40.262818 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231edec4-99b6-4643-a70f-aeff12adad48 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:40.284129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 99/191] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:48:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:40.285101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231edec4-99b6-4643-a70f-aeff12adad48 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:40.355649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 93/192] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:40.357037 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bab51a-80d0-4dfc-9186-06a12d4b004e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:40.377897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:40.406224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:40.415625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231edec4-99b6-4643-a70f-aeff12adad48 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:40.461030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaeb3d2-e52b-4f97-bfab-62b8e343bdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:40.461572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeb3d2-e52b-4f97-bfab-62b8e343bdb6 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:40.461844 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeb3d2-e52b-4f97-bfab-62b8e343bdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:40.462109 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeb3d2-e52b-4f97-bfab-62b8e343bdb6 None admin] PATH_INFO: `/v3/projects/c04ba4146576497da42624a6ecb68d3c` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:40.463346 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaeb3d2-e52b-4f97-bfab-62b8e343bdb6 None admin] RBAC: Authorizing `identity:get_project(project_id=c04ba4146576497da42624a6ecb68d3c)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:40.465192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaeb3d2-e52b-4f97-bfab-62b8e343bdb6 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:40.467250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 100/193] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:40 2022] GET /identity/v3/projects/c04ba4146576497da42624a6ecb68d3c => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:40.469053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ecb86-a1d1-4081-8d0f-67b040b2e411 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:40.469334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ecb86-a1d1-4081-8d0f-67b040b2e411 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:40.469596 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ecb86-a1d1-4081-8d0f-67b040b2e411 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:40.471056 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 101/194] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:40.475843 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ecb86-a1d1-4081-8d0f-67b040b2e411 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:40.492790 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bab51a-80d0-4dfc-9186-06a12d4b004e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:40.547065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd12fc5-760b-4754-bfc1-9f8a6583eac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:40.547718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd12fc5-760b-4754-bfc1-9f8a6583eac9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:40.548133 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd12fc5-760b-4754-bfc1-9f8a6583eac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:40.548408 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd12fc5-760b-4754-bfc1-9f8a6583eac9 None admin] PATH_INFO: `/v3/users/d87bda8d8cf54e6dad3732fb8f9b748f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:40.549969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd12fc5-760b-4754-bfc1-9f8a6583eac9 None admin] RBAC: Authorizing `identity:get_user(user_id=d87bda8d8cf54e6dad3732fb8f9b748f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:40.551906 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd12fc5-760b-4754-bfc1-9f8a6583eac9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:40.553956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 94/195] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:40 2022] GET /identity/v3/users/d87bda8d8cf54e6dad3732fb8f9b748f => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:40.555251 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd12fc5-760b-4754-bfc1-9f8a6583eac9 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:40.617804 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ecb86-a1d1-4081-8d0f-67b040b2e411 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:40.657503 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ec653-43f8-4637-b736-2c21aa4b86c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:40.658136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec653-43f8-4637-b736-2c21aa4b86c6 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:40.658454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec653-43f8-4637-b736-2c21aa4b86c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:40.658758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec653-43f8-4637-b736-2c21aa4b86c6 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:40.660107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ec653-43f8-4637-b736-2c21aa4b86c6 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:40.661630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ec653-43f8-4637-b736-2c21aa4b86c6 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:40.664149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 102/196] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:40 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:40.665377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95464360-1f96-432b-b4c8-7e6ffec0308d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:40.665668 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95464360-1f96-432b-b4c8-7e6ffec0308d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:40.665918 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95464360-1f96-432b-b4c8-7e6ffec0308d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:40.674348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:40.675791 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd12fc5-760b-4754-bfc1-9f8a6583eac9 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:40.686653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-95464360-1f96-432b-b4c8-7e6ffec0308d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:40.688065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:40.689088 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-95464360-1f96-432b-b4c8-7e6ffec0308d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:40.717308 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1488bc-420e-438e-9c13-54a1440656fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:40.717953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1488bc-420e-438e-9c13-54a1440656fd None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:40.718816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1488bc-420e-438e-9c13-54a1440656fd None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:40.719151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1488bc-420e-438e-9c13-54a1440656fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:40.720221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1488bc-420e-438e-9c13-54a1440656fd None admin] RBAC: Adding query filter params (role.id=f866ebebacd841168b26ac7ec2c7461b, scope.project.id=c04ba4146576497da42624a6ecb68d3c, user.id=7844dee1bb874523a45debbded632cde) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:40.720590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1488bc-420e-438e-9c13-54a1440656fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:40.722912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1488bc-420e-438e-9c13-54a1440656fd None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:40.734311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 95/197] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:40 2022] GET /identity/v3/role_assignments?user.id=7844dee1bb874523a45debbded632cde&scope.project.id=c04ba4146576497da42624a6ecb68d3c&role.id=f866ebebacd841168b26ac7ec2c7461b => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:40.735096 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1488bc-420e-438e-9c13-54a1440656fd None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:40.838204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 103/198] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:40.839686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95464360-1f96-432b-b4c8-7e6ffec0308d None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:40.928487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1488bc-420e-438e-9c13-54a1440656fd None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:41.021117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb6ef2-763a-45b9-af60-81cee507c081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:41.022114 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb6ef2-763a-45b9-af60-81cee507c081 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:41.022821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb6ef2-763a-45b9-af60-81cee507c081 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:41.024350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb6ef2-763a-45b9-af60-81cee507c081 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:41.094277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95464360-1f96-432b-b4c8-7e6ffec0308d None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:41.114966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:41.151155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b5df7-dc39-4faa-b5a0-fae138853735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:41.151801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b5df7-dc39-4faa-b5a0-fae138853735 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:41.152085 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b5df7-dc39-4faa-b5a0-fae138853735 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:41.152354 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b5df7-dc39-4faa-b5a0-fae138853735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:41.153093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b5df7-dc39-4faa-b5a0-fae138853735 None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b, user.id=d87bda8d8cf54e6dad3732fb8f9b748f) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:41.153393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b5df7-dc39-4faa-b5a0-fae138853735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:41.155127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b5df7-dc39-4faa-b5a0-fae138853735 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:41.157544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:41.165306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 104/199] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:40 2022] GET /identity/v3/role_assignments?user.id=d87bda8d8cf54e6dad3732fb8f9b748f&scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:41.178470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb6ef2-763a-45b9-af60-81cee507c081 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:41.180315 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb6ef2-763a-45b9-af60-81cee507c081 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:41.238343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b5df7-dc39-4faa-b5a0-fae138853735 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:41.388806 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 96/200] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:41.394266 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb6ef2-763a-45b9-af60-81cee507c081 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:41.433693 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b5df7-dc39-4faa-b5a0-fae138853735 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:41.512147 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b098f-2703-4125-8399-99dbc88223d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:41.512843 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b098f-2703-4125-8399-99dbc88223d2 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:41.513122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b098f-2703-4125-8399-99dbc88223d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:41.513392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b098f-2703-4125-8399-99dbc88223d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:41.531423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:41.532456 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b098f-2703-4125-8399-99dbc88223d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-3e7b098f-2703-4125-8399-99dbc88223d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:41.538170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:41.539129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:41.539919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:41.539919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:41.539919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:41.539919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:41.539919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:41.539919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:41.539919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:41.539919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:41.539919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:41.539919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:41.539919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:41.539919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:41.550973 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 105/201] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:48:41.556452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b098f-2703-4125-8399-99dbc88223d2 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:41.607387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb6ef2-763a-45b9-af60-81cee507c081 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:41.676426 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37922713-0828-4413-a216-923c2c835a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:41.677467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37922713-0828-4413-a216-923c2c835a27 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:41.679434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37922713-0828-4413-a216-923c2c835a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:41.679901 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37922713-0828-4413-a216-923c2c835a27 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:41.681444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37922713-0828-4413-a216-923c2c835a27 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:41.684812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37922713-0828-4413-a216-923c2c835a27 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:41.689499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 97/202] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:41 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:41.695724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:41.698244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37922713-0828-4413-a216-923c2c835a27 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:41.786429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b098f-2703-4125-8399-99dbc88223d2 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:41.840145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4d857-038e-4a6e-b423-649ea0768539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:41.841731 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4d857-038e-4a6e-b423-649ea0768539 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:41.842350 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4d857-038e-4a6e-b423-649ea0768539 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:41.845126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4d857-038e-4a6e-b423-649ea0768539 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:41.846068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4d857-038e-4a6e-b423-649ea0768539 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:41.846564 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4d857-038e-4a6e-b423-649ea0768539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:41.848223 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4d857-038e-4a6e-b423-649ea0768539 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:41.867436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 106/203] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:41.873558 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4d857-038e-4a6e-b423-649ea0768539 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:41.935972 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37922713-0828-4413-a216-923c2c835a27 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:41.983425 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4d857-038e-4a6e-b423-649ea0768539 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:42.005806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:42.013298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f1ae2-b874-4470-a951-2c3b191f7d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:42.013929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1ae2-b874-4470-a951-2c3b191f7d41 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:42.014204 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1ae2-b874-4470-a951-2c3b191f7d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:42.014478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f1ae2-b874-4470-a951-2c3b191f7d41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:42.015262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f1ae2-b874-4470-a951-2c3b191f7d41 None admin] RBAC: Adding query filter params (role.id=64aca4dbf153454d8abb3af690d90c76, scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b, user.id=d87bda8d8cf54e6dad3732fb8f9b748f) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:42.015566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f1ae2-b874-4470-a951-2c3b191f7d41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:42.017071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f1ae2-b874-4470-a951-2c3b191f7d41 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:42.036462 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 98/204] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:41 2022] GET /identity/v3/role_assignments?user.id=d87bda8d8cf54e6dad3732fb8f9b748f&scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b&role.id=64aca4dbf153454d8abb3af690d90c76 => generated 259 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:42.044728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528734d-7dde-43c2-ba16-bce3fcbf6b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:42.050660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528734d-7dde-43c2-ba16-bce3fcbf6b57 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:42.050660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528734d-7dde-43c2-ba16-bce3fcbf6b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:42.050660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528734d-7dde-43c2-ba16-bce3fcbf6b57 None admin] PATH_INFO: `/v3/users/11cdbd3e04ed45dc8210e024fdb817b0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:42.050660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528734d-7dde-43c2-ba16-bce3fcbf6b57 None admin] RBAC: Authorizing `identity:get_user(user_id=11cdbd3e04ed45dc8210e024fdb817b0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:42.050660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528734d-7dde-43c2-ba16-bce3fcbf6b57 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:42.054624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 107/205] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:41 2022] GET /identity/v3/users/11cdbd3e04ed45dc8210e024fdb817b0 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:42.062641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f1ae2-b874-4470-a951-2c3b191f7d41 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:42.072815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:42.086794 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63541470-f3d1-4062-81f2-a5cb0bbcd5ce None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:42.087210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63541470-f3d1-4062-81f2-a5cb0bbcd5ce None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:42.089099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63541470-f3d1-4062-81f2-a5cb0bbcd5ce None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:42.089099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 108/206] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:42.103113 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838559f2-26b2-47de-952f-32e81377e046 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:42.103609 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838559f2-26b2-47de-952f-32e81377e046 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:42.104089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838559f2-26b2-47de-952f-32e81377e046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:42.146684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-838559f2-26b2-47de-952f-32e81377e046 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:42.147847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-838559f2-26b2-47de-952f-32e81377e046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:42.252167 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 109/207] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 22 15:48:42.279835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f1ae2-b874-4470-a951-2c3b191f7d41 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:42.322556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e0ca7-66ed-4ffd-b7ba-c3f2ce82191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:42.323211 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0ca7-66ed-4ffd-b7ba-c3f2ce82191d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:42.323488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0ca7-66ed-4ffd-b7ba-c3f2ce82191d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:42.323760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e0ca7-66ed-4ffd-b7ba-c3f2ce82191d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:42.400879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88353c-5255-4d69-a1c7-52a4c0455fbe None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:42.401515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88353c-5255-4d69-a1c7-52a4c0455fbe None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:42.401978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88353c-5255-4d69-a1c7-52a4c0455fbe None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:42.404060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 110/208] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:42.409736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848730c-1e84-4080-912c-9d4b5a06e514 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:42.410378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848730c-1e84-4080-912c-9d4b5a06e514 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:42.410867 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848730c-1e84-4080-912c-9d4b5a06e514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:42.413262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e0ca7-66ed-4ffd-b7ba-c3f2ce82191d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:42.414799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e0ca7-66ed-4ffd-b7ba-c3f2ce82191d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:42.427055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:42.437651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c848730c-1e84-4080-912c-9d4b5a06e514 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:42.440828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c848730c-1e84-4080-912c-9d4b5a06e514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:42.571382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 111/209] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:48:42.602037 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848730c-1e84-4080-912c-9d4b5a06e514 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:42.646982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 99/210] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:42.659962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e0ca7-66ed-4ffd-b7ba-c3f2ce82191d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:42.671315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:42.731165 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848730c-1e84-4080-912c-9d4b5a06e514 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:42.774058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac71468-0aa1-44e8-a674-b1fca2c0167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:42.775150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac71468-0aa1-44e8-a674-b1fca2c0167d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:42.776464 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac71468-0aa1-44e8-a674-b1fca2c0167d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:42.776986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac71468-0aa1-44e8-a674-b1fca2c0167d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:42.779236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac71468-0aa1-44e8-a674-b1fca2c0167d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:42.781095 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac71468-0aa1-44e8-a674-b1fca2c0167d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:42.785682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 112/211] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:42.794978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac71468-0aa1-44e8-a674-b1fca2c0167d None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:42.864745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e0ca7-66ed-4ffd-b7ba-c3f2ce82191d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:42.874497 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:42.925954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d50071-b2bd-4f99-b7ab-0db609ff9914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:42.927172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50071-b2bd-4f99-b7ab-0db609ff9914 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:42.927620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50071-b2bd-4f99-b7ab-0db609ff9914 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:42.928042 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50071-b2bd-4f99-b7ab-0db609ff9914 None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:42.929720 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d50071-b2bd-4f99-b7ab-0db609ff9914 None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:42.931852 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d50071-b2bd-4f99-b7ab-0db609ff9914 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:42.934446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 100/212] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:42 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:42.935977 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d50071-b2bd-4f99-b7ab-0db609ff9914 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:43.000561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac71468-0aa1-44e8-a674-b1fca2c0167d None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:43.023982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:43.049806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aaaaf-bd31-4c27-b5e9-a6abf9b9e2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:43.050485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aaaaf-bd31-4c27-b5e9-a6abf9b9e2cd None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:43.050848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aaaaf-bd31-4c27-b5e9-a6abf9b9e2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:43.051124 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aaaaf-bd31-4c27-b5e9-a6abf9b9e2cd None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:43.052051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aaaaf-bd31-4c27-b5e9-a6abf9b9e2cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:43.054287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aaaaf-bd31-4c27-b5e9-a6abf9b9e2cd None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:43.086705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 113/213] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:48:42 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:43.088091 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aaaaf-bd31-4c27-b5e9-a6abf9b9e2cd None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:43.106011 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d50071-b2bd-4f99-b7ab-0db609ff9914 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:43.184293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b8f5d-073a-4208-a974-9a0ce5d2776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:43.185184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b8f5d-073a-4208-a974-9a0ce5d2776b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:43.185615 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b8f5d-073a-4208-a974-9a0ce5d2776b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:43.186026 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b8f5d-073a-4208-a974-9a0ce5d2776b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:43.221103 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b8f5d-073a-4208-a974-9a0ce5d2776b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-f12b8f5d-073a-4208-a974-9a0ce5d2776b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:43.232714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:43.233657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:43.234444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:43.234444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:43.234444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:43.234444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:43.234444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:43.234444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:43.234444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:43.234444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:43.234444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:43.234444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:43.234444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:43.234444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:43.246448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 101/214] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:43.248091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b8f5d-073a-4208-a974-9a0ce5d2776b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:43.319717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:43.344087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aaaaf-bd31-4c27-b5e9-a6abf9b9e2cd None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:43.424028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b8f5d-073a-4208-a974-9a0ce5d2776b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:43.433975 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0171d2-18c6-42fb-8015-4831930b6049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:43.435515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0171d2-18c6-42fb-8015-4831930b6049 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:43.435750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0171d2-18c6-42fb-8015-4831930b6049 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:43.436013 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0171d2-18c6-42fb-8015-4831930b6049 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:43.436792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0171d2-18c6-42fb-8015-4831930b6049 None admin] RBAC: Adding query filter params (role.id=4d7a14112b4142d8a641585adf39cc07, scope.project.id=25b73a36dde84c9d97a80501da4f16d0, user.id=11cdbd3e04ed45dc8210e024fdb817b0) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:43.437076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0171d2-18c6-42fb-8015-4831930b6049 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:43.438570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0171d2-18c6-42fb-8015-4831930b6049 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:43.447102 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 114/215] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:43 2022] GET /identity/v3/role_assignments?user.id=11cdbd3e04ed45dc8210e024fdb817b0&scope.project.id=25b73a36dde84c9d97a80501da4f16d0&role.id=4d7a14112b4142d8a641585adf39cc07 => generated 608 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:43.476454 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53f23c-5097-4cbe-9b6e-174d496569ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:43.477087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53f23c-5097-4cbe-9b6e-174d496569ae None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:43.477398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53f23c-5097-4cbe-9b6e-174d496569ae None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:43.477643 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53f23c-5097-4cbe-9b6e-174d496569ae None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:43.478310 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53f23c-5097-4cbe-9b6e-174d496569ae None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:43.478628 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53f23c-5097-4cbe-9b6e-174d496569ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:43.480099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53f23c-5097-4cbe-9b6e-174d496569ae None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:43.487743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c44b60-e4d5-479a-9db3-b4de79e8f553 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:43.488005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c44b60-e4d5-479a-9db3-b4de79e8f553 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:43.488395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c44b60-e4d5-479a-9db3-b4de79e8f553 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:43.489929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 115/216] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:48:43.490640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 102/217] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:43.495559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139000c0-1b47-4298-8d19-d1273caaeca6 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:43.495851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139000c0-1b47-4298-8d19-d1273caaeca6 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:43.496115 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139000c0-1b47-4298-8d19-d1273caaeca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:43.499708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53f23c-5097-4cbe-9b6e-174d496569ae None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:43.519779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-139000c0-1b47-4298-8d19-d1273caaeca6 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:43.521641 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-139000c0-1b47-4298-8d19-d1273caaeca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:43.587151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:43.630584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 116/218] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:48:43.643961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:43.653665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53f23c-5097-4cbe-9b6e-174d496569ae None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:43.696342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0b819-82d0-4834-be60-50b67b59de79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:43.697259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0b819-82d0-4834-be60-50b67b59de79 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:43.697631 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0b819-82d0-4834-be60-50b67b59de79 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:43.697928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0b819-82d0-4834-be60-50b67b59de79 None admin] PATH_INFO: `/v3/users/f078e81c2cb442038e27013668590c10` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:43.716070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0b819-82d0-4834-be60-50b67b59de79 None admin] RBAC: Authorizing `identity:get_user(user_id=f078e81c2cb442038e27013668590c10)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:43.717562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0b819-82d0-4834-be60-50b67b59de79 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:43.719684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 103/219] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:43 2022] GET /identity/v3/users/f078e81c2cb442038e27013668590c10 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:43.728994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139000c0-1b47-4298-8d19-d1273caaeca6 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:43.864998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139000c0-1b47-4298-8d19-d1273caaeca6 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:43.922660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bd581-384d-4ed5-872b-0a50591e775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:43.923829 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bd581-384d-4ed5-872b-0a50591e775f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:43.924383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bd581-384d-4ed5-872b-0a50591e775f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:43.924857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bd581-384d-4ed5-872b-0a50591e775f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:43.953265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0b819-82d0-4834-be60-50b67b59de79 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:44.003216 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:44.073714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bd581-384d-4ed5-872b-0a50591e775f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:44.075609 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bd581-384d-4ed5-872b-0a50591e775f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:44.160863 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0b819-82d0-4834-be60-50b67b59de79 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:44.230087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06601849-98c4-4f40-b8b2-09636a24922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:44.231802 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601849-98c4-4f40-b8b2-09636a24922d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:44.232513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601849-98c4-4f40-b8b2-09636a24922d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:44.233148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06601849-98c4-4f40-b8b2-09636a24922d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:44.265924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06601849-98c4-4f40-b8b2-09636a24922d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-06601849-98c4-4f40-b8b2-09636a24922d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:44.281704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:44.283156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:44.284245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:44.284245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:44.284245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:44.284245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:44.284245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:44.284245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:44.284245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:44.284245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:44.284245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:44.284245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:44.284245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:44.284245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:44.289845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 104/220] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:48:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:44.308657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06601849-98c4-4f40-b8b2-09636a24922d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:44.343036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:44.380129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 117/221] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:44.381528 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a020c5d-1136-482a-8258-56c1242f69cb None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:44.381814 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a020c5d-1136-482a-8258-56c1242f69cb None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:44.382081 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a020c5d-1136-482a-8258-56c1242f69cb None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:44.387706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 118/222] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:44.394638 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730e68b-8746-4ce8-b472-48c3d39536f2 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:44.394638 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730e68b-8746-4ce8-b472-48c3d39536f2 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:44.394638 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730e68b-8746-4ce8-b472-48c3d39536f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:44.411320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1730e68b-8746-4ce8-b472-48c3d39536f2 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:44.412627 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1730e68b-8746-4ce8-b472-48c3d39536f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:44.473832 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06601849-98c4-4f40-b8b2-09636a24922d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:44.487997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:44.496010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 119/223] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:44.497304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730e68b-8746-4ce8-b472-48c3d39536f2 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:44.547426 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfac7b3-6111-4ef6-943c-08a8b7914d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:44.548060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac7b3-6111-4ef6-943c-08a8b7914d07 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:44.548338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac7b3-6111-4ef6-943c-08a8b7914d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:44.548629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfac7b3-6111-4ef6-943c-08a8b7914d07 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:44.549377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfac7b3-6111-4ef6-943c-08a8b7914d07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:44.549679 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfac7b3-6111-4ef6-943c-08a8b7914d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:44.551160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfac7b3-6111-4ef6-943c-08a8b7914d07 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:44.568876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 105/224] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:44.575460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfac7b3-6111-4ef6-943c-08a8b7914d07 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:44.653965 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730e68b-8746-4ce8-b472-48c3d39536f2 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:44.673158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:44.700598 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfac7b3-6111-4ef6-943c-08a8b7914d07 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:44.741542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058623f-f509-4f15-9d51-576786e7a68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:44.742118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058623f-f509-4f15-9d51-576786e7a68d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:44.742395 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058623f-f509-4f15-9d51-576786e7a68d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:44.742701 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058623f-f509-4f15-9d51-576786e7a68d None admin] PATH_INFO: `/v3/users/d87bda8d8cf54e6dad3732fb8f9b748f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:44.744805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058623f-f509-4f15-9d51-576786e7a68d None admin] RBAC: Authorizing `identity:get_user(user_id=d87bda8d8cf54e6dad3732fb8f9b748f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:44.746322 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058623f-f509-4f15-9d51-576786e7a68d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:44.748049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 106/225] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:44 2022] GET /identity/v3/users/d87bda8d8cf54e6dad3732fb8f9b748f => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:44.755212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058623f-f509-4f15-9d51-576786e7a68d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:44.843823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0169f69-4425-4797-8c3f-4664b5eb87f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:44.844932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0169f69-4425-4797-8c3f-4664b5eb87f8 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:44.845404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0169f69-4425-4797-8c3f-4664b5eb87f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:44.845895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0169f69-4425-4797-8c3f-4664b5eb87f8 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:44.851920 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0169f69-4425-4797-8c3f-4664b5eb87f8 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:44.854670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0169f69-4425-4797-8c3f-4664b5eb87f8 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:44.856812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 120/226] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:44 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:44.863988 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0169f69-4425-4797-8c3f-4664b5eb87f8 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:44.870809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058623f-f509-4f15-9d51-576786e7a68d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:44.915441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716ebc5-97da-47b1-8907-751746f690d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:44.916090 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716ebc5-97da-47b1-8907-751746f690d1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:44.916367 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716ebc5-97da-47b1-8907-751746f690d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:44.916638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716ebc5-97da-47b1-8907-751746f690d1 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:44.921878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716ebc5-97da-47b1-8907-751746f690d1 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:44.924131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716ebc5-97da-47b1-8907-751746f690d1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:44.925993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 107/227] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:44 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:44.926884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716ebc5-97da-47b1-8907-751746f690d1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:44.947562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:44.977326 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:45.060047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0169f69-4425-4797-8c3f-4664b5eb87f8 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:45.094463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716ebc5-97da-47b1-8907-751746f690d1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:45.132190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0186c8d-dc28-4ec8-bec5-34f5e96b59fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:45.133658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0186c8d-dc28-4ec8-bec5-34f5e96b59fa None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:45.134331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0186c8d-dc28-4ec8-bec5-34f5e96b59fa None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:45.135038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4daf1-61be-46f7-8a9e-132fd63dc434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:45.135227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0186c8d-dc28-4ec8-bec5-34f5e96b59fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:45.135834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4daf1-61be-46f7-8a9e-132fd63dc434 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:45.136171 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4daf1-61be-46f7-8a9e-132fd63dc434 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:45.136512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4daf1-61be-46f7-8a9e-132fd63dc434 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:45.137923 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0186c8d-dc28-4ec8-bec5-34f5e96b59fa None admin] RBAC: Adding query filter params (role.id=f866ebebacd841168b26ac7ec2c7461b, scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b, user.id=f078e81c2cb442038e27013668590c10) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:45.138855 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0186c8d-dc28-4ec8-bec5-34f5e96b59fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:45.141999 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0186c8d-dc28-4ec8-bec5-34f5e96b59fa None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:45.149622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4daf1-61be-46f7-8a9e-132fd63dc434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:45.152968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 121/228] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:44 2022] GET /identity/v3/role_assignments?user.id=f078e81c2cb442038e27013668590c10&scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b&role.id=f866ebebacd841168b26ac7ec2c7461b => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:45.154861 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0186c8d-dc28-4ec8-bec5-34f5e96b59fa None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-cec4daf1-61be-46f7-8a9e-132fd63dc434 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:45.161279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:45.163253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:45.164843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:45.164843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:45.164843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:45.164843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:45.164843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:45.164843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:45.164843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:45.164843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:45.164843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:45.164843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:45.164843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:48:45.164843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:45.164843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 108/229] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:48:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:45.169954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4daf1-61be-46f7-8a9e-132fd63dc434 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:45.378836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:45.411151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0186c8d-dc28-4ec8-bec5-34f5e96b59fa None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:45.458430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:45.460629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4daf1-61be-46f7-8a9e-132fd63dc434 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:45.473158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ced1c9-2d90-40d5-bc71-0115da26ae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:45.476989 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced1c9-2d90-40d5-bc71-0115da26ae3a None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:45.477486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced1c9-2d90-40d5-bc71-0115da26ae3a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:45.477928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced1c9-2d90-40d5-bc71-0115da26ae3a None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b/users/d87bda8d8cf54e6dad3732fb8f9b748f/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:45.480557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ced1c9-2d90-40d5-bc71-0115da26ae3a None admin] RBAC: Authorizing `identity:create_grant(project_id=e27bb360e92e43f2bdebf830fd0ff33b, user_id=d87bda8d8cf54e6dad3732fb8f9b748f, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:45.484708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ced1c9-2d90-40d5-bc71-0115da26ae3a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:45.512983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 122/230] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:48:45 2022] PUT /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b/users/d87bda8d8cf54e6dad3732fb8f9b748f/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:48:45.519413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827efdc-b53e-4824-acbd-6acb6aff892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:45.520439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827efdc-b53e-4824-acbd-6acb6aff892f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:45.520900 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827efdc-b53e-4824-acbd-6acb6aff892f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:45.521463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827efdc-b53e-4824-acbd-6acb6aff892f None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:45.522660 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827efdc-b53e-4824-acbd-6acb6aff892f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:45.523173 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827efdc-b53e-4824-acbd-6acb6aff892f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:45.525046 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827efdc-b53e-4824-acbd-6acb6aff892f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:45.536929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 109/231] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:48:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:45.542813 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ced1c9-2d90-40d5-bc71-0115da26ae3a None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:45.721120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ced1c9-2d90-40d5-bc71-0115da26ae3a None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:45.799815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4f95e-c464-4c55-bb53-dca7981f57cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:45.801266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4f95e-c464-4c55-bb53-dca7981f57cd None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:45.802014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4f95e-c464-4c55-bb53-dca7981f57cd None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:45.802755 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4f95e-c464-4c55-bb53-dca7981f57cd None admin] PATH_INFO: `/v3/users/d87bda8d8cf54e6dad3732fb8f9b748f` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:45.805321 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4f95e-c464-4c55-bb53-dca7981f57cd None admin] RBAC: Authorizing `identity:get_user(user_id=d87bda8d8cf54e6dad3732fb8f9b748f)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:45.807452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4f95e-c464-4c55-bb53-dca7981f57cd None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:45.810142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 123/232] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:45 2022] GET /identity/v3/users/d87bda8d8cf54e6dad3732fb8f9b748f => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:45.816005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827efdc-b53e-4824-acbd-6acb6aff892f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:45.960194 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827efdc-b53e-4824-acbd-6acb6aff892f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:46.001419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:46.007956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d2b89-36ff-4774-8c74-8e72cc85d248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:46.008607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d2b89-36ff-4774-8c74-8e72cc85d248 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:46.008886 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d2b89-36ff-4774-8c74-8e72cc85d248 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:46.009160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d2b89-36ff-4774-8c74-8e72cc85d248 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:46.010367 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d2b89-36ff-4774-8c74-8e72cc85d248 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:46.011906 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d2b89-36ff-4774-8c74-8e72cc85d248 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:46.013887 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 110/233] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:45 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:46.019794 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4f95e-c464-4c55-bb53-dca7981f57cd None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:46.119327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:46.212101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4f95e-c464-4c55-bb53-dca7981f57cd None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:46.238556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a41de-58f8-4094-a9b4-834d955c137a None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:46.239222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a41de-58f8-4094-a9b4-834d955c137a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:46.239844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a41de-58f8-4094-a9b4-834d955c137a None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:46.241477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 111/234] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:46.247439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5082a-2791-4300-9938-94fea8e70a2e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:46.248063 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5082a-2791-4300-9938-94fea8e70a2e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:46.248539 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5082a-2791-4300-9938-94fea8e70a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:46.277116 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2b92b-e280-4e00-8d40-7f9383d60e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:46.278119 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2b92b-e280-4e00-8d40-7f9383d60e57 None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:46.278626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2b92b-e280-4e00-8d40-7f9383d60e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:46.279130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2b92b-e280-4e00-8d40-7f9383d60e57 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b/users/d87bda8d8cf54e6dad3732fb8f9b748f/roles/64aca4dbf153454d8abb3af690d90c76` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:46.283641 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2b92b-e280-4e00-8d40-7f9383d60e57 None admin] RBAC: Authorizing `identity:create_grant(project_id=e27bb360e92e43f2bdebf830fd0ff33b, user_id=d87bda8d8cf54e6dad3732fb8f9b748f, role_id=64aca4dbf153454d8abb3af690d90c76)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:46.290119 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2b92b-e280-4e00-8d40-7f9383d60e57 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:46.291766 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e1e5082a-2791-4300-9938-94fea8e70a2e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:46.293314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e1e5082a-2791-4300-9938-94fea8e70a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:46.322689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 124/235] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:48:46 2022] PUT /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b/users/d87bda8d8cf54e6dad3732fb8f9b748f/roles/64aca4dbf153454d8abb3af690d90c76 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:48:46.322689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dbc9d-3ac8-4061-a718-e18bb4b47800 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:46.323245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dbc9d-3ac8-4061-a718-e18bb4b47800 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:46.323822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dbc9d-3ac8-4061-a718-e18bb4b47800 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:46.331068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 125/236] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:46.343154 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd024c-6038-4e66-9e5a-cc85ad08c74f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:46.343724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd024c-6038-4e66-9e5a-cc85ad08c74f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:46.344195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd024c-6038-4e66-9e5a-cc85ad08c74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:46.365602 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1fcd024c-6038-4e66-9e5a-cc85ad08c74f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:46.368450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1fcd024c-6038-4e66-9e5a-cc85ad08c74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:46.463470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 112/237] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:46.478233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 126/238] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:48:46.766895 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5082a-2791-4300-9938-94fea8e70a2e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:46.893986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd024c-6038-4e66-9e5a-cc85ad08c74f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:46.895565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5082a-2791-4300-9938-94fea8e70a2e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:46.951248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:46.959980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0208595-57e6-488a-927e-bb727028f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:46.960642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0208595-57e6-488a-927e-bb727028f563 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:46.960917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0208595-57e6-488a-927e-bb727028f563 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:46.961266 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0208595-57e6-488a-927e-bb727028f563 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:46.962741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0208595-57e6-488a-927e-bb727028f563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:46.964244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0208595-57e6-488a-927e-bb727028f563 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:46.967883 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 113/239] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:46.979091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0208595-57e6-488a-927e-bb727028f563 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:46.990760 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:47.105534 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0208595-57e6-488a-927e-bb727028f563 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:47.146911 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74852fcf-996a-4a06-a1eb-530148a962dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:47.147790 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74852fcf-996a-4a06-a1eb-530148a962dd None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:47.148235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74852fcf-996a-4a06-a1eb-530148a962dd None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:47.148653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74852fcf-996a-4a06-a1eb-530148a962dd None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:47.149473 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74852fcf-996a-4a06-a1eb-530148a962dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:47.151147 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74852fcf-996a-4a06-a1eb-530148a962dd None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:47.171870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd024c-6038-4e66-9e5a-cc85ad08c74f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:47.186630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 114/240] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:48:46 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:47.234360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3340e9-822a-4cab-b56b-85c4da9ed7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:47.235049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3340e9-822a-4cab-b56b-85c4da9ed7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:47.235328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3340e9-822a-4cab-b56b-85c4da9ed7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:47.235595 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3340e9-822a-4cab-b56b-85c4da9ed7f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:47.254188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3340e9-822a-4cab-b56b-85c4da9ed7f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-8b3340e9-822a-4cab-b56b-85c4da9ed7f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:47.259309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:47.260312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:47.261279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:47.261279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:47.261279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:47.261279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:47.261279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:47.261279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:47.261279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:47.261279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:47.261279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:47.261279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:47.261279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:47.261279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:47.262400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 127/241] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:47.267172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74852fcf-996a-4a06-a1eb-530148a962dd None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:47.339711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:47.391833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74852fcf-996a-4a06-a1eb-530148a962dd None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:47.428779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5b0f4-114e-4fc5-9119-6668e70616cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:47.429391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5b0f4-114e-4fc5-9119-6668e70616cb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:47.429666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5b0f4-114e-4fc5-9119-6668e70616cb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:47.429928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5b0f4-114e-4fc5-9119-6668e70616cb None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:47.430625 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5b0f4-114e-4fc5-9119-6668e70616cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:47.430924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5b0f4-114e-4fc5-9119-6668e70616cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:47.432311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5b0f4-114e-4fc5-9119-6668e70616cb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:47.441293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 115/242] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:47.447379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3340e9-822a-4cab-b56b-85c4da9ed7f4 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:47.566888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3340e9-822a-4cab-b56b-85c4da9ed7f4 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:47.575189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:47.609467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ac8dd-03c8-4504-b7e0-7321e802206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:47.610115 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ac8dd-03c8-4504-b7e0-7321e802206c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:47.610394 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ac8dd-03c8-4504-b7e0-7321e802206c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:47.610713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ac8dd-03c8-4504-b7e0-7321e802206c None admin] PATH_INFO: `/v3/users/b57320523c1847f28de41d571b3773ee` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:47.625834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ac8dd-03c8-4504-b7e0-7321e802206c None admin] RBAC: Authorizing `identity:get_user(user_id=b57320523c1847f28de41d571b3773ee)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:47.627462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ac8dd-03c8-4504-b7e0-7321e802206c None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:47.629628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 128/243] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:47 2022] GET /identity/v3/users/b57320523c1847f28de41d571b3773ee => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:47.635026 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5b0f4-114e-4fc5-9119-6668e70616cb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:47.670289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b497c6-5bc8-4a15-935b-c64b311b1913 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:47.670764 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b497c6-5bc8-4a15-935b-c64b311b1913 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:47.671138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b497c6-5bc8-4a15-935b-c64b311b1913 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:47.672613 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 129/244] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:48:47.679941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e109d98-6ddb-440a-b888-7de8a843bf40 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:47.680513 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e109d98-6ddb-440a-b888-7de8a843bf40 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:47.680974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e109d98-6ddb-440a-b888-7de8a843bf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:47.709509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-0e109d98-6ddb-440a-b888-7de8a843bf40 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:47.711379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0e109d98-6ddb-440a-b888-7de8a843bf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:47.772012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5b0f4-114e-4fc5-9119-6668e70616cb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:47.791886 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:47.815740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708c551-fc05-4946-8ae5-3006f227d6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:47.815740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708c551-fc05-4946-8ae5-3006f227d6cf None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:47.815740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708c551-fc05-4946-8ae5-3006f227d6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:47.816195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708c551-fc05-4946-8ae5-3006f227d6cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:47.852742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 130/245] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:47.899555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708c551-fc05-4946-8ae5-3006f227d6cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:47.901168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708c551-fc05-4946-8ae5-3006f227d6cf None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:48.019362 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 116/246] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:48.026862 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e109d98-6ddb-440a-b888-7de8a843bf40 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:48.087040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c26025-083c-4e71-93c7-9bf95325e2a3 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:48.087330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c26025-083c-4e71-93c7-9bf95325e2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:48.087758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c26025-083c-4e71-93c7-9bf95325e2a3 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:48.089547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 117/247] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:48.097100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699797b-62c8-4d31-89e1-4dec906167c2 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:48.097419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699797b-62c8-4d31-89e1-4dec906167c2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:48.097793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699797b-62c8-4d31-89e1-4dec906167c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:48.125516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a699797b-62c8-4d31-89e1-4dec906167c2 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:48.125516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a699797b-62c8-4d31-89e1-4dec906167c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:48.137055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:48.206747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 118/248] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:48:48.246655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:48.254270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699797b-62c8-4d31-89e1-4dec906167c2 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:48.266124 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e109d98-6ddb-440a-b888-7de8a843bf40 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:48.391424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aff42-cecd-4a9c-9168-6a39b4b15892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:48.392601 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aff42-cecd-4a9c-9168-6a39b4b15892 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:48.393058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aff42-cecd-4a9c-9168-6a39b4b15892 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:48.393495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1aff42-cecd-4a9c-9168-6a39b4b15892 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:48.394985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1aff42-cecd-4a9c-9168-6a39b4b15892 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:48.396671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1aff42-cecd-4a9c-9168-6a39b4b15892 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:48.404033 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 131/249] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:48 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:48.418535 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aff42-cecd-4a9c-9168-6a39b4b15892 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:48.468735 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699797b-62c8-4d31-89e1-4dec906167c2 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:48.542420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17deb321-432a-4169-b084-c8c4c6c2ac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:48.543175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17deb321-432a-4169-b084-c8c4c6c2ac18 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:48.543450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17deb321-432a-4169-b084-c8c4c6c2ac18 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:48.543719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17deb321-432a-4169-b084-c8c4c6c2ac18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:48.571756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17deb321-432a-4169-b084-c8c4c6c2ac18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-17deb321-432a-4169-b084-c8c4c6c2ac18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:48.576942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:48.578024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:48.578859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:48.578859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:48.578859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:48.578859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:48.578859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:48.578859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:48.578859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:48.578859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:48.578859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:48.578859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:48.578859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:48.578859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:48.578859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 119/250] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:48:48.584898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17deb321-432a-4169-b084-c8c4c6c2ac18 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:48.602987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:48.681473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1aff42-cecd-4a9c-9168-6a39b4b15892 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:48.733067 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17deb321-432a-4169-b084-c8c4c6c2ac18 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:48.743798 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634e8c3-04c2-41ae-b8cb-857470540f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:48.744834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634e8c3-04c2-41ae-b8cb-857470540f68 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:48.745202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634e8c3-04c2-41ae-b8cb-857470540f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:48.745630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634e8c3-04c2-41ae-b8cb-857470540f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:48.746703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634e8c3-04c2-41ae-b8cb-857470540f68 None admin] RBAC: Adding query filter params (role.id=4d7a14112b4142d8a641585adf39cc07, scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b, user.id=b57320523c1847f28de41d571b3773ee) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:48.747203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634e8c3-04c2-41ae-b8cb-857470540f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:48.748899 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634e8c3-04c2-41ae-b8cb-857470540f68 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:48.762614 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 132/251] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:48 2022] GET /identity/v3/role_assignments?user.id=b57320523c1847f28de41d571b3773ee&scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b&role.id=4d7a14112b4142d8a641585adf39cc07 => generated 259 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:48.764047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634e8c3-04c2-41ae-b8cb-857470540f68 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:48.775040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5da81f-0251-4e97-a2de-f0bf403dca0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:48.775688 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da81f-0251-4e97-a2de-f0bf403dca0b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:48.775968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da81f-0251-4e97-a2de-f0bf403dca0b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:48.776239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da81f-0251-4e97-a2de-f0bf403dca0b None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:48.776943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5da81f-0251-4e97-a2de-f0bf403dca0b None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:48.777244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5da81f-0251-4e97-a2de-f0bf403dca0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:48.778760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5da81f-0251-4e97-a2de-f0bf403dca0b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:48.788882 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 120/252] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:48.795059 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5da81f-0251-4e97-a2de-f0bf403dca0b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:48.818239 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:48.887124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:48.922638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5da81f-0251-4e97-a2de-f0bf403dca0b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:48.964774 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e951f84-7b52-4bb0-ad7a-427297ec7fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:48.965523 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951f84-7b52-4bb0-ad7a-427297ec7fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:48.965838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951f84-7b52-4bb0-ad7a-427297ec7fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:48.966185 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951f84-7b52-4bb0-ad7a-427297ec7fd3 None admin] PATH_INFO: `/v3/users/f078e81c2cb442038e27013668590c10` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:48.967499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e951f84-7b52-4bb0-ad7a-427297ec7fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=f078e81c2cb442038e27013668590c10)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:48.969058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e951f84-7b52-4bb0-ad7a-427297ec7fd3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:48.974757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 121/253] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:48 2022] GET /identity/v3/users/f078e81c2cb442038e27013668590c10 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:48.977579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e951f84-7b52-4bb0-ad7a-427297ec7fd3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:49.008698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634e8c3-04c2-41ae-b8cb-857470540f68 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:49.047853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062de36c-0e55-449e-bea8-31b0b761d845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:49.048583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062de36c-0e55-449e-bea8-31b0b761d845 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:49.048850 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062de36c-0e55-449e-bea8-31b0b761d845 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:49.049122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062de36c-0e55-449e-bea8-31b0b761d845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:49.061048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062de36c-0e55-449e-bea8-31b0b761d845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-062de36c-0e55-449e-bea8-31b0b761d845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:49.066711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:49.068879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:49.071210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:49.071210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:49.071210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:49.071210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:49.071210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:49.071210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:49.071210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:49.071210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:49.071210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:49.071210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:49.071210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:48:49.071210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:49.071210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 133/254] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:48:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:49.071210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54179b9b-6302-4d2f-a473-fe05808331b9 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:49.072909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54179b9b-6302-4d2f-a473-fe05808331b9 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:49.072909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54179b9b-6302-4d2f-a473-fe05808331b9 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:49.077429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 134/255] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:49.078648 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54179b9b-6302-4d2f-a473-fe05808331b9 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:49.102132 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e951f84-7b52-4bb0-ad7a-427297ec7fd3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:49.145840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae5ec2-a0e1-4470-8151-1c4df477c761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:49.146414 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae5ec2-a0e1-4470-8151-1c4df477c761 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:49.146747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae5ec2-a0e1-4470-8151-1c4df477c761 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:49.147029 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae5ec2-a0e1-4470-8151-1c4df477c761 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:49.149438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae5ec2-a0e1-4470-8151-1c4df477c761 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:49.151002 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae5ec2-a0e1-4470-8151-1c4df477c761 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:49.158400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 122/256] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:48 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:49.160061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f56ed-35b3-47e8-993e-863bd2e344ce None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:49.160341 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f56ed-35b3-47e8-993e-863bd2e344ce None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:49.160614 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f56ed-35b3-47e8-993e-863bd2e344ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:49.179929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:49.182283 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-af9f56ed-35b3-47e8-993e-863bd2e344ce None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:49.183760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-af9f56ed-35b3-47e8-993e-863bd2e344ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:49.186690 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:49.206637 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54179b9b-6302-4d2f-a473-fe05808331b9 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:49.244741 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0165a-ae84-411e-af9c-9188f8db441b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:49.245377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0165a-ae84-411e-af9c-9188f8db441b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:49.245654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0165a-ae84-411e-af9c-9188f8db441b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:49.245924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0165a-ae84-411e-af9c-9188f8db441b None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:49.246621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0165a-ae84-411e-af9c-9188f8db441b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:49.246935 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0165a-ae84-411e-af9c-9188f8db441b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:49.248385 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0165a-ae84-411e-af9c-9188f8db441b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:49.258464 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 135/257] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:49.259160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0165a-ae84-411e-af9c-9188f8db441b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:49.268586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 123/258] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:49.272254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f56ed-35b3-47e8-993e-863bd2e344ce None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:49.390568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0165a-ae84-411e-af9c-9188f8db441b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:49.394789 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f56ed-35b3-47e8-993e-863bd2e344ce None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:49.429034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3387b61-3cc0-4ee9-bdb1-cfa529bf464a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:49.429728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387b61-3cc0-4ee9-bdb1-cfa529bf464a None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:49.430005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387b61-3cc0-4ee9-bdb1-cfa529bf464a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:49.430278 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3387b61-3cc0-4ee9-bdb1-cfa529bf464a None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b/users/f078e81c2cb442038e27013668590c10/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:49.437167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d39d-2bea-42dd-a7ac-d641caae8045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:49.438224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d39d-2bea-42dd-a7ac-d641caae8045 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:49.438811 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d39d-2bea-42dd-a7ac-d641caae8045 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:49.439319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d39d-2bea-42dd-a7ac-d641caae8045 None admin] PATH_INFO: `/v3/users/d87bda8d8cf54e6dad3732fb8f9b748f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:49.440330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3387b61-3cc0-4ee9-bdb1-cfa529bf464a None admin] RBAC: Authorizing `identity:create_grant(project_id=e27bb360e92e43f2bdebf830fd0ff33b, user_id=f078e81c2cb442038e27013668590c10, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:49.441134 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751d39d-2bea-42dd-a7ac-d641caae8045 None admin] RBAC: Authorizing `identity:get_user(user_id=d87bda8d8cf54e6dad3732fb8f9b748f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:49.441845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3387b61-3cc0-4ee9-bdb1-cfa529bf464a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:49.443087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751d39d-2bea-42dd-a7ac-d641caae8045 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:49.450618 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 124/259] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:49 2022] GET /identity/v3/users/d87bda8d8cf54e6dad3732fb8f9b748f => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:49.452624 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d39d-2bea-42dd-a7ac-d641caae8045 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:49.459009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:49.468007 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 136/260] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:48:49 2022] PUT /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b/users/f078e81c2cb442038e27013668590c10/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:48:49.594277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d39d-2bea-42dd-a7ac-d641caae8045 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:49.643703 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b05ac-dcd5-4a67-93f7-5d95835c9ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:49.644825 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b05ac-dcd5-4a67-93f7-5d95835c9ddb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:49.645375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b05ac-dcd5-4a67-93f7-5d95835c9ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:49.645902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b05ac-dcd5-4a67-93f7-5d95835c9ddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:49.734737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b05ac-dcd5-4a67-93f7-5d95835c9ddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:49.736891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b05ac-dcd5-4a67-93f7-5d95835c9ddb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:49.747208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:49.766157 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3387b61-3cc0-4ee9-bdb1-cfa529bf464a None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:49.797221 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:49.894191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 125/261] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:49.896487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b05ac-dcd5-4a67-93f7-5d95835c9ddb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:50.025414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3387b61-3cc0-4ee9-bdb1-cfa529bf464a None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:50.093099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b05ac-dcd5-4a67-93f7-5d95835c9ddb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:50.096385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:50.120137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6229b45-ae6a-4289-a7c0-a42ad55a02fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:50.121526 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6229b45-ae6a-4289-a7c0-a42ad55a02fa None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:50.122052 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6229b45-ae6a-4289-a7c0-a42ad55a02fa None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:50.122519 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6229b45-ae6a-4289-a7c0-a42ad55a02fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:50.155680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6229b45-ae6a-4289-a7c0-a42ad55a02fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:50.158963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5cafd-7af1-4a6a-8f44-31c070524910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:50.160058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5cafd-7af1-4a6a-8f44-31c070524910 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:50.160524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5cafd-7af1-4a6a-8f44-31c070524910 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:50.160993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5cafd-7af1-4a6a-8f44-31c070524910 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-e6229b45-ae6a-4289-a7c0-a42ad55a02fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:50.162101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:50.162995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:50.163792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:50.163792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:50.163792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:50.163792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:50.163792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:50.163792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:50.163792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:50.163792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:50.163792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:50.163792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:50.163792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:48:50.163792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:50.164410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5cafd-7af1-4a6a-8f44-31c070524910 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:50.164410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5cafd-7af1-4a6a-8f44-31c070524910 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:50.170826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 126/262] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:49 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:50.171416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 137/263] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:48:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:50.174641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5cafd-7af1-4a6a-8f44-31c070524910 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:50.176686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6229b45-ae6a-4289-a7c0-a42ad55a02fa None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:50.289246 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5cafd-7af1-4a6a-8f44-31c070524910 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:50.331259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aa326-1212-40fd-8220-d82d90e5df5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:50.331897 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aa326-1212-40fd-8220-d82d90e5df5c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:50.332358 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aa326-1212-40fd-8220-d82d90e5df5c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:50.332636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aa326-1212-40fd-8220-d82d90e5df5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:50.333411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aa326-1212-40fd-8220-d82d90e5df5c None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b, user.id=d87bda8d8cf54e6dad3732fb8f9b748f) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:50.333721 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aa326-1212-40fd-8220-d82d90e5df5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:50.335334 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aa326-1212-40fd-8220-d82d90e5df5c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:50.346163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 127/264] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:50 2022] GET /identity/v3/role_assignments?user.id=d87bda8d8cf54e6dad3732fb8f9b748f&scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:50.392525 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:50.456017 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6229b45-ae6a-4289-a7c0-a42ad55a02fa None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:50.498137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7aa84-e7c3-4953-8f9b-a06034f57106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:50.499380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7aa84-e7c3-4953-8f9b-a06034f57106 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:50.499882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7aa84-e7c3-4953-8f9b-a06034f57106 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:50.500377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7aa84-e7c3-4953-8f9b-a06034f57106 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:50.501380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7aa84-e7c3-4953-8f9b-a06034f57106 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:50.501918 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7aa84-e7c3-4953-8f9b-a06034f57106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:50.503703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7aa84-e7c3-4953-8f9b-a06034f57106 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:50.518434 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 138/265] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:48:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:50.524249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aa326-1212-40fd-8220-d82d90e5df5c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:50.588274 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:50.664934 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aa326-1212-40fd-8220-d82d90e5df5c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:50.709318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8aa8f-a54d-4260-9503-5fc573862235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:50.709992 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8aa8f-a54d-4260-9503-5fc573862235 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:50.710273 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8aa8f-a54d-4260-9503-5fc573862235 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:50.710548 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8aa8f-a54d-4260-9503-5fc573862235 None admin] PATH_INFO: `/v3/users/d87bda8d8cf54e6dad3732fb8f9b748f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:50.711873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8aa8f-a54d-4260-9503-5fc573862235 None admin] RBAC: Authorizing `identity:get_user(user_id=d87bda8d8cf54e6dad3732fb8f9b748f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:50.713374 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8aa8f-a54d-4260-9503-5fc573862235 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:50.715524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 128/266] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:50 2022] GET /identity/v3/users/d87bda8d8cf54e6dad3732fb8f9b748f => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:50.728062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7aa84-e7c3-4953-8f9b-a06034f57106 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:50.939378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7aa84-e7c3-4953-8f9b-a06034f57106 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:50.999236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:51.011439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef46db-62bf-4cbd-9387-9bac1d4b631f None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:51.011901 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef46db-62bf-4cbd-9387-9bac1d4b631f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:51.012183 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef46db-62bf-4cbd-9387-9bac1d4b631f None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:51.012555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b71c76-9153-49f5-a3fc-adf93d23761a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:51.013616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b71c76-9153-49f5-a3fc-adf93d23761a None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:51.014178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b71c76-9153-49f5-a3fc-adf93d23761a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:51.014717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b71c76-9153-49f5-a3fc-adf93d23761a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:51.016934 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 129/267] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:51.024177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648752b9-ce08-4444-b0a3-d51edca6dcf9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:51.024485 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648752b9-ce08-4444-b0a3-d51edca6dcf9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:51.024734 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648752b9-ce08-4444-b0a3-d51edca6dcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:51.060883 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-648752b9-ce08-4444-b0a3-d51edca6dcf9 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:51.062158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-648752b9-ce08-4444-b0a3-d51edca6dcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:51.133056 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b71c76-9153-49f5-a3fc-adf93d23761a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:51.135216 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b71c76-9153-49f5-a3fc-adf93d23761a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:51.178760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 130/268] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:51.180883 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168058fc-db59-4cb5-ad60-7c79f5836571 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:51.181394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168058fc-db59-4cb5-ad60-7c79f5836571 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:51.181846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168058fc-db59-4cb5-ad60-7c79f5836571 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:51.183535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 131/269] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:51.194703 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d9f6-2aa8-48f3-ae3c-01fd155880bc None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:51.194703 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d9f6-2aa8-48f3-ae3c-01fd155880bc None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:51.194703 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0d9f6-2aa8-48f3-ae3c-01fd155880bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:51.229123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d2e0d9f6-2aa8-48f3-ae3c-01fd155880bc None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:51.230473 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d2e0d9f6-2aa8-48f3-ae3c-01fd155880bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:51.295160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:51.345325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 139/270] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:51.354770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b71c76-9153-49f5-a3fc-adf93d23761a None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:51.384086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 132/271] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:51.418492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:51.519450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b71c76-9153-49f5-a3fc-adf93d23761a None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:51.557473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc293f72-c67c-4aff-bfae-4201a30437ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:51.558127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc293f72-c67c-4aff-bfae-4201a30437ee None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:51.558403 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc293f72-c67c-4aff-bfae-4201a30437ee None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:51.558714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc293f72-c67c-4aff-bfae-4201a30437ee None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:51.559940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc293f72-c67c-4aff-bfae-4201a30437ee None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:51.561453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc293f72-c67c-4aff-bfae-4201a30437ee None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:51.563727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 140/272] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:51 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:51.570561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0d9f6-2aa8-48f3-ae3c-01fd155880bc None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:51.699251 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc293f72-c67c-4aff-bfae-4201a30437ee None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:51.728742 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0d9f6-2aa8-48f3-ae3c-01fd155880bc None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:51.792039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223c8d2-fbdc-4baf-b21a-6a548bbc256f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:51.792589 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c8d2-fbdc-4baf-b21a-6a548bbc256f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:51.792865 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c8d2-fbdc-4baf-b21a-6a548bbc256f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:51.793134 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c8d2-fbdc-4baf-b21a-6a548bbc256f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:51.793881 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223c8d2-fbdc-4baf-b21a-6a548bbc256f None admin] RBAC: Adding query filter params (role.id=64aca4dbf153454d8abb3af690d90c76, scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b, user.id=d87bda8d8cf54e6dad3732fb8f9b748f) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:51.794187 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223c8d2-fbdc-4baf-b21a-6a548bbc256f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:51.795687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223c8d2-fbdc-4baf-b21a-6a548bbc256f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:51.802481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 133/273] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:51 2022] GET /identity/v3/role_assignments?user.id=d87bda8d8cf54e6dad3732fb8f9b748f&scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b&role.id=64aca4dbf153454d8abb3af690d90c76 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:51.803364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223c8d2-fbdc-4baf-b21a-6a548bbc256f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:51.828863 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc293f72-c67c-4aff-bfae-4201a30437ee None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:51.833712 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:51.853165 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:51.876164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a501bdb-08b0-4ed0-8f0a-94a62818fff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:51.876930 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a501bdb-08b0-4ed0-8f0a-94a62818fff2 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:51.877348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a501bdb-08b0-4ed0-8f0a-94a62818fff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:51.877634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a501bdb-08b0-4ed0-8f0a-94a62818fff2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:51.879522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a501bdb-08b0-4ed0-8f0a-94a62818fff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:51.881285 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a501bdb-08b0-4ed0-8f0a-94a62818fff2 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:51.883724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 141/274] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:51.885374 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5be53-0c90-45be-9fb6-42ea2c07b622 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:51.885661 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5be53-0c90-45be-9fb6-42ea2c07b622 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:51.886041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5be53-0c90-45be-9fb6-42ea2c07b622 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:51.892138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 142/275] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:51.893357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5be53-0c90-45be-9fb6-42ea2c07b622 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:51.943865 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223c8d2-fbdc-4baf-b21a-6a548bbc256f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:51.985117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19f622-38d6-4242-a0d5-8a58bb70a423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:51.986092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19f622-38d6-4242-a0d5-8a58bb70a423 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:51.986560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19f622-38d6-4242-a0d5-8a58bb70a423 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:51.987045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19f622-38d6-4242-a0d5-8a58bb70a423 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:52.000794 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19f622-38d6-4242-a0d5-8a58bb70a423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-2c19f622-38d6-4242-a0d5-8a58bb70a423 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:52.006518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:52.007653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:52.008650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:52.008650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:52.008650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:52.008650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:52.008650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:52.008650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:52.008650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:52.008650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:52.008650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:52.008650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:52.008650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:52.008650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:52.011508 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 134/276] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:52.017626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3d483-6eb5-4d93-9aaf-403554968570 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:52.018307 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3d483-6eb5-4d93-9aaf-403554968570 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:52.018805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3d483-6eb5-4d93-9aaf-403554968570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:52.026253 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5be53-0c90-45be-9fb6-42ea2c07b622 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:52.042447 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8cc3d483-6eb5-4d93-9aaf-403554968570 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:52.044544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8cc3d483-6eb5-4d93-9aaf-403554968570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:52.093083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a922cba-090c-4011-a4c7-a215c482d99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:52.094003 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a922cba-090c-4011-a4c7-a215c482d99b None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:52.094325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a922cba-090c-4011-a4c7-a215c482d99b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:52.094644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a922cba-090c-4011-a4c7-a215c482d99b None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:52.095337 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a922cba-090c-4011-a4c7-a215c482d99b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:52.096863 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a922cba-090c-4011-a4c7-a215c482d99b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:52.122466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 143/277] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:48:51 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:52.123355 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a922cba-090c-4011-a4c7-a215c482d99b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:52.155190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:52.164636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 135/278] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:52.285511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a922cba-090c-4011-a4c7-a215c482d99b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:52.347452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3ba9f-745c-469b-aef6-e78b18328b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:52.348104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3ba9f-745c-469b-aef6-e78b18328b8e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:52.348383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3ba9f-745c-469b-aef6-e78b18328b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:52.348656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3ba9f-745c-469b-aef6-e78b18328b8e None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:52.349342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3ba9f-745c-469b-aef6-e78b18328b8e None admin] RBAC: Adding query filter params (name=member) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:52.349643 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3ba9f-745c-469b-aef6-e78b18328b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:52.354498 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3ba9f-745c-469b-aef6-e78b18328b8e None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:52.360876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 144/279] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:52.367798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3d483-6eb5-4d93-9aaf-403554968570 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:52.391257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:52.458440 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3ba9f-745c-469b-aef6-e78b18328b8e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:52.496248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3d483-6eb5-4d93-9aaf-403554968570 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:52.534694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb65978-2908-496b-b545-a06bcc2440ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:52.535359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb65978-2908-496b-b545-a06bcc2440ff None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:52.535634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb65978-2908-496b-b545-a06bcc2440ff None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:52.535904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb65978-2908-496b-b545-a06bcc2440ff None admin] PATH_INFO: `/v3/users/a8137bd5f3a64dafa05eccc46f08b834` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:52.551446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb65978-2908-496b-b545-a06bcc2440ff None admin] RBAC: Authorizing `identity:get_user(user_id=a8137bd5f3a64dafa05eccc46f08b834)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:52.553009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb65978-2908-496b-b545-a06bcc2440ff None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:52.554796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 136/280] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:52 2022] GET /identity/v3/users/a8137bd5f3a64dafa05eccc46f08b834 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:52.556285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e406b84-2b13-4bf9-8a46-968062a46279 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:52.556566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e406b84-2b13-4bf9-8a46-968062a46279 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:52.556837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e406b84-2b13-4bf9-8a46-968062a46279 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:52.558295 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 137/281] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:52.567331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadbbb3-7a03-4d9a-a3fa-510c4d6cc094 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:52.567722 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadbbb3-7a03-4d9a-a3fa-510c4d6cc094 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:52.568001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadbbb3-7a03-4d9a-a3fa-510c4d6cc094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:52.590530 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1cadbbb3-7a03-4d9a-a3fa-510c4d6cc094 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:52.592067 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1cadbbb3-7a03-4d9a-a3fa-510c4d6cc094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:52.592195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:52.609958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3ba9f-745c-469b-aef6-e78b18328b8e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:52.654440 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc89b25-bbc7-451f-8234-25e3ef666ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:52.655541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc89b25-bbc7-451f-8234-25e3ef666ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:52.656010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc89b25-bbc7-451f-8234-25e3ef666ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:52.656520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc89b25-bbc7-451f-8234-25e3ef666ca9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:52.668314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc89b25-bbc7-451f-8234-25e3ef666ca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-1dc89b25-bbc7-451f-8234-25e3ef666ca9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:52.673998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:52.674941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:52.675725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:52.675725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:52.675725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:52.675725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:52.675725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:52.675725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:52.675725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:52.675725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:52.675725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:52.675725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:52.675725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:52.675725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:52.678267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 145/282] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:52.679293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc89b25-bbc7-451f-8234-25e3ef666ca9 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:52.682745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 138/283] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:52.684655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadbbb3-7a03-4d9a-a3fa-510c4d6cc094 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:52.689234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:52.808593 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc89b25-bbc7-451f-8234-25e3ef666ca9 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:52.814969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadbbb3-7a03-4d9a-a3fa-510c4d6cc094 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:52.863602 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b581e6-7b41-4a89-992d-3f0f317c957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:52.864139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b581e6-7b41-4a89-992d-3f0f317c957d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:52.864412 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b581e6-7b41-4a89-992d-3f0f317c957d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:52.864675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b581e6-7b41-4a89-992d-3f0f317c957d None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:52.865350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b581e6-7b41-4a89-992d-3f0f317c957d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:52.865645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b581e6-7b41-4a89-992d-3f0f317c957d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:52.867067 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b581e6-7b41-4a89-992d-3f0f317c957d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:52.873980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3202961-e5ad-46a3-b8d0-c9b41f7c960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:52.874622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3202961-e5ad-46a3-b8d0-c9b41f7c960e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:52.874993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3202961-e5ad-46a3-b8d0-c9b41f7c960e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:52.875348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3202961-e5ad-46a3-b8d0-c9b41f7c960e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:52.876088 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3202961-e5ad-46a3-b8d0-c9b41f7c960e None admin] RBAC: Adding query filter params (role.id=f866ebebacd841168b26ac7ec2c7461b, user.id=a8137bd5f3a64dafa05eccc46f08b834, scope.system=all) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:52.876397 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3202961-e5ad-46a3-b8d0-c9b41f7c960e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:52.877844 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3202961-e5ad-46a3-b8d0-c9b41f7c960e None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:52.884939 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 146/284] 10.222.0.77 () {56 vars in 1308 bytes} [Mon Aug 22 15:48:52 2022] GET /identity/v3/role_assignments?user.id=a8137bd5f3a64dafa05eccc46f08b834&scope.system=all&role.id=f866ebebacd841168b26ac7ec2c7461b => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:52.892660 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 139/285] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:52.898650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3202961-e5ad-46a3-b8d0-c9b41f7c960e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:52.921349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:53.036317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3202961-e5ad-46a3-b8d0-c9b41f7c960e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:53.069831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b581e6-7b41-4a89-992d-3f0f317c957d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:53.075583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff1475-b606-4eef-82f2-caafe5651c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:53.076494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff1475-b606-4eef-82f2-caafe5651c99 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:53.076970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff1475-b606-4eef-82f2-caafe5651c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:53.077457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff1475-b606-4eef-82f2-caafe5651c99 None admin] PATH_INFO: `/v3/users/b57320523c1847f28de41d571b3773ee` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:53.078954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff1475-b606-4eef-82f2-caafe5651c99 None admin] RBAC: Authorizing `identity:get_user(user_id=b57320523c1847f28de41d571b3773ee)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:53.080626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff1475-b606-4eef-82f2-caafe5651c99 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:53.082818 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 147/286] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:52 2022] GET /identity/v3/users/b57320523c1847f28de41d571b3773ee => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:53.089222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff1475-b606-4eef-82f2-caafe5651c99 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:53.172783 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:53.190855 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:53.216425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b581e6-7b41-4a89-992d-3f0f317c957d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:53.230053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff1475-b606-4eef-82f2-caafe5651c99 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:53.253857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7381ad-0256-4d56-b554-c7bf1bec54b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:53.254559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7381ad-0256-4d56-b554-c7bf1bec54b2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:53.254871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7381ad-0256-4d56-b554-c7bf1bec54b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:53.255143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7381ad-0256-4d56-b554-c7bf1bec54b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:53.266936 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7381ad-0256-4d56-b554-c7bf1bec54b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-fa7381ad-0256-4d56-b554-c7bf1bec54b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:53.272302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:53.273156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:53.273929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:53.273929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:53.273929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:53.273929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:53.273929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:53.273929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:53.273929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:53.273929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:53.273929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:53.273929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:53.273929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:53.273929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:53.273929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 140/287] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:48:53.280641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7381ad-0256-4d56-b554-c7bf1bec54b2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:53.315879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e4dca-1327-4c91-b508-7b4eaf62a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:53.316531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e4dca-1327-4c91-b508-7b4eaf62a995 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:53.316814 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e4dca-1327-4c91-b508-7b4eaf62a995 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:53.317092 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e4dca-1327-4c91-b508-7b4eaf62a995 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:53.323337 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e4dca-1327-4c91-b508-7b4eaf62a995 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:53.324835 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e4dca-1327-4c91-b508-7b4eaf62a995 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:53.326896 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 148/288] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:53 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:53.335535 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e4dca-1327-4c91-b508-7b4eaf62a995 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:53.401801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7381ad-0256-4d56-b554-c7bf1bec54b2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:53.442728 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:53.463101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8730b1a-a4e4-4ca8-9353-c4faef974d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:53.463733 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8730b1a-a4e4-4ca8-9353-c4faef974d19 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:53.464009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8730b1a-a4e4-4ca8-9353-c4faef974d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:53.464412 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8730b1a-a4e4-4ca8-9353-c4faef974d19 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:53.465098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8730b1a-a4e4-4ca8-9353-c4faef974d19 None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:53.465404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8730b1a-a4e4-4ca8-9353-c4faef974d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:53.466829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8730b1a-a4e4-4ca8-9353-c4faef974d19 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:53.486258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 141/289] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:53.492992 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8730b1a-a4e4-4ca8-9353-c4faef974d19 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:53.553788 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e4dca-1327-4c91-b508-7b4eaf62a995 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:53.631357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231d876-3efc-430b-8aee-3bbbec33f804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:53.632037 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231d876-3efc-430b-8aee-3bbbec33f804 None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:53.632316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231d876-3efc-430b-8aee-3bbbec33f804 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:53.632590 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231d876-3efc-430b-8aee-3bbbec33f804 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b/users/b57320523c1847f28de41d571b3773ee/roles/4d7a14112b4142d8a641585adf39cc07` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:53.638173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231d876-3efc-430b-8aee-3bbbec33f804 None admin] RBAC: Authorizing `identity:create_grant(project_id=e27bb360e92e43f2bdebf830fd0ff33b, user_id=b57320523c1847f28de41d571b3773ee, role_id=4d7a14112b4142d8a641585adf39cc07)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:53.645740 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231d876-3efc-430b-8aee-3bbbec33f804 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:53.670758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 149/290] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:48:53 2022] PUT /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b/users/b57320523c1847f28de41d571b3773ee/roles/4d7a14112b4142d8a641585adf39cc07 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:48:53.680679 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8730b1a-a4e4-4ca8-9353-c4faef974d19 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:53.727225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f554e70-1184-47c2-ba14-5084954ad9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:53.727875 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f554e70-1184-47c2-ba14-5084954ad9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:53.728146 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f554e70-1184-47c2-ba14-5084954ad9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:53.728421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f554e70-1184-47c2-ba14-5084954ad9a1 None admin] PATH_INFO: `/v3/users/f078e81c2cb442038e27013668590c10` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:53.731092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f554e70-1184-47c2-ba14-5084954ad9a1 None admin] RBAC: Authorizing `identity:get_user(user_id=f078e81c2cb442038e27013668590c10)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:53.735699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f554e70-1184-47c2-ba14-5084954ad9a1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:53.737626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 142/291] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:53 2022] GET /identity/v3/users/f078e81c2cb442038e27013668590c10 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:53.744127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231d876-3efc-430b-8aee-3bbbec33f804 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:53.754150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:53.874876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231d876-3efc-430b-8aee-3bbbec33f804 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:53.913695 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bafd8-6bc3-4458-b24f-e2eeb89217ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:53.914430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bafd8-6bc3-4458-b24f-e2eeb89217ad None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:53.914737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bafd8-6bc3-4458-b24f-e2eeb89217ad None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:53.915006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bafd8-6bc3-4458-b24f-e2eeb89217ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:53.994811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bafd8-6bc3-4458-b24f-e2eeb89217ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:53.996192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bafd8-6bc3-4458-b24f-e2eeb89217ad None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:53.999116 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:54.122721 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 150/292] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:54.128679 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f554e70-1184-47c2-ba14-5084954ad9a1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:54.230199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:54.302027 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f554e70-1184-47c2-ba14-5084954ad9a1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:54.357421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567514e-14d0-47de-8875-71c98e068dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:54.358463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567514e-14d0-47de-8875-71c98e068dfb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:54.358968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567514e-14d0-47de-8875-71c98e068dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:54.359568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567514e-14d0-47de-8875-71c98e068dfb None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:54.363609 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567514e-14d0-47de-8875-71c98e068dfb None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:54.365270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567514e-14d0-47de-8875-71c98e068dfb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:54.367265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 143/293] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:54 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:54.373479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bafd8-6bc3-4458-b24f-e2eeb89217ad None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:54.494537 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bafd8-6bc3-4458-b24f-e2eeb89217ad None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:54.496968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:54.538483 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae83f3-8514-4438-84e4-f064e0c23347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:54.539503 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae83f3-8514-4438-84e4-f064e0c23347 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:54.539969 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae83f3-8514-4438-84e4-f064e0c23347 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:54.540424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae83f3-8514-4438-84e4-f064e0c23347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:54.541765 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae83f3-8514-4438-84e4-f064e0c23347 None admin] RBAC: Adding query filter params (role.id=f866ebebacd841168b26ac7ec2c7461b, scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b, user.id=f078e81c2cb442038e27013668590c10) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:54.542242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae83f3-8514-4438-84e4-f064e0c23347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:54.544528 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae83f3-8514-4438-84e4-f064e0c23347 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:54.551602 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 151/294] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:54 2022] GET /identity/v3/role_assignments?user.id=f078e81c2cb442038e27013668590c10&scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b&role.id=f866ebebacd841168b26ac7ec2c7461b => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:54.822187 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bcf34-a5e3-40c1-8d5e-bc2fce52a8d3 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:54.823233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bcf34-a5e3-40c1-8d5e-bc2fce52a8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:54.823699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bcf34-a5e3-40c1-8d5e-bc2fce52a8d3 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:54.824211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12dfca-5ea7-4caf-b6ba-ad93a9f63c87 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:54.824499 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12dfca-5ea7-4caf-b6ba-ad93a9f63c87 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:54.824775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12dfca-5ea7-4caf-b6ba-ad93a9f63c87 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:54.826138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 144/295] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:54.827173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 152/296] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:48:54.831678 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191123-b0c2-43e1-b857-e10813d5c2be None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:54.831963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191123-b0c2-43e1-b857-e10813d5c2be None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:54.832242 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82191123-b0c2-43e1-b857-e10813d5c2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:54.834232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e86b5-402f-46eb-a053-352ed24b524a None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:54.834521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e86b5-402f-46eb-a053-352ed24b524a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:54.834831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e86b5-402f-46eb-a053-352ed24b524a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:54.852913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-82191123-b0c2-43e1-b857-e10813d5c2be None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:54.854217 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-82191123-b0c2-43e1-b857-e10813d5c2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:54.860544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-262e86b5-402f-46eb-a053-352ed24b524a None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:54.861797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-262e86b5-402f-46eb-a053-352ed24b524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:54.941016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 145/297] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:48:54.965604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 153/298] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:55.239234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82191123-b0c2-43e1-b857-e10813d5c2be None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:55.254665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e86b5-402f-46eb-a053-352ed24b524a None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:55.302806 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:55.354774 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82191123-b0c2-43e1-b857-e10813d5c2be None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:55.366994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:55.371120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e86b5-402f-46eb-a053-352ed24b524a None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:55.395975 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c91d2-3f0e-453e-89f9-9fdca7222524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:55.396928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c91d2-3f0e-453e-89f9-9fdca7222524 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:55.397225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c91d2-3f0e-453e-89f9-9fdca7222524 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:55.397516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c91d2-3f0e-453e-89f9-9fdca7222524 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:55.408479 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c91d2-3f0e-453e-89f9-9fdca7222524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:55.410213 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2a853-1c9f-4c14-846b-ad009c4562cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:55.410887 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2a853-1c9f-4c14-846b-ad009c4562cf None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:55.411163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2a853-1c9f-4c14-846b-ad009c4562cf None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:55.411432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2a853-1c9f-4c14-846b-ad009c4562cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:55.412535 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2a853-1c9f-4c14-846b-ad009c4562cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-5d3c91d2-3f0e-453e-89f9-9fdca7222524 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:55.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:55.414296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:55.415128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:55.415128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:55.415128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:55.415128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:55.415128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:55.415128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:55.415128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:55.415128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:55.415128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:55.415128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:55.415128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:55.415128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:55.420536 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2a853-1c9f-4c14-846b-ad009c4562cf None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:55.420536 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 154/299] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:55.420536 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e927782-6b5c-4368-89a8-9cf41b0e8674 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:55.420536 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e927782-6b5c-4368-89a8-9cf41b0e8674 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:55.420536 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e927782-6b5c-4368-89a8-9cf41b0e8674 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:55.420894 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 146/300] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:55.421113 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c91d2-3f0e-453e-89f9-9fdca7222524 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:55.423105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 155/301] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:55.423858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e927782-6b5c-4368-89a8-9cf41b0e8674 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:55.532573 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e927782-6b5c-4368-89a8-9cf41b0e8674 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:55.536347 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c91d2-3f0e-453e-89f9-9fdca7222524 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:55.557207 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:55.571951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c091cd-ca6f-48d1-8656-c71a5e33c06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:55.572938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c091cd-ca6f-48d1-8656-c71a5e33c06d None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:55.573447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c091cd-ca6f-48d1-8656-c71a5e33c06d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:55.573726 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c091cd-ca6f-48d1-8656-c71a5e33c06d None admin] PATH_INFO: `/v3/groups` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:55.574439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c091cd-ca6f-48d1-8656-c71a5e33c06d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:55.575951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c091cd-ca6f-48d1-8656-c71a5e33c06d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:55.584117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d8efa-25bc-4d66-a4cc-182f7cf78b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:55.584667 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d8efa-25bc-4d66-a4cc-182f7cf78b77 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:55.584985 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d8efa-25bc-4d66-a4cc-182f7cf78b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:55.585313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d8efa-25bc-4d66-a4cc-182f7cf78b77 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:55.586009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d8efa-25bc-4d66-a4cc-182f7cf78b77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:55.586340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d8efa-25bc-4d66-a4cc-182f7cf78b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:55.587926 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d8efa-25bc-4d66-a4cc-182f7cf78b77 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:55.595608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 156/302] 10.222.0.77 () {60 vars in 1134 bytes} [Mon Aug 22 15:48:55 2022] POST /identity/v3/groups => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:55.596884 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9beca-362a-4ca5-88d2-824c71350c4b None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:55.597173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9beca-362a-4ca5-88d2-824c71350c4b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:55.597697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9beca-362a-4ca5-88d2-824c71350c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:55.608814 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 147/303] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:55.614618 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d8efa-25bc-4d66-a4cc-182f7cf78b77 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:55.624629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-0ee9beca-362a-4ca5-88d2-824c71350c4b None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:55.626479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0ee9beca-362a-4ca5-88d2-824c71350c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:55.659633 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:55.733087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 157/304] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:55.746810 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d8efa-25bc-4d66-a4cc-182f7cf78b77 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:55.785027 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59143f-3eb3-49ee-8b7d-466286f2cb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:55.785658 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59143f-3eb3-49ee-8b7d-466286f2cb50 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:55.785864 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59143f-3eb3-49ee-8b7d-466286f2cb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:55.786143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59143f-3eb3-49ee-8b7d-466286f2cb50 None admin] PATH_INFO: `/v3/users/81931cf5cc8a4aa296f8368ea78a18a9` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:55.801343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59143f-3eb3-49ee-8b7d-466286f2cb50 None admin] RBAC: Authorizing `identity:get_user(user_id=81931cf5cc8a4aa296f8368ea78a18a9)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:55.802853 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59143f-3eb3-49ee-8b7d-466286f2cb50 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:55.806680 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 148/305] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:55 2022] GET /identity/v3/users/81931cf5cc8a4aa296f8368ea78a18a9 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:55.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9beca-362a-4ca5-88d2-824c71350c4b None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:55.923715 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9beca-362a-4ca5-88d2-824c71350c4b None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:55.950017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb2bd9-4a5f-4347-971a-9676d5e86256 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:55.950842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb2bd9-4a5f-4347-971a-9676d5e86256 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:55.950842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb2bd9-4a5f-4347-971a-9676d5e86256 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:55.952199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 149/306] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:55.961345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33d549-f349-4feb-ac9c-cf144e394cc2 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:55.962111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33d549-f349-4feb-ac9c-cf144e394cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:55.962514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33d549-f349-4feb-ac9c-cf144e394cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:55.975739 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8995cf2-8df8-480d-b18e-2c2ceb4701da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:55.976867 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8995cf2-8df8-480d-b18e-2c2ceb4701da None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:55.977630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8995cf2-8df8-480d-b18e-2c2ceb4701da None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:55.977949 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8995cf2-8df8-480d-b18e-2c2ceb4701da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:55.978843 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8995cf2-8df8-480d-b18e-2c2ceb4701da None admin] RBAC: Adding query filter params (role.id=4d7a14112b4142d8a641585adf39cc07, user.id=81931cf5cc8a4aa296f8368ea78a18a9, scope.system=all) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:55.979296 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8995cf2-8df8-480d-b18e-2c2ceb4701da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:55.981121 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8995cf2-8df8-480d-b18e-2c2ceb4701da None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:55.985719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8f33d549-f349-4feb-ac9c-cf144e394cc2 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:55.987581 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8f33d549-f349-4feb-ac9c-cf144e394cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:55.988175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 158/307] 10.222.0.77 () {56 vars in 1308 bytes} [Mon Aug 22 15:48:55 2022] GET /identity/v3/role_assignments?user.id=81931cf5cc8a4aa296f8368ea78a18a9&scope.system=all&role.id=4d7a14112b4142d8a641585adf39cc07 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:56.025513 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8995cf2-8df8-480d-b18e-2c2ceb4701da None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:56.028303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:56.053789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:56.106824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 150/308] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:56.159565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8995cf2-8df8-480d-b18e-2c2ceb4701da None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:56.198568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5732beb-9ed4-414b-b3a6-cac0046c075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:56.199316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5732beb-9ed4-414b-b3a6-cac0046c075c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:56.199600 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5732beb-9ed4-414b-b3a6-cac0046c075c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:56.199874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5732beb-9ed4-414b-b3a6-cac0046c075c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:56.211706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5732beb-9ed4-414b-b3a6-cac0046c075c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-e5732beb-9ed4-414b-b3a6-cac0046c075c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:56.217283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:56.218421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:56.219430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:56.219430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:56.219430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:56.219430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:56.219430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:56.219430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:56.219430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:56.219430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:56.219430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:56.219430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:56.219430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:56.219430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:56.219430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 159/309] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:48:56.226535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33d549-f349-4feb-ac9c-cf144e394cc2 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:56.336087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33d549-f349-4feb-ac9c-cf144e394cc2 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:56.372933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526269a-67b4-4134-9d54-a57a1bfee88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:56.373555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526269a-67b4-4134-9d54-a57a1bfee88a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:56.373831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526269a-67b4-4134-9d54-a57a1bfee88a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:56.374101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526269a-67b4-4134-9d54-a57a1bfee88a None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:56.374905 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526269a-67b4-4134-9d54-a57a1bfee88a None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:56.375208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526269a-67b4-4134-9d54-a57a1bfee88a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:56.376595 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526269a-67b4-4134-9d54-a57a1bfee88a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:56.386351 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 151/310] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:56.392215 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5732beb-9ed4-414b-b3a6-cac0046c075c None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:56.399731 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526269a-67b4-4134-9d54-a57a1bfee88a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:56.446448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:56.489780 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:56.514089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5732beb-9ed4-414b-b3a6-cac0046c075c None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:56.547215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526269a-67b4-4134-9d54-a57a1bfee88a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:56.556711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbacb8-1dbb-413b-ada1-b0b588e090cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:56.557583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbacb8-1dbb-413b-ada1-b0b588e090cb None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:56.557995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbacb8-1dbb-413b-ada1-b0b588e090cb None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:56.558402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbacb8-1dbb-413b-ada1-b0b588e090cb None admin] PATH_INFO: `/v3/users/a8137bd5f3a64dafa05eccc46f08b834` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:56.559800 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbacb8-1dbb-413b-ada1-b0b588e090cb None admin] RBAC: Authorizing `identity:get_user(user_id=a8137bd5f3a64dafa05eccc46f08b834)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:56.561393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbacb8-1dbb-413b-ada1-b0b588e090cb None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:56.563212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 160/311] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:56 2022] GET /identity/v3/users/a8137bd5f3a64dafa05eccc46f08b834 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:56.569214 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbacb8-1dbb-413b-ada1-b0b588e090cb None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:56.590019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbc293-dbda-4fc4-9b3c-bb23d3e85829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:56.590737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbc293-dbda-4fc4-9b3c-bb23d3e85829 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:56.591079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbc293-dbda-4fc4-9b3c-bb23d3e85829 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:56.591412 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbc293-dbda-4fc4-9b3c-bb23d3e85829 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:56.605736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbc293-dbda-4fc4-9b3c-bb23d3e85829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-3acbc293-dbda-4fc4-9b3c-bb23d3e85829 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:56.612240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:56.613128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:56.613922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:56.613922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:56.613922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:56.613922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:56.613922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:56.613922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:56.613922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:56.613922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:56.613922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:56.613922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:56.613922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:56.613922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:56.618681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 152/312] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:56.622484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbc293-dbda-4fc4-9b3c-bb23d3e85829 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:56.686157 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbacb8-1dbb-413b-ada1-b0b588e090cb None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:56.715142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:56.726636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf10f0a-ae80-4bf3-af9f-1d1ce14bf004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:56.727811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf10f0a-ae80-4bf3-af9f-1d1ce14bf004 None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:56.728378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf10f0a-ae80-4bf3-af9f-1d1ce14bf004 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:56.728833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf10f0a-ae80-4bf3-af9f-1d1ce14bf004 None admin] PATH_INFO: `/v3/system/users/a8137bd5f3a64dafa05eccc46f08b834/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:56.730434 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf10f0a-ae80-4bf3-af9f-1d1ce14bf004 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a8137bd5f3a64dafa05eccc46f08b834, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:56.731245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbc293-dbda-4fc4-9b3c-bb23d3e85829 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:56.732268 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf10f0a-ae80-4bf3-af9f-1d1ce14bf004 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:56.743050 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 161/313] 10.222.0.77 () {58 vars in 1334 bytes} [Mon Aug 22 15:48:56 2022] PUT /identity/v3/system/users/a8137bd5f3a64dafa05eccc46f08b834/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:48:56.783899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00613df9-0e58-4fc5-85a2-f3f144366fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:56.785141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00613df9-0e58-4fc5-85a2-f3f144366fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:56.785695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00613df9-0e58-4fc5-85a2-f3f144366fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:56.786220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00613df9-0e58-4fc5-85a2-f3f144366fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:56.787170 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00613df9-0e58-4fc5-85a2-f3f144366fb4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:56.787699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00613df9-0e58-4fc5-85a2-f3f144366fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:56.789349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00613df9-0e58-4fc5-85a2-f3f144366fb4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:56.800379 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 153/314] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:56.806673 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf10f0a-ae80-4bf3-af9f-1d1ce14bf004 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:56.825691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:56.920534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf10f0a-ae80-4bf3-af9f-1d1ce14bf004 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:56.954906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d736d2-c82b-4215-9bad-d28accd6b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:56.955540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d736d2-c82b-4215-9bad-d28accd6b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:56.955811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d736d2-c82b-4215-9bad-d28accd6b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:56.956079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d736d2-c82b-4215-9bad-d28accd6b7f9 None admin] PATH_INFO: `/v3/users/b57320523c1847f28de41d571b3773ee` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:56.957274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d736d2-c82b-4215-9bad-d28accd6b7f9 None admin] RBAC: Authorizing `identity:get_user(user_id=b57320523c1847f28de41d571b3773ee)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:56.958740 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d736d2-c82b-4215-9bad-d28accd6b7f9 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:56.960331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 162/315] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:56 2022] GET /identity/v3/users/b57320523c1847f28de41d571b3773ee => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:56.966049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00613df9-0e58-4fc5-85a2-f3f144366fb4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:57.072876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00613df9-0e58-4fc5-85a2-f3f144366fb4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:57.110235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f024f-6622-421b-ae79-03f2871073d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:57.110893 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f024f-6622-421b-ae79-03f2871073d6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:57.111169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f024f-6622-421b-ae79-03f2871073d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:57.111440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f024f-6622-421b-ae79-03f2871073d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:57.131720 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:57.199461 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f024f-6622-421b-ae79-03f2871073d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:57.200844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f024f-6622-421b-ae79-03f2871073d6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:57.329349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 154/316] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:48:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:48:57.335139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d736d2-c82b-4215-9bad-d28accd6b7f9 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:57.421103 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:57.451339 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d736d2-c82b-4215-9bad-d28accd6b7f9 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:57.490428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91990ae-9a6a-440a-80a2-1a722235fb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:57.492087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91990ae-9a6a-440a-80a2-1a722235fb79 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:57.492564 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91990ae-9a6a-440a-80a2-1a722235fb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:57.493030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91990ae-9a6a-440a-80a2-1a722235fb79 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:57.494536 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91990ae-9a6a-440a-80a2-1a722235fb79 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:57.496301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91990ae-9a6a-440a-80a2-1a722235fb79 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:57.498585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 163/317] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:48:57 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:57.510670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f024f-6622-421b-ae79-03f2871073d6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:57.558282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:57.613285 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9971c9f-fd09-4df6-91f1-96793990e721 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:57.613677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9971c9f-fd09-4df6-91f1-96793990e721 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:57.613957 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9971c9f-fd09-4df6-91f1-96793990e721 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:57.615982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 164/318] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:48:57.624439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e2e4-54e1-4e34-9d83-a31524da4382 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:57.625383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e2e4-54e1-4e34-9d83-a31524da4382 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:57.626125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e2e4-54e1-4e34-9d83-a31524da4382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:57.641507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f024f-6622-421b-ae79-03f2871073d6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:57.655977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-6a19e2e4-54e1-4e34-9d83-a31524da4382 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:57.657739 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-6a19e2e4-54e1-4e34-9d83-a31524da4382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:57.691372 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a527f-db86-4768-b2b2-87dd97865ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:57.692076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a527f-db86-4768-b2b2-87dd97865ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:57.692353 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a527f-db86-4768-b2b2-87dd97865ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:57.692626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a527f-db86-4768-b2b2-87dd97865ef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:57.693398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a527f-db86-4768-b2b2-87dd97865ef2 None admin] RBAC: Adding query filter params (role.id=4d7a14112b4142d8a641585adf39cc07, scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b, user.id=b57320523c1847f28de41d571b3773ee) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:57.694038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a527f-db86-4768-b2b2-87dd97865ef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:57.695698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a527f-db86-4768-b2b2-87dd97865ef2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:57.704861 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 155/319] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:48:57 2022] GET /identity/v3/role_assignments?user.id=b57320523c1847f28de41d571b3773ee&scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b&role.id=4d7a14112b4142d8a641585adf39cc07 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:57.802814 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 165/320] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:48:58.050711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940735f5-c88c-4bb2-bbd4-9ddd8d5df6df None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:58.051203 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940735f5-c88c-4bb2-bbd4-9ddd8d5df6df None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:58.051203 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940735f5-c88c-4bb2-bbd4-9ddd8d5df6df None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:58.052833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 156/321] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:48:58.058068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c75e7a-06b5-4871-9210-a32d91d7cda4 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:58.058355 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c75e7a-06b5-4871-9210-a32d91d7cda4 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:58.058630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c75e7a-06b5-4871-9210-a32d91d7cda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:58.080161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-52c75e7a-06b5-4871-9210-a32d91d7cda4 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:58.081349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-52c75e7a-06b5-4871-9210-a32d91d7cda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:58.160480 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 166/322] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:48:58.179387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940735f5-c88c-4bb2-bbd4-9ddd8d5df6df None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:58.288413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940735f5-c88c-4bb2-bbd4-9ddd8d5df6df None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:58.309086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:58.336721 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763eaf3-9015-4b2a-9917-f3f353fa9c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:58.337388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763eaf3-9015-4b2a-9917-f3f353fa9c2c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:58.337669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763eaf3-9015-4b2a-9917-f3f353fa9c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:58.337941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763eaf3-9015-4b2a-9917-f3f353fa9c2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:58.339151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763eaf3-9015-4b2a-9917-f3f353fa9c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:58.340625 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763eaf3-9015-4b2a-9917-f3f353fa9c2c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:58.342482 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 157/323] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:48:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:58.348054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c75e7a-06b5-4871-9210-a32d91d7cda4 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:58.359752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:58.425917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763eaf3-9015-4b2a-9917-f3f353fa9c2c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:58.468863 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c75e7a-06b5-4871-9210-a32d91d7cda4 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:58.505786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efeb468-7ba0-419b-a827-cc01e56a2561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:58.506492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeb468-7ba0-419b-a827-cc01e56a2561 None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:58.506710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeb468-7ba0-419b-a827-cc01e56a2561 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:58.506978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeb468-7ba0-419b-a827-cc01e56a2561 None admin] PATH_INFO: `/v3/groups` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:58.507622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efeb468-7ba0-419b-a827-cc01e56a2561 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:58.509062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efeb468-7ba0-419b-a827-cc01e56a2561 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:58.526001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 167/324] 10.222.0.77 () {60 vars in 1134 bytes} [Mon Aug 22 15:48:58 2022] POST /identity/v3/groups => generated 226 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:48:58.566269 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763eaf3-9015-4b2a-9917-f3f353fa9c2c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:58.606553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f39ad-692a-48cc-8a3c-283c19f26877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:58.607248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f39ad-692a-48cc-8a3c-283c19f26877 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:58.607525 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f39ad-692a-48cc-8a3c-283c19f26877 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:58.607794 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f39ad-692a-48cc-8a3c-283c19f26877 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:58.620741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f39ad-692a-48cc-8a3c-283c19f26877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-621f39ad-692a-48cc-8a3c-283c19f26877 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:58.626979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:58.627922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:58.632239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:58.632239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:58.632239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:58.632239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:58.632239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:58.632239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:58.632239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:58.632239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:58.632239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:58.632239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:58.632239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:48:58.632239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:48:58.632239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 158/325] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:48:58.634733 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efeb468-7ba0-419b-a827-cc01e56a2561 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:58.725054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:58.765343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efeb468-7ba0-419b-a827-cc01e56a2561 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:58.770283 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c3052-045e-47a9-9dc3-8407b6c9ddaf None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:58.770559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c3052-045e-47a9-9dc3-8407b6c9ddaf None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:58.770883 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c3052-045e-47a9-9dc3-8407b6c9ddaf None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:58.772256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 159/326] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:48:58.777992 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bb3b6-7102-43fe-a655-a9d38ffef7e8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:58.778268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bb3b6-7102-43fe-a655-a9d38ffef7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:58.778570 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bb3b6-7102-43fe-a655-a9d38ffef7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:58.806464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-ea4bb3b6-7102-43fe-a655-a9d38ffef7e8 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:48:58.808495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ea4bb3b6-7102-43fe-a655-a9d38ffef7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:48:58.810146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a329a7b-35c6-4606-8ed6-1545926fd729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:58.810945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a329a7b-35c6-4606-8ed6-1545926fd729 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:58.811232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a329a7b-35c6-4606-8ed6-1545926fd729 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:58.811533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a329a7b-35c6-4606-8ed6-1545926fd729 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:58.812228 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a329a7b-35c6-4606-8ed6-1545926fd729 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:58.812530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a329a7b-35c6-4606-8ed6-1545926fd729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:58.813945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a329a7b-35c6-4606-8ed6-1545926fd729 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:58.825523 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 168/327] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:58.830909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a329a7b-35c6-4606-8ed6-1545926fd729 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:58.861786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:58.905613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 160/328] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:48:58.945335 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a329a7b-35c6-4606-8ed6-1545926fd729 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:58.978166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:58.984624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9d567-4a7c-4613-a01c-de5c58a17555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:58.985282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9d567-4a7c-4613-a01c-de5c58a17555 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:58.985560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9d567-4a7c-4613-a01c-de5c58a17555 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:58.985827 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9d567-4a7c-4613-a01c-de5c58a17555 None admin] PATH_INFO: `/v3/users/81931cf5cc8a4aa296f8368ea78a18a9` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:58.987094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9d567-4a7c-4613-a01c-de5c58a17555 None admin] RBAC: Authorizing `identity:get_user(user_id=81931cf5cc8a4aa296f8368ea78a18a9)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:58.988696 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9d567-4a7c-4613-a01c-de5c58a17555 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:58.991488 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 169/329] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:58 2022] GET /identity/v3/users/81931cf5cc8a4aa296f8368ea78a18a9 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:58.998060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bb3b6-7102-43fe-a655-a9d38ffef7e8 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:59.174736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bb3b6-7102-43fe-a655-a9d38ffef7e8 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:59.205819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9d567-4a7c-4613-a01c-de5c58a17555 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:59.219237 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf84751-e4f1-4574-8c63-d7a5f2d04f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:59.220322 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf84751-e4f1-4574-8c63-d7a5f2d04f2d None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:59.220794 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf84751-e4f1-4574-8c63-d7a5f2d04f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:59.221846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf84751-e4f1-4574-8c63-d7a5f2d04f2d None admin] PATH_INFO: `/v3/system/users/81931cf5cc8a4aa296f8368ea78a18a9/roles/4d7a14112b4142d8a641585adf39cc07` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:59.223595 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf84751-e4f1-4574-8c63-d7a5f2d04f2d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=81931cf5cc8a4aa296f8368ea78a18a9, role_id=4d7a14112b4142d8a641585adf39cc07)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:59.225191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf84751-e4f1-4574-8c63-d7a5f2d04f2d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:59.247293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 161/330] 10.222.0.77 () {58 vars in 1334 bytes} [Mon Aug 22 15:48:58 2022] PUT /identity/v3/system/users/81931cf5cc8a4aa296f8368ea78a18a9/roles/4d7a14112b4142d8a641585adf39cc07 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:48:59.346119 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9d567-4a7c-4613-a01c-de5c58a17555 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:59.391291 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f0a46-aff2-48b8-98d7-3f9fb9af2272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:59.391941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f0a46-aff2-48b8-98d7-3f9fb9af2272 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:59.392219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f0a46-aff2-48b8-98d7-3f9fb9af2272 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:59.392491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f0a46-aff2-48b8-98d7-3f9fb9af2272 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:59.407260 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f0a46-aff2-48b8-98d7-3f9fb9af2272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-734f0a46-aff2-48b8-98d7-3f9fb9af2272 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:48:59.413181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:48:59.414149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:48:59.414952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:48:59.414952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:48:59.414952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:48:59.414952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:48:59.414952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:48:59.414952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:48:59.414952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:48:59.414952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:48:59.414952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:48:59.414952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:48:59.414952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:48:59.414952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:48:59.416700 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 170/331] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:48:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:48:59.423085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf84751-e4f1-4574-8c63-d7a5f2d04f2d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:59.475046 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:59.590931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf84751-e4f1-4574-8c63-d7a5f2d04f2d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:59.642724 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a2fc5-279f-4912-b30b-c30019e971ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:59.643790 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a2fc5-279f-4912-b30b-c30019e971ca None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:59.644257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a2fc5-279f-4912-b30b-c30019e971ca None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:59.644712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a2fc5-279f-4912-b30b-c30019e971ca None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:59.645589 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a2fc5-279f-4912-b30b-c30019e971ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:48:59.646111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a2fc5-279f-4912-b30b-c30019e971ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:59.647916 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a2fc5-279f-4912-b30b-c30019e971ca None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:59.662748 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 162/332] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:48:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:48:59.664773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f0a46-aff2-48b8-98d7-3f9fb9af2272 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:48:59.734806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:48:59.785393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f0a46-aff2-48b8-98d7-3f9fb9af2272 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:48:59.832177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a2ee3-8bd9-4598-923d-b084c3a32f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:48:59.833232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2ee3-8bd9-4598-923d-b084c3a32f19 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:48:59.833702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2ee3-8bd9-4598-923d-b084c3a32f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:48:59.834193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2ee3-8bd9-4598-923d-b084c3a32f19 None admin] PATH_INFO: `/v3/users/a8137bd5f3a64dafa05eccc46f08b834` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:48:59.836602 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a2ee3-8bd9-4598-923d-b084c3a32f19 None admin] RBAC: Authorizing `identity:get_user(user_id=a8137bd5f3a64dafa05eccc46f08b834)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:48:59.847776 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a2ee3-8bd9-4598-923d-b084c3a32f19 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:48:59.850852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 171/333] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:48:59 2022] GET /identity/v3/users/a8137bd5f3a64dafa05eccc46f08b834 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:48:59.857762 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a2fc5-279f-4912-b30b-c30019e971ca None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:00.001986 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:00.008583 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a2fc5-279f-4912-b30b-c30019e971ca None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:00.051503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56aa915-e21b-436c-a25a-dabe6ade6970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:00.052123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56aa915-e21b-436c-a25a-dabe6ade6970 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:00.052400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56aa915-e21b-436c-a25a-dabe6ade6970 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:00.052669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56aa915-e21b-436c-a25a-dabe6ade6970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:00.053395 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56aa915-e21b-436c-a25a-dabe6ade6970 None admin] RBAC: Adding query filter params (role.id=f866ebebacd841168b26ac7ec2c7461b, user.id=a8137bd5f3a64dafa05eccc46f08b834, scope.system=all) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:00.053717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56aa915-e21b-436c-a25a-dabe6ade6970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:00.055219 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56aa915-e21b-436c-a25a-dabe6ade6970 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:00.075306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 163/334] 10.222.0.77 () {56 vars in 1308 bytes} [Mon Aug 22 15:48:59 2022] GET /identity/v3/role_assignments?user.id=a8137bd5f3a64dafa05eccc46f08b834&scope.system=all&role.id=f866ebebacd841168b26ac7ec2c7461b => generated 510 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:01.484148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616e40d-f3e2-4aef-a66d-3ab2793e3a4d None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:01.484693 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616e40d-f3e2-4aef-a66d-3ab2793e3a4d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:01.485116 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616e40d-f3e2-4aef-a66d-3ab2793e3a4d None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:01.487934 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 172/335] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:01.499031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690623a-5cd9-4105-a201-d960c8d32aac None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:01.499546 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690623a-5cd9-4105-a201-d960c8d32aac None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:01.499937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690623a-5cd9-4105-a201-d960c8d32aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:01.537343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0690623a-5cd9-4105-a201-d960c8d32aac None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:01.538799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0690623a-5cd9-4105-a201-d960c8d32aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:01.655100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137060d6-007c-4beb-b931-62d6d1acdf69 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:01.655780 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137060d6-007c-4beb-b931-62d6d1acdf69 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:01.656254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137060d6-007c-4beb-b931-62d6d1acdf69 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:01.660158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 173/336] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:01.668147 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db79e7-a988-48e2-90b2-eb49b0df36bd None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:01.668445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db79e7-a988-48e2-90b2-eb49b0df36bd None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:01.668702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db79e7-a988-48e2-90b2-eb49b0df36bd None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:01.670388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 174/337] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:01.674915 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 164/338] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:01.676386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d059eaf-b4f2-4228-a541-3bc9f81d27b1 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:01.676921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d059eaf-b4f2-4228-a541-3bc9f81d27b1 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:01.677257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d059eaf-b4f2-4228-a541-3bc9f81d27b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:01.683322 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e47f8-ff41-4058-8848-c93968b6e8ee None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:01.683993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e47f8-ff41-4058-8848-c93968b6e8ee None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:01.684286 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e47f8-ff41-4058-8848-c93968b6e8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:01.710020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1d059eaf-b4f2-4228-a541-3bc9f81d27b1 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:01.711471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1d059eaf-b4f2-4228-a541-3bc9f81d27b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:01.716751 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-170e47f8-ff41-4058-8848-c93968b6e8ee None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:01.718550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-170e47f8-ff41-4058-8848-c93968b6e8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:01.809334 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 165/339] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:49:01.878820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 175/340] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:02.042305 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e47f8-ff41-4058-8848-c93968b6e8ee None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:02.065053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:02.186453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e47f8-ff41-4058-8848-c93968b6e8ee None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:02.218963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d059eaf-b4f2-4228-a541-3bc9f81d27b1 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:02.227812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9691878-82c7-4703-a12a-57be80ea7528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:02.228466 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9691878-82c7-4703-a12a-57be80ea7528 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:02.228751 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9691878-82c7-4703-a12a-57be80ea7528 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:02.229006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9691878-82c7-4703-a12a-57be80ea7528 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:02.244119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9691878-82c7-4703-a12a-57be80ea7528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-d9691878-82c7-4703-a12a-57be80ea7528 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:02.249616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:02.250559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:02.251840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:02.251840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:02.251840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:02.251840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:02.251840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:02.251840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:02.251840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:02.251840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:02.251840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:02.251840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:02.251840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:49:02.251840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:02.251840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 166/341] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:49:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:02.257346 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9691878-82c7-4703-a12a-57be80ea7528 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:02.382666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9691878-82c7-4703-a12a-57be80ea7528 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:02.385687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:02.423468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75085316-810a-4117-8c52-474db6314847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:02.424821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75085316-810a-4117-8c52-474db6314847 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:02.425224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75085316-810a-4117-8c52-474db6314847 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:02.425619 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75085316-810a-4117-8c52-474db6314847 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:02.426687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75085316-810a-4117-8c52-474db6314847 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:02.427162 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75085316-810a-4117-8c52-474db6314847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:02.429424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75085316-810a-4117-8c52-474db6314847 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:02.444041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 167/342] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:02.448782 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75085316-810a-4117-8c52-474db6314847 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:02.450967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:02.532378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d059eaf-b4f2-4228-a541-3bc9f81d27b1 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:02.588965 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75085316-810a-4117-8c52-474db6314847 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:02.593806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f433798-b7ad-4668-b4a6-ae4ee5e0d988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:02.595038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f433798-b7ad-4668-b4a6-ae4ee5e0d988 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:02.595522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f433798-b7ad-4668-b4a6-ae4ee5e0d988 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:02.595998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f433798-b7ad-4668-b4a6-ae4ee5e0d988 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:02.618589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f433798-b7ad-4668-b4a6-ae4ee5e0d988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-8f433798-b7ad-4668-b4a6-ae4ee5e0d988 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:02.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:02.625132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:02.625914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:02.625914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:02.625914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:02.625914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:02.625914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:02.625914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:02.625914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:02.625914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:02.625914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:02.625914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:02.625914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:49:02.625914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:02.625914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 176/343] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:02.627079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f433798-b7ad-4668-b4a6-ae4ee5e0d988 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:02.649947 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4005f35-22df-4403-8592-f15a6f6bb96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:02.650622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4005f35-22df-4403-8592-f15a6f6bb96d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:02.650891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4005f35-22df-4403-8592-f15a6f6bb96d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:02.651159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4005f35-22df-4403-8592-f15a6f6bb96d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:02.654917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:02.671965 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4005f35-22df-4403-8592-f15a6f6bb96d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-d4005f35-22df-4403-8592-f15a6f6bb96d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:02.677837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:02.678835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:02.679639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:02.679639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:02.679639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:02.679639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:02.679639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:02.679639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:02.679639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:02.679639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:02.679639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:02.679639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:02.679639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:49:02.679639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:02.679639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 168/344] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:02.681005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5eca30-2c73-4734-9b11-28d37ab33c9c None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:02.686624 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5eca30-2c73-4734-9b11-28d37ab33c9c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:02.686959 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5eca30-2c73-4734-9b11-28d37ab33c9c None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:02.688789 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 169/345] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:02.689655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5eca30-2c73-4734-9b11-28d37ab33c9c None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:02.769424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f433798-b7ad-4668-b4a6-ae4ee5e0d988 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:02.790187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:02.815798 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a78e7-a20f-474b-aba3-1802d1ff9c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:02.817499 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a78e7-a20f-474b-aba3-1802d1ff9c19 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:02.818373 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a78e7-a20f-474b-aba3-1802d1ff9c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:02.818832 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a78e7-a20f-474b-aba3-1802d1ff9c19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:02.892383 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5eca30-2c73-4734-9b11-28d37ab33c9c None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:02.951146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a78e7-a20f-474b-aba3-1802d1ff9c19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:02.956157 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a78e7-a20f-474b-aba3-1802d1ff9c19 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:02.965451 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ebc26-6a09-4f1a-8bfd-d704f26d0e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:02.966213 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ebc26-6a09-4f1a-8bfd-d704f26d0e8b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:02.966735 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ebc26-6a09-4f1a-8bfd-d704f26d0e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:02.967289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ebc26-6a09-4f1a-8bfd-d704f26d0e8b None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:02.968303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ebc26-6a09-4f1a-8bfd-d704f26d0e8b None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:02.968620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ebc26-6a09-4f1a-8bfd-d704f26d0e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:02.972579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ebc26-6a09-4f1a-8bfd-d704f26d0e8b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:02.985749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 170/346] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:49:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:02.988939 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ebc26-6a09-4f1a-8bfd-d704f26d0e8b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:03.089337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:03.143831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ebc26-6a09-4f1a-8bfd-d704f26d0e8b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:03.149489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 177/347] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:03.154672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30398cf4-3331-427e-933f-f30eb5a197cd None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:03.154672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30398cf4-3331-427e-933f-f30eb5a197cd None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:03.154672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30398cf4-3331-427e-933f-f30eb5a197cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:03.187652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-30398cf4-3331-427e-933f-f30eb5a197cd None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:03.190172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-30398cf4-3331-427e-933f-f30eb5a197cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:03.191612 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfdedc-a405-4ce2-b02b-c476a59d340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:03.192498 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfdedc-a405-4ce2-b02b-c476a59d340c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:03.193292 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfdedc-a405-4ce2-b02b-c476a59d340c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:03.193762 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfdedc-a405-4ce2-b02b-c476a59d340c None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:03.194692 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfdedc-a405-4ce2-b02b-c476a59d340c None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:03.195193 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfdedc-a405-4ce2-b02b-c476a59d340c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:03.196835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfdedc-a405-4ce2-b02b-c476a59d340c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:03.207067 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 171/348] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:49:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:03.208274 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfdedc-a405-4ce2-b02b-c476a59d340c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:03.251091 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:03.321579 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 178/349] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:03.327168 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30398cf4-3331-427e-933f-f30eb5a197cd None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:03.368137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfdedc-a405-4ce2-b02b-c476a59d340c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:03.419377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:03.446049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4013b-bdd6-49e3-9fa3-2fd20caa8c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:03.446989 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4013b-bdd6-49e3-9fa3-2fd20caa8c64 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:03.447458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4013b-bdd6-49e3-9fa3-2fd20caa8c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:03.447880 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4013b-bdd6-49e3-9fa3-2fd20caa8c64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:03.504276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30398cf4-3331-427e-933f-f30eb5a197cd None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:03.554296 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3419ec-478d-4506-a74d-776e3afeedf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:03.555082 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3419ec-478d-4506-a74d-776e3afeedf7 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:03.555264 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3419ec-478d-4506-a74d-776e3afeedf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:03.555536 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3419ec-478d-4506-a74d-776e3afeedf7 None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:03.557075 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3419ec-478d-4506-a74d-776e3afeedf7 None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:03.558574 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3419ec-478d-4506-a74d-776e3afeedf7 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:03.562697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 179/350] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:03 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:03.563199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3419ec-478d-4506-a74d-776e3afeedf7 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:03.563301 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4013b-bdd6-49e3-9fa3-2fd20caa8c64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:03.565054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4013b-bdd6-49e3-9fa3-2fd20caa8c64 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:03.591678 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:03.699143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 172/351] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:03.700471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07af64-48d0-4a5f-8fa1-8e5fb44f8585 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:03.700791 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07af64-48d0-4a5f-8fa1-8e5fb44f8585 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:03.701021 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07af64-48d0-4a5f-8fa1-8e5fb44f8585 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:03.702722 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 173/352] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:03.703677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c1a3b-4602-4ff8-be94-aa0b56efa443 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:03.703953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c1a3b-4602-4ff8-be94-aa0b56efa443 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:03.704225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c1a3b-4602-4ff8-be94-aa0b56efa443 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:03.704912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3419ec-478d-4506-a74d-776e3afeedf7 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:03.705722 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 174/353] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:03.706783 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c1a3b-4602-4ff8-be94-aa0b56efa443 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:03.740501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:03.757683 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f4cec-e533-4c71-80b5-563863ae8650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:03.758536 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f4cec-e533-4c71-80b5-563863ae8650 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:03.758846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f4cec-e533-4c71-80b5-563863ae8650 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:03.759123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f4cec-e533-4c71-80b5-563863ae8650 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:03.864999 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f4cec-e533-4c71-80b5-563863ae8650 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:03.866860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c1a3b-4602-4ff8-be94-aa0b56efa443 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:03.867883 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f4cec-e533-4c71-80b5-563863ae8650 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:03.887817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:03.912128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d4753-3a8d-4c57-8b40-557654af45ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:03.912779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d4753-3a8d-4c57-8b40-557654af45ad None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:03.913059 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d4753-3a8d-4c57-8b40-557654af45ad None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:03.913401 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d4753-3a8d-4c57-8b40-557654af45ad None admin] PATH_INFO: `/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:03.923639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d4753-3a8d-4c57-8b40-557654af45ad None admin] RBAC: Authorizing `identity:get_group(group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:03.925585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d4753-3a8d-4c57-8b40-557654af45ad None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:03.927411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 175/354] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:03 2022] GET /identity/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:03.928609 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d4753-3a8d-4c57-8b40-557654af45ad None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:04.023322 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 180/355] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:04.025526 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ccf2b-e575-4431-a64b-9835dd5f3c58 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:04.025965 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ccf2b-e575-4431-a64b-9835dd5f3c58 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:04.026401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ccf2b-e575-4431-a64b-9835dd5f3c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:04.058039 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-9c6ccf2b-e575-4431-a64b-9835dd5f3c58 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:04.059845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9c6ccf2b-e575-4431-a64b-9835dd5f3c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:04.070635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:04.100798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d4753-3a8d-4c57-8b40-557654af45ad None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:04.151127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdf302-586a-4d8a-88f4-59058d39c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:04.151809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdf302-586a-4d8a-88f4-59058d39c2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:04.152058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdf302-586a-4d8a-88f4-59058d39c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:04.152338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdf302-586a-4d8a-88f4-59058d39c2b6 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:04.154136 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdf302-586a-4d8a-88f4-59058d39c2b6 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:04.156232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdf302-586a-4d8a-88f4-59058d39c2b6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:04.158510 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 176/356] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:03 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:04.159999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd35c-9ae7-4b67-89aa-589e96e09a63 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:04.160272 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd35c-9ae7-4b67-89aa-589e96e09a63 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:04.160537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd35c-9ae7-4b67-89aa-589e96e09a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:04.164052 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 181/357] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:04.165033 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ccf2b-e575-4431-a64b-9835dd5f3c58 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:04.191735 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-435dd35c-9ae7-4b67-89aa-589e96e09a63 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:04.193534 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-435dd35c-9ae7-4b67-89aa-589e96e09a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:04.246926 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:04.307464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 177/358] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:04.308648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dd35c-9ae7-4b67-89aa-589e96e09a63 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:04.335623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ccf2b-e575-4431-a64b-9835dd5f3c58 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:04.386629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a3f9e-179e-4a10-8b92-92e3487e9649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:04.386629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a3f9e-179e-4a10-8b92-92e3487e9649 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:04.386629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a3f9e-179e-4a10-8b92-92e3487e9649 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:04.386629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a3f9e-179e-4a10-8b92-92e3487e9649 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:04.396449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a3f9e-179e-4a10-8b92-92e3487e9649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-0b7a3f9e-179e-4a10-8b92-92e3487e9649 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:04.402833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:04.404592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:04.406191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:04.406191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:04.406191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:04.406191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:04.406191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:04.406191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:04.406191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:04.406191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:04.406191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:04.406191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:04.406191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 15:49:04.406191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:04.406191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 182/359] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:04.406191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a3f9e-179e-4a10-8b92-92e3487e9649 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:04.455001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:04.472043 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dd35c-9ae7-4b67-89aa-589e96e09a63 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:04.523384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c8b57-696f-437b-bf27-8cdda7104ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:04.524113 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8b57-696f-437b-bf27-8cdda7104ded None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:04.524500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8b57-696f-437b-bf27-8cdda7104ded None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:04.524818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8b57-696f-437b-bf27-8cdda7104ded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:04.526317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c8b57-696f-437b-bf27-8cdda7104ded None admin] RBAC: Adding query filter params (group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f, role.id=64aca4dbf153454d8abb3af690d90c76, scope.project.id=25b73a36dde84c9d97a80501da4f16d0) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:04.526317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c8b57-696f-437b-bf27-8cdda7104ded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:04.527808 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c8b57-696f-437b-bf27-8cdda7104ded None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:04.536073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 178/360] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 22 15:49:04 2022] GET /identity/v3/role_assignments?group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f&scope.project.id=25b73a36dde84c9d97a80501da4f16d0&role.id=64aca4dbf153454d8abb3af690d90c76 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:04.539054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c8b57-696f-437b-bf27-8cdda7104ded None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:04.555711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a3f9e-179e-4a10-8b92-92e3487e9649 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:04.564352 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:04.618569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26b880-7399-4643-8bff-0c8738e5aa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:04.619623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26b880-7399-4643-8bff-0c8738e5aa4f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:04.620074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26b880-7399-4643-8bff-0c8738e5aa4f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:04.620485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26b880-7399-4643-8bff-0c8738e5aa4f None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:04.622022 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26b880-7399-4643-8bff-0c8738e5aa4f None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:04.624558 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26b880-7399-4643-8bff-0c8738e5aa4f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:04.627520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 183/361] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:04 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:04.629395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26b880-7399-4643-8bff-0c8738e5aa4f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:04.705592 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c8b57-696f-437b-bf27-8cdda7104ded None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:04.755603 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e1842-eb8e-4f75-8eee-0fcc55279f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:04.756275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e1842-eb8e-4f75-8eee-0fcc55279f4c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:04.756628 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e1842-eb8e-4f75-8eee-0fcc55279f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:04.756860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e1842-eb8e-4f75-8eee-0fcc55279f4c None admin] PATH_INFO: `/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:04.758032 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e1842-eb8e-4f75-8eee-0fcc55279f4c None admin] RBAC: Authorizing `identity:get_group(group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:04.760289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e1842-eb8e-4f75-8eee-0fcc55279f4c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:04.761732 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 179/362] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:04 2022] GET /identity/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:04.761991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e1842-eb8e-4f75-8eee-0fcc55279f4c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:04.788063 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26b880-7399-4643-8bff-0c8738e5aa4f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:04.791125 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:04.830705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaddd92-2941-4b60-a210-368c1316dd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:04.831242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaddd92-2941-4b60-a210-368c1316dd34 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:04.831523 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaddd92-2941-4b60-a210-368c1316dd34 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:04.831794 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaddd92-2941-4b60-a210-368c1316dd34 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:04.832482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaddd92-2941-4b60-a210-368c1316dd34 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:04.832784 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaddd92-2941-4b60-a210-368c1316dd34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:04.834211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaddd92-2941-4b60-a210-368c1316dd34 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:04.845320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 184/363] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:49:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:04.847581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaddd92-2941-4b60-a210-368c1316dd34 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:04.899836 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:04.931129 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e1842-eb8e-4f75-8eee-0fcc55279f4c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:04.985749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afafdd-c1ed-4876-bb65-99065312ae97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:04.986404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afafdd-c1ed-4876-bb65-99065312ae97 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:04.986773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afafdd-c1ed-4876-bb65-99065312ae97 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:04.987052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afafdd-c1ed-4876-bb65-99065312ae97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:04.995078 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaddd92-2941-4b60-a210-368c1316dd34 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:05.000158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afafdd-c1ed-4876-bb65-99065312ae97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-29afafdd-c1ed-4876-bb65-99065312ae97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:05.008044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:05.009456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:05.010270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:05.010270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:05.010270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:05.010270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:05.010270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:05.010270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:05.010270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:05.010270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:05.010270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:05.010270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:05.010270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:05.010270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:05.010270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 180/364] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:49:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:05.010270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afafdd-c1ed-4876-bb65-99065312ae97 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:05.055488 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a5a22-f506-4a3c-8dfa-b0415670ddc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:05.056552 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a5a22-f506-4a3c-8dfa-b0415670ddc1 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:05.057143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a5a22-f506-4a3c-8dfa-b0415670ddc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:05.057416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a5a22-f506-4a3c-8dfa-b0415670ddc1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:05.075692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a5a22-f506-4a3c-8dfa-b0415670ddc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-ce6a5a22-f506-4a3c-8dfa-b0415670ddc1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:05.081618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:05.082730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:05.083660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:05.083660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:05.083660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:05.083660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:05.083660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:05.083660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:05.083660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:05.083660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:05.083660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:05.083660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:05.083660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:49:05.083660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:05.083660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 185/365] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:49:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:05.087457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a5a22-f506-4a3c-8dfa-b0415670ddc1 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:05.126962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:05.165331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afafdd-c1ed-4876-bb65-99065312ae97 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:05.215907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b8077-9649-437b-9506-e48bfbf41e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:05.217027 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b8077-9649-437b-9506-e48bfbf41e4b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:05.217495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b8077-9649-437b-9506-e48bfbf41e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:05.218074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b8077-9649-437b-9506-e48bfbf41e4b None admin] PATH_INFO: `/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:05.219608 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b8077-9649-437b-9506-e48bfbf41e4b None admin] RBAC: Authorizing `identity:get_group(group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:05.222028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b8077-9649-437b-9506-e48bfbf41e4b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:05.224860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 181/366] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:05 2022] GET /identity/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:05.226016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b8077-9649-437b-9506-e48bfbf41e4b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:05.231272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:05.240761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a5a22-f506-4a3c-8dfa-b0415670ddc1 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:05.300113 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb6461-7c07-4573-b152-824cd99d08ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:05.300970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb6461-7c07-4573-b152-824cd99d08ff None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:05.301314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb6461-7c07-4573-b152-824cd99d08ff None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:05.301602 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb6461-7c07-4573-b152-824cd99d08ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:05.305550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb6461-7c07-4573-b152-824cd99d08ff None admin] RBAC: Adding query filter params (group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f, role.id=f866ebebacd841168b26ac7ec2c7461b, scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:05.305550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb6461-7c07-4573-b152-824cd99d08ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:05.305550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb6461-7c07-4573-b152-824cd99d08ff None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:05.312338 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 186/367] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 22 15:49:05 2022] GET /identity/v3/role_assignments?group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f&scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b&role.id=f866ebebacd841168b26ac7ec2c7461b => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:05.313450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb6461-7c07-4573-b152-824cd99d08ff None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:05.403646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b8077-9649-437b-9506-e48bfbf41e4b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:05.444160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb6461-7c07-4573-b152-824cd99d08ff None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:05.491073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5e582-fb03-42a6-9fa2-3bc8d3c20976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:05.492642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5e582-fb03-42a6-9fa2-3bc8d3c20976 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:05.492947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5e582-fb03-42a6-9fa2-3bc8d3c20976 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:05.493189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5e582-fb03-42a6-9fa2-3bc8d3c20976 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:05.493885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5e582-fb03-42a6-9fa2-3bc8d3c20976 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:05.494189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5e582-fb03-42a6-9fa2-3bc8d3c20976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:05.495660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5e582-fb03-42a6-9fa2-3bc8d3c20976 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:05.498191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15055c-16f9-4b49-a78f-a89354d28af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:05.498950 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15055c-16f9-4b49-a78f-a89354d28af6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:05.499242 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15055c-16f9-4b49-a78f-a89354d28af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:05.499496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15055c-16f9-4b49-a78f-a89354d28af6 None admin] PATH_INFO: `/v3/users/81931cf5cc8a4aa296f8368ea78a18a9` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:05.501280 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15055c-16f9-4b49-a78f-a89354d28af6 None admin] RBAC: Authorizing `identity:get_user(user_id=81931cf5cc8a4aa296f8368ea78a18a9)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:05.502807 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15055c-16f9-4b49-a78f-a89354d28af6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:05.504467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 182/368] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:49:05 2022] GET /identity/v3/users/81931cf5cc8a4aa296f8368ea78a18a9 => generated 293 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:05.505268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15055c-16f9-4b49-a78f-a89354d28af6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:05.513396 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 187/369] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:05.514311 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5e582-fb03-42a6-9fa2-3bc8d3c20976 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:05.528420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:05.550718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:05.678831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15055c-16f9-4b49-a78f-a89354d28af6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:05.728748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5e582-fb03-42a6-9fa2-3bc8d3c20976 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:05.731617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe8ed1-e834-4111-a526-2b975362a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:05.732735 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe8ed1-e834-4111-a526-2b975362a87a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:05.733056 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe8ed1-e834-4111-a526-2b975362a87a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:05.733332 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe8ed1-e834-4111-a526-2b975362a87a None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:05.735106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe8ed1-e834-4111-a526-2b975362a87a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:05.735410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe8ed1-e834-4111-a526-2b975362a87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:05.736811 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe8ed1-e834-4111-a526-2b975362a87a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:05.750758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 183/370] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:05.751950 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe8ed1-e834-4111-a526-2b975362a87a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:05.784197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c07f7-01cc-4264-a43a-9d8d6e416bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:05.784907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c07f7-01cc-4264-a43a-9d8d6e416bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:05.785190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c07f7-01cc-4264-a43a-9d8d6e416bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:05.785470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c07f7-01cc-4264-a43a-9d8d6e416bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:05.786245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c07f7-01cc-4264-a43a-9d8d6e416bc4 None admin] RBAC: Adding query filter params (group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f, role.id=f866ebebacd841168b26ac7ec2c7461b, scope.project.id=25b73a36dde84c9d97a80501da4f16d0) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:05.786688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c07f7-01cc-4264-a43a-9d8d6e416bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:05.788352 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c07f7-01cc-4264-a43a-9d8d6e416bc4 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:05.795745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 188/371] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 22 15:49:05 2022] GET /identity/v3/role_assignments?group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f&scope.project.id=25b73a36dde84c9d97a80501da4f16d0&role.id=f866ebebacd841168b26ac7ec2c7461b => generated 260 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:05.796614 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c07f7-01cc-4264-a43a-9d8d6e416bc4 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:05.894173 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:05.955207 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe8ed1-e834-4111-a526-2b975362a87a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:05.981048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:06.016079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c07f7-01cc-4264-a43a-9d8d6e416bc4 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:06.032700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4a083-7655-4f24-9c2d-2ab545b41651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:06.033327 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4a083-7655-4f24-9c2d-2ab545b41651 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:06.033607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4a083-7655-4f24-9c2d-2ab545b41651 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:06.033888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4a083-7655-4f24-9c2d-2ab545b41651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:06.036805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4a083-7655-4f24-9c2d-2ab545b41651 None admin] RBAC: Adding query filter params (role.id=4d7a14112b4142d8a641585adf39cc07, user.id=81931cf5cc8a4aa296f8368ea78a18a9, scope.system=all) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:06.037184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4a083-7655-4f24-9c2d-2ab545b41651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:06.038727 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4a083-7655-4f24-9c2d-2ab545b41651 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:06.052181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 184/372] 10.222.0.77 () {56 vars in 1308 bytes} [Mon Aug 22 15:49:05 2022] GET /identity/v3/role_assignments?user.id=81931cf5cc8a4aa296f8368ea78a18a9&scope.system=all&role.id=4d7a14112b4142d8a641585adf39cc07 => generated 510 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:06.053050 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4a083-7655-4f24-9c2d-2ab545b41651 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:06.083106 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b28b96-9cbd-43d2-ad59-363123659d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:06.083750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28b96-9cbd-43d2-ad59-363123659d15 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:06.084031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28b96-9cbd-43d2-ad59-363123659d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:06.084297 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28b96-9cbd-43d2-ad59-363123659d15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:06.179888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4a083-7655-4f24-9c2d-2ab545b41651 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:06.220826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:06.224850 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b28b96-9cbd-43d2-ad59-363123659d15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:06.227510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b28b96-9cbd-43d2-ad59-363123659d15 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:06.228083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74163b-4db5-48f5-8cce-810dc10ef5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:06.228803 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74163b-4db5-48f5-8cce-810dc10ef5ee None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:06.229121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74163b-4db5-48f5-8cce-810dc10ef5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:06.229544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74163b-4db5-48f5-8cce-810dc10ef5ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:06.381154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74163b-4db5-48f5-8cce-810dc10ef5ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:06.382696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74163b-4db5-48f5-8cce-810dc10ef5ee None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:06.389110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:06.410120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 189/373] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:06.416971 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b28b96-9cbd-43d2-ad59-363123659d15 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:06.569088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 185/374] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:06.592673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74163b-4db5-48f5-8cce-810dc10ef5ee None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:06.633111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b28b96-9cbd-43d2-ad59-363123659d15 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:06.663005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:06.707500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143a445-937e-4500-9f0f-7d766c3a6ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:06.708149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143a445-937e-4500-9f0f-7d766c3a6ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:06.708427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143a445-937e-4500-9f0f-7d766c3a6ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:06.708709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143a445-937e-4500-9f0f-7d766c3a6ce7 None admin] PATH_INFO: `/v3/projects/29b6132ef8cb45a795d9be0f08083084` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:06.709960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143a445-937e-4500-9f0f-7d766c3a6ce7 None admin] RBAC: Authorizing `identity:get_project(project_id=29b6132ef8cb45a795d9be0f08083084)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:06.711630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143a445-937e-4500-9f0f-7d766c3a6ce7 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:06.718097 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 190/375] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:06 2022] GET /identity/v3/projects/29b6132ef8cb45a795d9be0f08083084 => generated 344 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:06.721367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143a445-937e-4500-9f0f-7d766c3a6ce7 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:06.746888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74163b-4db5-48f5-8cce-810dc10ef5ee None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:06.791280 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef21a08-4706-4db9-ae02-4910f5d17d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:06.791924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef21a08-4706-4db9-ae02-4910f5d17d96 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:06.792190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef21a08-4706-4db9-ae02-4910f5d17d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:06.793968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef21a08-4706-4db9-ae02-4910f5d17d96 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:06.795728 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef21a08-4706-4db9-ae02-4910f5d17d96 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:06.803981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef21a08-4706-4db9-ae02-4910f5d17d96 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:06.805792 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 186/376] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:06 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:06.814436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:06.820107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef21a08-4706-4db9-ae02-4910f5d17d96 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:06.875507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143a445-937e-4500-9f0f-7d766c3a6ce7 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:06.917335 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daf355-bf3c-4d9a-8b7d-667463075757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:06.918416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf355-bf3c-4d9a-8b7d-667463075757 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:06.918924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf355-bf3c-4d9a-8b7d-667463075757 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:06.919379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daf355-bf3c-4d9a-8b7d-667463075757 None admin] PATH_INFO: `/v3/groups/e134846c902046c9acf1f4f6ad98ad1c` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:06.932073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8daf355-bf3c-4d9a-8b7d-667463075757 None admin] RBAC: Authorizing `identity:get_group(group_id=e134846c902046c9acf1f4f6ad98ad1c)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:06.935441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8daf355-bf3c-4d9a-8b7d-667463075757 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:06.941471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 191/377] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:06 2022] GET /identity/v3/groups/e134846c902046c9acf1f4f6ad98ad1c => generated 229 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:06.948246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daf355-bf3c-4d9a-8b7d-667463075757 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:07.048890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:07.060261 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef21a08-4706-4db9-ae02-4910f5d17d96 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:07.093367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daf355-bf3c-4d9a-8b7d-667463075757 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:07.113705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:07.142001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599dbd5-86b3-4bb3-9fe2-3d69ca0d0e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:07.143078 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599dbd5-86b3-4bb3-9fe2-3d69ca0d0e79 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:07.143555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599dbd5-86b3-4bb3-9fe2-3d69ca0d0e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:07.144297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599dbd5-86b3-4bb3-9fe2-3d69ca0d0e79 None admin] PATH_INFO: `/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:07.145686 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599dbd5-86b3-4bb3-9fe2-3d69ca0d0e79 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:07.148195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599dbd5-86b3-4bb3-9fe2-3d69ca0d0e79 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:07.154821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 187/378] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:06 2022] GET /identity/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f => generated 226 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:07.158118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589e993-8e77-4476-a1dd-822776dc03ed None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:07.158416 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589e993-8e77-4476-a1dd-822776dc03ed None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:07.158737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589e993-8e77-4476-a1dd-822776dc03ed None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:07.160149 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 188/379] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:07.164856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41c6d4-218e-400a-9b44-2498322c9cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:07.166197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589e993-8e77-4476-a1dd-822776dc03ed None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:07.166467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41c6d4-218e-400a-9b44-2498322c9cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:07.167131 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41c6d4-218e-400a-9b44-2498322c9cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:07.167604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41c6d4-218e-400a-9b44-2498322c9cd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:07.168568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41c6d4-218e-400a-9b44-2498322c9cd9 None admin] RBAC: Adding query filter params (group.id=e134846c902046c9acf1f4f6ad98ad1c, role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=29b6132ef8cb45a795d9be0f08083084) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:07.169095 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41c6d4-218e-400a-9b44-2498322c9cd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:07.171166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41c6d4-218e-400a-9b44-2498322c9cd9 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:07.178265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 192/380] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 22 15:49:06 2022] GET /identity/v3/role_assignments?group.id=e134846c902046c9acf1f4f6ad98ad1c&scope.project.id=29b6132ef8cb45a795d9be0f08083084&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:07.179995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e64ba0-018c-4186-a3e1-15ea0f824a13 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:07.180504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e64ba0-018c-4186-a3e1-15ea0f824a13 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:07.180972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e64ba0-018c-4186-a3e1-15ea0f824a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:07.203024 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c5e64ba0-018c-4186-a3e1-15ea0f824a13 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:07.204682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c5e64ba0-018c-4186-a3e1-15ea0f824a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:07.300948 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 193/381] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:07.378055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589e993-8e77-4476-a1dd-822776dc03ed None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:07.443128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f84aab-978a-456a-8642-d0ccfaaa735c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:07.443835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f84aab-978a-456a-8642-d0ccfaaa735c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:07.444112 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f84aab-978a-456a-8642-d0ccfaaa735c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:07.444377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f84aab-978a-456a-8642-d0ccfaaa735c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:07.445156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f84aab-978a-456a-8642-d0ccfaaa735c None admin] RBAC: Adding query filter params (group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f, role.id=64aca4dbf153454d8abb3af690d90c76, scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:07.445457 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f84aab-978a-456a-8642-d0ccfaaa735c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:07.446998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f84aab-978a-456a-8642-d0ccfaaa735c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:07.458285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 189/382] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 22 15:49:07 2022] GET /identity/v3/role_assignments?group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f&scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b&role.id=64aca4dbf153454d8abb3af690d90c76 => generated 260 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:07.676151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c0482-2d83-4080-b2bd-8ff961678e08 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:07.676548 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c0482-2d83-4080-b2bd-8ff961678e08 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:07.676734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c0482-2d83-4080-b2bd-8ff961678e08 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:07.678271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 194/383] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:07.684251 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b21b03-957d-457d-ac34-36e550a4d1a6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:07.684879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b21b03-957d-457d-ac34-36e550a4d1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:07.686319 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c0482-2d83-4080-b2bd-8ff961678e08 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:07.687781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b21b03-957d-457d-ac34-36e550a4d1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:07.710106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a0b21b03-957d-457d-ac34-36e550a4d1a6 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:07.712059 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a0b21b03-957d-457d-ac34-36e550a4d1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:07.771672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:07.845669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c0482-2d83-4080-b2bd-8ff961678e08 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:07.850785 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 190/384] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:07.860962 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:07.890834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d38446-dbc6-4f99-bcfb-d33f31d77c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:07.891904 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38446-dbc6-4f99-bcfb-d33f31d77c6b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:07.892401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38446-dbc6-4f99-bcfb-d33f31d77c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:07.892868 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38446-dbc6-4f99-bcfb-d33f31d77c6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:07.905935 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d38446-dbc6-4f99-bcfb-d33f31d77c6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-07d38446-dbc6-4f99-bcfb-d33f31d77c6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:07.911494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:07.912491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:07.913327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:07.913327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:07.913327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:07.913327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:07.913327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:07.913327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:07.913327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:07.913327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:07.913327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:07.913327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:07.913327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:49:07.913327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:07.916196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 195/385] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:49:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:07.925655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b21b03-957d-457d-ac34-36e550a4d1a6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:08.082014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b21b03-957d-457d-ac34-36e550a4d1a6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:08.117828 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff539e-2d03-41d1-bc4e-9c7be8e345df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:08.118445 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff539e-2d03-41d1-bc4e-9c7be8e345df None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:08.118750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff539e-2d03-41d1-bc4e-9c7be8e345df None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:08.119019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff539e-2d03-41d1-bc4e-9c7be8e345df None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:08.119699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff539e-2d03-41d1-bc4e-9c7be8e345df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:08.119995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff539e-2d03-41d1-bc4e-9c7be8e345df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:08.121387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff539e-2d03-41d1-bc4e-9c7be8e345df None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:08.132643 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 191/386] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:08.138620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d38446-dbc6-4f99-bcfb-d33f31d77c6b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:08.169898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff539e-2d03-41d1-bc4e-9c7be8e345df None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:08.235416 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:08.343226 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d38446-dbc6-4f99-bcfb-d33f31d77c6b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:08.384734 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff539e-2d03-41d1-bc4e-9c7be8e345df None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:08.387247 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a5a56-7fc9-4deb-b912-c6118cf76ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:08.388188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a5a56-7fc9-4deb-b912-c6118cf76ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:08.388669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a5a56-7fc9-4deb-b912-c6118cf76ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:08.389127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a5a56-7fc9-4deb-b912-c6118cf76ed5 None admin] PATH_INFO: `/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:08.390497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a5a56-7fc9-4deb-b912-c6118cf76ed5 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:08.393169 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a5a56-7fc9-4deb-b912-c6118cf76ed5 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:08.395372 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 196/387] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:08 2022] GET /identity/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:08.401490 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a5a56-7fc9-4deb-b912-c6118cf76ed5 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:08.430100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f30c8-72a3-46e0-a01c-325f3ce6336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:08.430708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f30c8-72a3-46e0-a01c-325f3ce6336b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:08.430983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f30c8-72a3-46e0-a01c-325f3ce6336b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:08.431254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f30c8-72a3-46e0-a01c-325f3ce6336b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:08.442889 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f30c8-72a3-46e0-a01c-325f3ce6336b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-138f30c8-72a3-46e0-a01c-325f3ce6336b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:08.448400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:08.449496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:08.450398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:08.450398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:08.450398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:08.450398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:08.450398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:08.450398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:08.450398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:08.450398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:08.450398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:08.450398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:08.450398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:49:08.450398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:08.450398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 192/388] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:08.455826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce3b20-ddb5-48b2-b45c-f503410bf601 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:08.456306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:08.457234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce3b20-ddb5-48b2-b45c-f503410bf601 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:08.457689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce3b20-ddb5-48b2-b45c-f503410bf601 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:08.459540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 193/389] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:08.461256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce3b20-ddb5-48b2-b45c-f503410bf601 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:08.527702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a5a56-7fc9-4deb-b912-c6118cf76ed5 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:08.559616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:08.580609 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78aaf8-7ca6-4df1-87a5-7b1e93ffc863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:08.581247 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78aaf8-7ca6-4df1-87a5-7b1e93ffc863 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:08.581524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78aaf8-7ca6-4df1-87a5-7b1e93ffc863 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:08.581794 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78aaf8-7ca6-4df1-87a5-7b1e93ffc863 None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:08.583419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78aaf8-7ca6-4df1-87a5-7b1e93ffc863 None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:08.584170 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce3b20-ddb5-48b2-b45c-f503410bf601 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:08.584907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78aaf8-7ca6-4df1-87a5-7b1e93ffc863 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:08.590793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 197/390] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:08 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:08.592344 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b6a56-ddcd-4983-9e81-5eb45012776f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:08.595022 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b6a56-ddcd-4983-9e81-5eb45012776f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:08.595243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b6a56-ddcd-4983-9e81-5eb45012776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:08.619515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c03b6a56-ddcd-4983-9e81-5eb45012776f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:08.620948 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c03b6a56-ddcd-4983-9e81-5eb45012776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:08.627536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660460bc-0d5a-43e0-bdf9-dae674c2daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:08.628591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660460bc-0d5a-43e0-bdf9-dae674c2daa9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:08.629052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660460bc-0d5a-43e0-bdf9-dae674c2daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:08.629566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660460bc-0d5a-43e0-bdf9-dae674c2daa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:08.630428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660460bc-0d5a-43e0-bdf9-dae674c2daa9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:08.630957 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660460bc-0d5a-43e0-bdf9-dae674c2daa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:08.632555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660460bc-0d5a-43e0-bdf9-dae674c2daa9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:08.644172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 194/391] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:49:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:08.645238 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660460bc-0d5a-43e0-bdf9-dae674c2daa9 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:08.716477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 198/392] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:08.717621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b6a56-ddcd-4983-9e81-5eb45012776f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:08.756466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:08.798832 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660460bc-0d5a-43e0-bdf9-dae674c2daa9 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:08.838928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b6a56-ddcd-4983-9e81-5eb45012776f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:08.873324 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98db515-ed35-4c69-a3ee-bdb597a7971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:08.874402 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98db515-ed35-4c69-a3ee-bdb597a7971e None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:08.874904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98db515-ed35-4c69-a3ee-bdb597a7971e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:08.875361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98db515-ed35-4c69-a3ee-bdb597a7971e None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f/roles/64aca4dbf153454d8abb3af690d90c76` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:08.877721 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d9496-2aa8-483f-b328-3bda95805314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:08.878343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d9496-2aa8-483f-b328-3bda95805314 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:08.878640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d9496-2aa8-483f-b328-3bda95805314 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:08.878914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d9496-2aa8-483f-b328-3bda95805314 None admin] PATH_INFO: `/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:08.882296 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d9496-2aa8-483f-b328-3bda95805314 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:08.882296 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d9496-2aa8-483f-b328-3bda95805314 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:08.883613 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 199/393] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:08 2022] GET /identity/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:08.884337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98db515-ed35-4c69-a3ee-bdb597a7971e None admin] RBAC: Authorizing `identity:create_grant(project_id=25b73a36dde84c9d97a80501da4f16d0, group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f, role_id=64aca4dbf153454d8abb3af690d90c76)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:08.886999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98db515-ed35-4c69-a3ee-bdb597a7971e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:08.889368 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d9496-2aa8-483f-b328-3bda95805314 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:08.915184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 195/394] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Aug 22 15:49:08 2022] PUT /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f/roles/64aca4dbf153454d8abb3af690d90c76 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:49:08.984037 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98db515-ed35-4c69-a3ee-bdb597a7971e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:08.991290 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:09.064419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d9496-2aa8-483f-b328-3bda95805314 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:09.067420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:09.118204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93653e8-da17-4437-8622-92bfaba73a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:09.119125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93653e8-da17-4437-8622-92bfaba73a38 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:09.120364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93653e8-da17-4437-8622-92bfaba73a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:09.120843 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93653e8-da17-4437-8622-92bfaba73a38 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:09.122300 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93653e8-da17-4437-8622-92bfaba73a38 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:09.123982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93653e8-da17-4437-8622-92bfaba73a38 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:09.126089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 200/395] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:08 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:09.132057 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93653e8-da17-4437-8622-92bfaba73a38 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:09.154035 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98db515-ed35-4c69-a3ee-bdb597a7971e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:09.188995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50836e48-6df8-40d7-adf9-cbec609d2404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:09.189640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50836e48-6df8-40d7-adf9-cbec609d2404 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:09.189917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50836e48-6df8-40d7-adf9-cbec609d2404 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:09.190190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50836e48-6df8-40d7-adf9-cbec609d2404 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:09.201487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50836e48-6df8-40d7-adf9-cbec609d2404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-50836e48-6df8-40d7-adf9-cbec609d2404 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:09.207016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:09.208121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:09.209123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:09.209123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:09.209123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:09.209123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:09.209123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:09.209123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:09.209123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:09.209123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:09.209123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:09.209123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:09.209123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:49:09.209123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:09.210720 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 196/396] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:09.214322 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50836e48-6df8-40d7-adf9-cbec609d2404 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:09.245830 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93653e8-da17-4437-8622-92bfaba73a38 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:09.287566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:09.319757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50836e48-6df8-40d7-adf9-cbec609d2404 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:09.334617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dddd19-9030-4882-9c21-0eb235dc42a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:09.334777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dddd19-9030-4882-9c21-0eb235dc42a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:09.334954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dddd19-9030-4882-9c21-0eb235dc42a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:09.336133 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dddd19-9030-4882-9c21-0eb235dc42a9 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:09.339010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dddd19-9030-4882-9c21-0eb235dc42a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e27bb360e92e43f2bdebf830fd0ff33b, group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:09.340487 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dddd19-9030-4882-9c21-0eb235dc42a9 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:09.366867 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 201/397] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Aug 22 15:49:09 2022] PUT /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:49:09.372985 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224e25e-24d1-4968-a6d3-2841b7f2245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:09.373671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224e25e-24d1-4968-a6d3-2841b7f2245a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:09.374057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224e25e-24d1-4968-a6d3-2841b7f2245a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:09.374279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224e25e-24d1-4968-a6d3-2841b7f2245a None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:09.375011 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224e25e-24d1-4968-a6d3-2841b7f2245a None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:09.375316 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224e25e-24d1-4968-a6d3-2841b7f2245a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:09.376853 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224e25e-24d1-4968-a6d3-2841b7f2245a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:09.387208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 197/398] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:49:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:09.393354 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dddd19-9030-4882-9c21-0eb235dc42a9 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:09.428540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:09.524193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dddd19-9030-4882-9c21-0eb235dc42a9 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:09.576155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d483763-70d1-4d93-a990-19c908343162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:09.576811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d483763-70d1-4d93-a990-19c908343162 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:09.577153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d483763-70d1-4d93-a990-19c908343162 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:09.577428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d483763-70d1-4d93-a990-19c908343162 None admin] PATH_INFO: `/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:09.578705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d483763-70d1-4d93-a990-19c908343162 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:09.580174 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d483763-70d1-4d93-a990-19c908343162 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:09.581916 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 202/399] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:09 2022] GET /identity/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:09.588514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224e25e-24d1-4968-a6d3-2841b7f2245a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:09.699112 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224e25e-24d1-4968-a6d3-2841b7f2245a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:09.727039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:09.735531 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417522e-6787-4f11-a771-a19d0f0ba857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:09.736613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417522e-6787-4f11-a771-a19d0f0ba857 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:09.737100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417522e-6787-4f11-a771-a19d0f0ba857 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:09.737716 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417522e-6787-4f11-a771-a19d0f0ba857 None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:09.739010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417522e-6787-4f11-a771-a19d0f0ba857 None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:09.740482 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417522e-6787-4f11-a771-a19d0f0ba857 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:09.746585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 198/400] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:09 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:09.748452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d483763-70d1-4d93-a990-19c908343162 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:09.863477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:09.867652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d483763-70d1-4d93-a990-19c908343162 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:09.908628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbf41f-9f3e-4119-95e5-03fe9bd57a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:09.909396 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf41f-9f3e-4119-95e5-03fe9bd57a43 None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:09.909575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf41f-9f3e-4119-95e5-03fe9bd57a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:09.909838 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf41f-9f3e-4119-95e5-03fe9bd57a43 None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:09.911781 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbf41f-9f3e-4119-95e5-03fe9bd57a43 None admin] RBAC: Authorizing `identity:create_grant(project_id=25b73a36dde84c9d97a80501da4f16d0, group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:09.913235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbf41f-9f3e-4119-95e5-03fe9bd57a43 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:09.934899 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 203/401] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Aug 22 15:49:09 2022] PUT /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:49:09.949890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13000fb4-a5cf-4726-a5ff-468661658688 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:09.950453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13000fb4-a5cf-4726-a5ff-468661658688 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:09.950453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13000fb4-a5cf-4726-a5ff-468661658688 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:09.952127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 199/402] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:09.966681 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fec7-01a1-44d4-880d-e1f0cbf7385e None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:09.967014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fec7-01a1-44d4-880d-e1f0cbf7385e None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:09.967237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fec7-01a1-44d4-880d-e1f0cbf7385e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:09.991763 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-2552fec7-01a1-44d4-880d-e1f0cbf7385e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:09.993117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-2552fec7-01a1-44d4-880d-e1f0cbf7385e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:10.004505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfad4ea-9a5b-4ed5-8958-211afe08a874 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:10.005120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfad4ea-9a5b-4ed5-8958-211afe08a874 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:10.005606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfad4ea-9a5b-4ed5-8958-211afe08a874 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:10.007553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 200/403] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:10.024435 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a852e33-83ab-427b-86f3-b21261535236 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:10.024791 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a852e33-83ab-427b-86f3-b21261535236 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:10.024988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a852e33-83ab-427b-86f3-b21261535236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:10.070555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9a852e33-83ab-427b-86f3-b21261535236 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:10.071833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9a852e33-83ab-427b-86f3-b21261535236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:10.122858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 204/404] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:10.176358 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 201/405] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:10.449001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552fec7-01a1-44d4-880d-e1f0cbf7385e None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:10.453847 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a852e33-83ab-427b-86f3-b21261535236 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:10.587201 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552fec7-01a1-44d4-880d-e1f0cbf7385e None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:10.588763 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:10.609434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a852e33-83ab-427b-86f3-b21261535236 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:10.624398 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e25bd2-8e50-4497-9f44-b096de9dd169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:10.625050 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e25bd2-8e50-4497-9f44-b096de9dd169 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:10.625326 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e25bd2-8e50-4497-9f44-b096de9dd169 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:10.625593 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e25bd2-8e50-4497-9f44-b096de9dd169 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:10.637419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e25bd2-8e50-4497-9f44-b096de9dd169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-55e25bd2-8e50-4497-9f44-b096de9dd169 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:10.642301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:10.643197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:10.644012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:10.644012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:10.644012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:10.644012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:10.644012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:10.644012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:10.644012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:10.644012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:10.644012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:10.644012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:10.644012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:10.644012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:10.644012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 205/406] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:49:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:10.645140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:10.661950 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5663b-5059-4c0b-b52e-31b43f7f8033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:10.662618 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5663b-5059-4c0b-b52e-31b43f7f8033 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:10.662910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5663b-5059-4c0b-b52e-31b43f7f8033 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:10.663196 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5663b-5059-4c0b-b52e-31b43f7f8033 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:10.663774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e25bd2-8e50-4497-9f44-b096de9dd169 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:10.674755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5663b-5059-4c0b-b52e-31b43f7f8033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-70b5663b-5059-4c0b-b52e-31b43f7f8033 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:10.682318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:10.683410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:10.684218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:10.684218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:10.684218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:10.684218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:10.684218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:10.684218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:10.684218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:10.684218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:10.684218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:10.684218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:10.684218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:49:10.684218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:10.684218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 202/407] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:49:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:10.692150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5663b-5059-4c0b-b52e-31b43f7f8033 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:10.824871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5663b-5059-4c0b-b52e-31b43f7f8033 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:10.869880 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e25bd2-8e50-4497-9f44-b096de9dd169 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:10.905667 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bf659-fbda-463b-a7e7-d80b312f15c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:10.906313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bf659-fbda-463b-a7e7-d80b312f15c5 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:10.906585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bf659-fbda-463b-a7e7-d80b312f15c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:10.906872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bf659-fbda-463b-a7e7-d80b312f15c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:10.907747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bf659-fbda-463b-a7e7-d80b312f15c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:10.908055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bf659-fbda-463b-a7e7-d80b312f15c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:10.909231 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ac99d-20b9-4ba0-8396-3a2a11b80dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:10.909674 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bf659-fbda-463b-a7e7-d80b312f15c5 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:10.910482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ac99d-20b9-4ba0-8396-3a2a11b80dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:10.911170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ac99d-20b9-4ba0-8396-3a2a11b80dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:10.911631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ac99d-20b9-4ba0-8396-3a2a11b80dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:10.912521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ac99d-20b9-4ba0-8396-3a2a11b80dd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:10.913009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ac99d-20b9-4ba0-8396-3a2a11b80dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:10.914622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ac99d-20b9-4ba0-8396-3a2a11b80dd0 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:10.925013 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 206/408] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:10.930844 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ac99d-20b9-4ba0-8396-3a2a11b80dd0 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:10.932058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 203/409] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:10.936002 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bf659-fbda-463b-a7e7-d80b312f15c5 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:10.961410 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:11.038961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:11.125991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bf659-fbda-463b-a7e7-d80b312f15c5 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:11.138015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ac99d-20b9-4ba0-8396-3a2a11b80dd0 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:11.190784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ada3b-baf4-4ef1-bae9-987dc80d89ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:11.191420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ada3b-baf4-4ef1-bae9-987dc80d89ef None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:11.192011 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ada3b-baf4-4ef1-bae9-987dc80d89ef None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:11.192278 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ada3b-baf4-4ef1-bae9-987dc80d89ef None admin] PATH_INFO: `/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:11.194054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ada3b-baf4-4ef1-bae9-987dc80d89ef None admin] RBAC: Authorizing `identity:get_group(group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:11.195530 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ada3b-baf4-4ef1-bae9-987dc80d89ef None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:11.200739 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab3122-abc0-43ec-b35c-18dffc9f28f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:11.201386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab3122-abc0-43ec-b35c-18dffc9f28f1 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:11.201666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab3122-abc0-43ec-b35c-18dffc9f28f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:11.201936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab3122-abc0-43ec-b35c-18dffc9f28f1 None admin] PATH_INFO: `/v3/groups/e134846c902046c9acf1f4f6ad98ad1c` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:11.203102 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab3122-abc0-43ec-b35c-18dffc9f28f1 None admin] RBAC: Authorizing `identity:get_group(group_id=e134846c902046c9acf1f4f6ad98ad1c)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:11.204557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab3122-abc0-43ec-b35c-18dffc9f28f1 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:11.206151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 207/411] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:10 2022] GET /identity/v3/groups/e134846c902046c9acf1f4f6ad98ad1c => generated 229 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:11.206929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab3122-abc0-43ec-b35c-18dffc9f28f1 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:11.207257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 204/411] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:10 2022] GET /identity/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:11.215715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ada3b-baf4-4ef1-bae9-987dc80d89ef None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:11.341332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:11.374947 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ada3b-baf4-4ef1-bae9-987dc80d89ef None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:11.388085 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab3122-abc0-43ec-b35c-18dffc9f28f1 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:11.400368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:11.427574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090d11f-b3d7-41fa-a609-42bd9c3661f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:11.428219 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090d11f-b3d7-41fa-a609-42bd9c3661f1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:11.428500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090d11f-b3d7-41fa-a609-42bd9c3661f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:11.428768 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090d11f-b3d7-41fa-a609-42bd9c3661f1 None admin] PATH_INFO: `/v3/projects/29b6132ef8cb45a795d9be0f08083084` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:11.429972 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090d11f-b3d7-41fa-a609-42bd9c3661f1 None admin] RBAC: Authorizing `identity:get_project(project_id=29b6132ef8cb45a795d9be0f08083084)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:11.432069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090d11f-b3d7-41fa-a609-42bd9c3661f1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:11.434200 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 205/412] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:11 2022] GET /identity/v3/projects/29b6132ef8cb45a795d9be0f08083084 => generated 344 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:11.435699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee58fc0-edd9-4087-bff9-47204cfa4084 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:11.435979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee58fc0-edd9-4087-bff9-47204cfa4084 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:11.436250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee58fc0-edd9-4087-bff9-47204cfa4084 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:11.438362 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 206/413] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:11.444215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee58fc0-edd9-4087-bff9-47204cfa4084 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:11.452511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49839d68-da69-44c6-a8a8-aab67ef6bb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:11.453365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49839d68-da69-44c6-a8a8-aab67ef6bb96 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:11.453845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49839d68-da69-44c6-a8a8-aab67ef6bb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:11.454258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49839d68-da69-44c6-a8a8-aab67ef6bb96 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:11.455707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49839d68-da69-44c6-a8a8-aab67ef6bb96 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:11.457516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49839d68-da69-44c6-a8a8-aab67ef6bb96 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:11.459754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 208/414] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:11 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:11.466089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6d1b6-22bf-44a4-a2ff-f0d58cecb147 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:11.466569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6d1b6-22bf-44a4-a2ff-f0d58cecb147 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:11.467004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6d1b6-22bf-44a4-a2ff-f0d58cecb147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:11.486874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-8ba6d1b6-22bf-44a4-a2ff-f0d58cecb147 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:11.488332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8ba6d1b6-22bf-44a4-a2ff-f0d58cecb147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:11.560395 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee58fc0-edd9-4087-bff9-47204cfa4084 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:11.574677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 209/415] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:11.575824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6d1b6-22bf-44a4-a2ff-f0d58cecb147 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:11.619847 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90efb21-fe9b-4b01-a9b5-d913e43e0d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:11.622028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90efb21-fe9b-4b01-a9b5-d913e43e0d13 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:11.622538 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90efb21-fe9b-4b01-a9b5-d913e43e0d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:11.623136 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90efb21-fe9b-4b01-a9b5-d913e43e0d13 None admin] PATH_INFO: `/v3/projects/29b6132ef8cb45a795d9be0f08083084/groups/e134846c902046c9acf1f4f6ad98ad1c/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:11.628140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90efb21-fe9b-4b01-a9b5-d913e43e0d13 None admin] RBAC: Authorizing `identity:create_grant(project_id=29b6132ef8cb45a795d9be0f08083084, group_id=e134846c902046c9acf1f4f6ad98ad1c, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:11.631399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90efb21-fe9b-4b01-a9b5-d913e43e0d13 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:11.655840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 207/416] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Aug 22 15:49:11 2022] PUT /identity/v3/projects/29b6132ef8cb45a795d9be0f08083084/groups/e134846c902046c9acf1f4f6ad98ad1c/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:49:11.719078 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:11.749269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6d1b6-22bf-44a4-a2ff-f0d58cecb147 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:11.796876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec9041-14b3-45eb-b67d-597fad261d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:11.797834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9041-14b3-45eb-b67d-597fad261d93 None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:11.798260 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9041-14b3-45eb-b67d-597fad261d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:11.798703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec9041-14b3-45eb-b67d-597fad261d93 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f/roles/64aca4dbf153454d8abb3af690d90c76` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:11.801096 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec9041-14b3-45eb-b67d-597fad261d93 None admin] RBAC: Authorizing `identity:create_grant(project_id=e27bb360e92e43f2bdebf830fd0ff33b, group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f, role_id=64aca4dbf153454d8abb3af690d90c76)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:11.802821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec9041-14b3-45eb-b67d-597fad261d93 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:11.818690 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 210/417] 10.222.0.77 () {58 vars in 1442 bytes} [Mon Aug 22 15:49:11 2022] PUT /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f/roles/64aca4dbf153454d8abb3af690d90c76 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:49:11.894480 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90efb21-fe9b-4b01-a9b5-d913e43e0d13 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:11.954539 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:12.025892 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90efb21-fe9b-4b01-a9b5-d913e43e0d13 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:12.034805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e33e5a-6164-4c1f-959e-2893991a315f None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:12.035315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e33e5a-6164-4c1f-959e-2893991a315f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:12.035546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e33e5a-6164-4c1f-959e-2893991a315f None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:12.037153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 211/418] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:12.042800 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ae53d-683f-4054-a84b-3d8706ca160e None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:12.043203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ae53d-683f-4054-a84b-3d8706ca160e None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:12.043560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ae53d-683f-4054-a84b-3d8706ca160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:12.069997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-bc5ae53d-683f-4054-a84b-3d8706ca160e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:12.071241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bc5ae53d-683f-4054-a84b-3d8706ca160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:12.082944 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579a23c-56fa-4854-bed5-feea5b18e8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:12.083611 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579a23c-56fa-4854-bed5-feea5b18e8de None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:12.083852 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579a23c-56fa-4854-bed5-feea5b18e8de None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:12.084115 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579a23c-56fa-4854-bed5-feea5b18e8de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:12.101615 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579a23c-56fa-4854-bed5-feea5b18e8de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7579a23c-56fa-4854-bed5-feea5b18e8de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:12.110836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:12.111826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:12.112627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:12.112627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:12.112627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:12.112627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:12.112627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:12.112627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:12.112627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:12.112627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:12.112627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:12.112627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:12.112627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:49:12.112627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:12.112627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 208/419] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:49:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:12.122264 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579a23c-56fa-4854-bed5-feea5b18e8de None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:12.233169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579a23c-56fa-4854-bed5-feea5b18e8de None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:12.240802 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:12.264550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 212/420] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:12.270232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29694c1-edc2-44e2-aae5-be5cd29e4b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:12.271060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29694c1-edc2-44e2-aae5-be5cd29e4b9a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:12.271338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29694c1-edc2-44e2-aae5-be5cd29e4b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:12.271606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29694c1-edc2-44e2-aae5-be5cd29e4b9a None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:12.272272 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29694c1-edc2-44e2-aae5-be5cd29e4b9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:12.272568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29694c1-edc2-44e2-aae5-be5cd29e4b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:12.274029 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29694c1-edc2-44e2-aae5-be5cd29e4b9a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:12.283314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 209/421] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:12.289467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ae53d-683f-4054-a84b-3d8706ca160e None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:12.327704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cc4f2-677c-4bd5-8478-9e3304a51c0b None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:12.328343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cc4f2-677c-4bd5-8478-9e3304a51c0b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:12.328622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cc4f2-677c-4bd5-8478-9e3304a51c0b None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:12.331862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 210/422] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:49:12.336448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218526-2400-4bce-b510-168443c3d537 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:12.336738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218526-2400-4bce-b510-168443c3d537 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:12.337011 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218526-2400-4bce-b510-168443c3d537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:12.371202 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-70218526-2400-4bce-b510-168443c3d537 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:12.374090 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-70218526-2400-4bce-b510-168443c3d537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:12.417782 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:12.461145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ae53d-683f-4054-a84b-3d8706ca160e None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:12.502335 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cca73-938e-454e-ad80-57e734516298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:12.504523 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cca73-938e-454e-ad80-57e734516298 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:12.504813 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cca73-938e-454e-ad80-57e734516298 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:12.505082 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cca73-938e-454e-ad80-57e734516298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:12.527141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 211/423] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:12.583792 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70218526-2400-4bce-b510-168443c3d537 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:12.618297 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cca73-938e-454e-ad80-57e734516298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:12.619833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cca73-938e-454e-ad80-57e734516298 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:12.693174 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:12.729440 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 213/424] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:12.730738 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cca73-938e-454e-ad80-57e734516298 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:12.831431 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cca73-938e-454e-ad80-57e734516298 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:12.846818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:12.858341 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70218526-2400-4bce-b510-168443c3d537 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:12.871378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5a3a1-b835-40f6-9f13-731033e4fc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:12.872781 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5a3a1-b835-40f6-9f13-731033e4fc5c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:12.873069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5a3a1-b835-40f6-9f13-731033e4fc5c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:12.873345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5a3a1-b835-40f6-9f13-731033e4fc5c None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:12.874542 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5a3a1-b835-40f6-9f13-731033e4fc5c None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:12.876109 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5a3a1-b835-40f6-9f13-731033e4fc5c None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:12.877973 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 214/425] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:12 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:12.878699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5a3a1-b835-40f6-9f13-731033e4fc5c None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:12.918540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e0540-9fb0-457f-92a4-893923f01270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:12.919904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e0540-9fb0-457f-92a4-893923f01270 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:12.920398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e0540-9fb0-457f-92a4-893923f01270 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:12.920891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e0540-9fb0-457f-92a4-893923f01270 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:12.927251 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:12.935383 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e0540-9fb0-457f-92a4-893923f01270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-843e0540-9fb0-457f-92a4-893923f01270 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:12.941884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:12.942857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:12.943659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:12.943659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:12.943659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:12.943659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:12.943659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:12.943659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:12.943659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:12.943659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:12.943659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:12.943659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:12.943659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:49:12.943659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:12.947117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 212/426] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:12.948216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e0540-9fb0-457f-92a4-893923f01270 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:13.010149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5a3a1-b835-40f6-9f13-731033e4fc5c None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:13.053493 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99041ffa-6ec5-4d2b-8211-79e12ac1c1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:13.055263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99041ffa-6ec5-4d2b-8211-79e12ac1c1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:13.055759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99041ffa-6ec5-4d2b-8211-79e12ac1c1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:13.056039 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99041ffa-6ec5-4d2b-8211-79e12ac1c1a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:13.073389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99041ffa-6ec5-4d2b-8211-79e12ac1c1a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-99041ffa-6ec5-4d2b-8211-79e12ac1c1a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:13.083145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:13.084074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:13.084864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:13.084864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:13.084864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:13.084864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:13.084864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:13.084864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:13.084864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:13.084864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:13.084864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:13.084864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:13.084864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 15:49:13.084864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:13.091038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 215/427] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:13.092118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e0540-9fb0-457f-92a4-893923f01270 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:13.092659 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99041ffa-6ec5-4d2b-8211-79e12ac1c1a9 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:13.142220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cb110-4d65-4c7a-a9b9-83bf821ae11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:13.142890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb110-4d65-4c7a-a9b9-83bf821ae11c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:13.143170 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb110-4d65-4c7a-a9b9-83bf821ae11c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:13.143438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cb110-4d65-4c7a-a9b9-83bf821ae11c None admin] PATH_INFO: `/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:13.144674 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cb110-4d65-4c7a-a9b9-83bf821ae11c None admin] RBAC: Authorizing `identity:get_group(group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:13.146169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cb110-4d65-4c7a-a9b9-83bf821ae11c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:13.148776 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 213/428] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:12 2022] GET /identity/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:13.149614 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cb110-4d65-4c7a-a9b9-83bf821ae11c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:13.191011 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:13.228333 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:13.237540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99041ffa-6ec5-4d2b-8211-79e12ac1c1a9 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:13.284413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85570a79-5b37-41ae-8d50-0534664e59fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:13.285059 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85570a79-5b37-41ae-8d50-0534664e59fb None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:13.285345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85570a79-5b37-41ae-8d50-0534664e59fb None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:13.285618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85570a79-5b37-41ae-8d50-0534664e59fb None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:13.285745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cb110-4d65-4c7a-a9b9-83bf821ae11c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:13.286298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85570a79-5b37-41ae-8d50-0534664e59fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:13.286611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85570a79-5b37-41ae-8d50-0534664e59fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:13.289022 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85570a79-5b37-41ae-8d50-0534664e59fb None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:13.300829 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 216/429] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:49:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:13.302140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85570a79-5b37-41ae-8d50-0534664e59fb None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:13.336060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab71548-46cc-4d80-842e-cbf6ea0c2568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:13.336624 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab71548-46cc-4d80-842e-cbf6ea0c2568 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:13.336902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab71548-46cc-4d80-842e-cbf6ea0c2568 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:13.337171 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab71548-46cc-4d80-842e-cbf6ea0c2568 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:13.337843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab71548-46cc-4d80-842e-cbf6ea0c2568 None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:13.338143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab71548-46cc-4d80-842e-cbf6ea0c2568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:13.339730 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab71548-46cc-4d80-842e-cbf6ea0c2568 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:13.354926 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 214/430] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:49:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:13.355944 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab71548-46cc-4d80-842e-cbf6ea0c2568 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:13.422004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85570a79-5b37-41ae-8d50-0534664e59fb None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:13.450093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:13.458362 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adfa66-d2c8-43dc-bd82-1cc7a939b016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:13.459377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adfa66-d2c8-43dc-bd82-1cc7a939b016 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:13.459864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adfa66-d2c8-43dc-bd82-1cc7a939b016 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:13.460364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adfa66-d2c8-43dc-bd82-1cc7a939b016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:13.461325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adfa66-d2c8-43dc-bd82-1cc7a939b016 None admin] RBAC: Adding query filter params (group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f, role.id=64aca4dbf153454d8abb3af690d90c76, scope.project.id=25b73a36dde84c9d97a80501da4f16d0) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:13.461820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adfa66-d2c8-43dc-bd82-1cc7a939b016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:13.463467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adfa66-d2c8-43dc-bd82-1cc7a939b016 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:13.469645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab71548-46cc-4d80-842e-cbf6ea0c2568 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:13.471142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 217/431] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 22 15:49:13 2022] GET /identity/v3/role_assignments?group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f&scope.project.id=25b73a36dde84c9d97a80501da4f16d0&role.id=64aca4dbf153454d8abb3af690d90c76 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:13.472136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adfa66-d2c8-43dc-bd82-1cc7a939b016 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:13.537129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:13.539693 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2a24d-b9e0-43de-a135-719d9fa10d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:13.540829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a24d-b9e0-43de-a135-719d9fa10d23 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:13.541334 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a24d-b9e0-43de-a135-719d9fa10d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:13.541788 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2a24d-b9e0-43de-a135-719d9fa10d23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:13.671183 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2a24d-b9e0-43de-a135-719d9fa10d23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:13.673386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2a24d-b9e0-43de-a135-719d9fa10d23 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:13.704028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adfa66-d2c8-43dc-bd82-1cc7a939b016 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:13.771404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812fccb-70e0-4a54-8635-5bef422413f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:13.774371 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812fccb-70e0-4a54-8635-5bef422413f7 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:13.775325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812fccb-70e0-4a54-8635-5bef422413f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:13.776109 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812fccb-70e0-4a54-8635-5bef422413f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:13.794993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:13.802574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 215/432] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:13.809971 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2a24d-b9e0-43de-a135-719d9fa10d23 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:13.929688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812fccb-70e0-4a54-8635-5bef422413f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:13.932160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812fccb-70e0-4a54-8635-5bef422413f7 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:13.934020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2a24d-b9e0-43de-a135-719d9fa10d23 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:13.971531 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a0620-66bf-4dcb-ae08-208230d15977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:13.972177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a0620-66bf-4dcb-ae08-208230d15977 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:13.972454 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a0620-66bf-4dcb-ae08-208230d15977 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:13.972727 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a0620-66bf-4dcb-ae08-208230d15977 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:13.973914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a0620-66bf-4dcb-ae08-208230d15977 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:13.975414 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a0620-66bf-4dcb-ae08-208230d15977 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:13.976786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:13.977371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 216/433] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:13 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:13.978702 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854c8a2-2377-44b9-b4e1-bb88ee678c69 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:13.979285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854c8a2-2377-44b9-b4e1-bb88ee678c69 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:13.979285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854c8a2-2377-44b9-b4e1-bb88ee678c69 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:13.980726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 217/434] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:13.983574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854c8a2-2377-44b9-b4e1-bb88ee678c69 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:14.048392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:14.086503 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 218/435] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:14.088399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea681db4-5cd1-48a2-ade8-b0acde179547 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:14.088692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea681db4-5cd1-48a2-ade8-b0acde179547 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:14.089305 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea681db4-5cd1-48a2-ade8-b0acde179547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:14.099745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854c8a2-2377-44b9-b4e1-bb88ee678c69 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:14.107859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-ea681db4-5cd1-48a2-ade8-b0acde179547 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:14.109060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ea681db4-5cd1-48a2-ade8-b0acde179547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:14.135092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fb26c-cecd-4ce9-9a9c-39256fdaf2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:14.135725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fb26c-cecd-4ce9-9a9c-39256fdaf2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:14.135993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fb26c-cecd-4ce9-9a9c-39256fdaf2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:14.136263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fb26c-cecd-4ce9-9a9c-39256fdaf2d6 None admin] PATH_INFO: `/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:14.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fb26c-cecd-4ce9-9a9c-39256fdaf2d6 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:14.138983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fb26c-cecd-4ce9-9a9c-39256fdaf2d6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:14.140594 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 218/436] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:13 2022] GET /identity/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:14.141760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae66870-2073-4d47-b933-f1ea6eab35c2 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:14.142032 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae66870-2073-4d47-b933-f1ea6eab35c2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:14.142293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae66870-2073-4d47-b933-f1ea6eab35c2 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:14.143606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 219/437] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:14.144337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae66870-2073-4d47-b933-f1ea6eab35c2 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:14.189599 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 219/438] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:14.190484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea681db4-5cd1-48a2-ade8-b0acde179547 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:14.257546 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae66870-2073-4d47-b933-f1ea6eab35c2 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:14.258808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:14.281716 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:14.306916 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95126931-cf04-48bf-8b48-189372e759c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:14.307566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126931-cf04-48bf-8b48-189372e759c0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:14.307843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126931-cf04-48bf-8b48-189372e759c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:14.308114 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126931-cf04-48bf-8b48-189372e759c0 None admin] PATH_INFO: `/v3/projects/25b73a36dde84c9d97a80501da4f16d0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:14.309327 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95126931-cf04-48bf-8b48-189372e759c0 None admin] RBAC: Authorizing `identity:get_project(project_id=25b73a36dde84c9d97a80501da4f16d0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:14.310824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95126931-cf04-48bf-8b48-189372e759c0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:14.312510 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 220/439] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:14 2022] GET /identity/v3/projects/25b73a36dde84c9d97a80501da4f16d0 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:14.313832 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122359c-a576-400f-a5f6-595cf3125d43 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:14.314108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122359c-a576-400f-a5f6-595cf3125d43 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:14.314377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122359c-a576-400f-a5f6-595cf3125d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:14.341416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea681db4-5cd1-48a2-ade8-b0acde179547 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:14.344937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7122359c-a576-400f-a5f6-595cf3125d43 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:14.346478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7122359c-a576-400f-a5f6-595cf3125d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:14.394127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5d5df-bfad-457f-b15e-238c04869094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:14.394789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5d5df-bfad-457f-b15e-238c04869094 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:14.395070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5d5df-bfad-457f-b15e-238c04869094 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:14.395344 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5d5df-bfad-457f-b15e-238c04869094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:14.396129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5d5df-bfad-457f-b15e-238c04869094 None admin] RBAC: Adding query filter params (group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f, role.id=f866ebebacd841168b26ac7ec2c7461b, scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:14.396436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5d5df-bfad-457f-b15e-238c04869094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:14.398651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5d5df-bfad-457f-b15e-238c04869094 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:14.405361 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 220/440] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 22 15:49:14 2022] GET /identity/v3/role_assignments?group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f&scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b&role.id=f866ebebacd841168b26ac7ec2c7461b => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:14.406829 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5d5df-bfad-457f-b15e-238c04869094 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:14.462228 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 221/441] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:14.473138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122359c-a576-400f-a5f6-595cf3125d43 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:14.543684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5d5df-bfad-457f-b15e-238c04869094 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:14.571436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:14.596801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c5e92-7a33-451d-84cb-bf973b82b5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:14.597557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5e92-7a33-451d-84cb-bf973b82b5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:14.597894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5e92-7a33-451d-84cb-bf973b82b5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:14.598162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c5e92-7a33-451d-84cb-bf973b82b5c1 None admin] PATH_INFO: `/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:14.599435 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c5e92-7a33-451d-84cb-bf973b82b5c1 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:14.600919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c5e92-7a33-451d-84cb-bf973b82b5c1 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:14.602540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 221/442] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:14 2022] GET /identity/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:14.609402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c5e92-7a33-451d-84cb-bf973b82b5c1 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:14.624914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122359c-a576-400f-a5f6-595cf3125d43 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:14.643495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:14.668441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc531944-22f9-4ad1-a2d4-6443f4cb0dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:14.669116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc531944-22f9-4ad1-a2d4-6443f4cb0dcb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:14.669397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc531944-22f9-4ad1-a2d4-6443f4cb0dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:14.669670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc531944-22f9-4ad1-a2d4-6443f4cb0dcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:14.680748 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc531944-22f9-4ad1-a2d4-6443f4cb0dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-dc531944-22f9-4ad1-a2d4-6443f4cb0dcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:14.685821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:14.686759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:14.687553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:14.687553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:14.687553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:14.687553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:14.687553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:14.687553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:14.687553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:14.687553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:14.687553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:14.687553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:14.687553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:14.687553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:14.690745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 222/443] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:49:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:14.693074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc531944-22f9-4ad1-a2d4-6443f4cb0dcb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:14.728058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c5e92-7a33-451d-84cb-bf973b82b5c1 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:14.762666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0a6f3-5c58-4315-8ff8-ac8db6fd3ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:14.763302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0a6f3-5c58-4315-8ff8-ac8db6fd3ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:14.763575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0a6f3-5c58-4315-8ff8-ac8db6fd3ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:14.763856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0a6f3-5c58-4315-8ff8-ac8db6fd3ee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:14.764629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0a6f3-5c58-4315-8ff8-ac8db6fd3ee9 None admin] RBAC: Adding query filter params (group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f, role.id=f866ebebacd841168b26ac7ec2c7461b, scope.project.id=25b73a36dde84c9d97a80501da4f16d0) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:14.764935 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0a6f3-5c58-4315-8ff8-ac8db6fd3ee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:14.766407 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0a6f3-5c58-4315-8ff8-ac8db6fd3ee9 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:14.772617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 222/444] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 22 15:49:14 2022] GET /identity/v3/role_assignments?group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f&scope.project.id=25b73a36dde84c9d97a80501da4f16d0&role.id=f866ebebacd841168b26ac7ec2c7461b => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:14.773446 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0a6f3-5c58-4315-8ff8-ac8db6fd3ee9 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:14.805299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc531944-22f9-4ad1-a2d4-6443f4cb0dcb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:14.846773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:14.849367 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3c461-a6f4-43a4-a0a8-02dd91d054f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:14.850167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c461-a6f4-43a4-a0a8-02dd91d054f9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:14.850486 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c461-a6f4-43a4-a0a8-02dd91d054f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:14.850768 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3c461-a6f4-43a4-a0a8-02dd91d054f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:14.851580 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3c461-a6f4-43a4-a0a8-02dd91d054f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:14.852431 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3c461-a6f4-43a4-a0a8-02dd91d054f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:14.853329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3c461-a6f4-43a4-a0a8-02dd91d054f9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:14.863839 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 223/445] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:14.872806 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3c461-a6f4-43a4-a0a8-02dd91d054f9 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:14.924652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0a6f3-5c58-4315-8ff8-ac8db6fd3ee9 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:14.931702 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:14.974470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30174ec-f9c9-4fa9-b560-e4bc1eb4ede1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:14.975314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30174ec-f9c9-4fa9-b560-e4bc1eb4ede1 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:14.975537 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30174ec-f9c9-4fa9-b560-e4bc1eb4ede1 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:14.975780 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30174ec-f9c9-4fa9-b560-e4bc1eb4ede1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:14.992174 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30174ec-f9c9-4fa9-b560-e4bc1eb4ede1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-d30174ec-f9c9-4fa9-b560-e4bc1eb4ede1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:15.001455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:15.002462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:15.003298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:15.003298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:15.003298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:15.003298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:15.003298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:15.003298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:15.003298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:15.003298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:15.003298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:15.003298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:15.003298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:49:15.003298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:15.003929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 223/446] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:49:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:15.009920 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30174ec-f9c9-4fa9-b560-e4bc1eb4ede1 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:15.028415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3c461-a6f4-43a4-a0a8-02dd91d054f9 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:15.091605 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60602ed8-61fe-4b78-8820-721fc94379ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:15.092294 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60602ed8-61fe-4b78-8820-721fc94379ab None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:15.092602 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60602ed8-61fe-4b78-8820-721fc94379ab None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:15.092963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60602ed8-61fe-4b78-8820-721fc94379ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:15.161338 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30174ec-f9c9-4fa9-b560-e4bc1eb4ede1 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:15.176995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:15.200186 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60602ed8-61fe-4b78-8820-721fc94379ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:15.201944 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60602ed8-61fe-4b78-8820-721fc94379ab None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:15.220161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec3a18-9f65-46e9-bd92-bd3a1c80bb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:15.220787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec3a18-9f65-46e9-bd92-bd3a1c80bb3e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:15.221061 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec3a18-9f65-46e9-bd92-bd3a1c80bb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:15.221329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec3a18-9f65-46e9-bd92-bd3a1c80bb3e None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:15.222693 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec3a18-9f65-46e9-bd92-bd3a1c80bb3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:15.222693 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec3a18-9f65-46e9-bd92-bd3a1c80bb3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:15.224023 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec3a18-9f65-46e9-bd92-bd3a1c80bb3e None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:15.234680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 224/447] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:15.240827 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec3a18-9f65-46e9-bd92-bd3a1c80bb3e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:15.274174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:15.372292 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 224/448] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 15:49:15.378081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60602ed8-61fe-4b78-8820-721fc94379ab None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:15.400643 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec3a18-9f65-46e9-bd92-bd3a1c80bb3e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:15.457365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa66027-d2fe-478a-a137-6f74edf9174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:15.458839 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa66027-d2fe-478a-a137-6f74edf9174a None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:15.458839 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa66027-d2fe-478a-a137-6f74edf9174a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:15.458839 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa66027-d2fe-478a-a137-6f74edf9174a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:15.513875 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:15.526936 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60602ed8-61fe-4b78-8820-721fc94379ab None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:15.546911 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa66027-d2fe-478a-a137-6f74edf9174a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:15.548526 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa66027-d2fe-478a-a137-6f74edf9174a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:15.568657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02975163-3a11-4c90-8d45-0899577d579e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:15.569294 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02975163-3a11-4c90-8d45-0899577d579e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:15.569560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02975163-3a11-4c90-8d45-0899577d579e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:15.569824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02975163-3a11-4c90-8d45-0899577d579e None admin] PATH_INFO: `/v3/projects/29b6132ef8cb45a795d9be0f08083084` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:15.571005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02975163-3a11-4c90-8d45-0899577d579e None admin] RBAC: Authorizing `identity:get_project(project_id=29b6132ef8cb45a795d9be0f08083084)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:15.572465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02975163-3a11-4c90-8d45-0899577d579e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:15.574102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 225/449] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:15 2022] GET /identity/v3/projects/29b6132ef8cb45a795d9be0f08083084 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:15.580530 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02975163-3a11-4c90-8d45-0899577d579e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:15.592968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:15.666458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 225/450] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:15.673079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa66027-d2fe-478a-a137-6f74edf9174a None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:15.688916 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02975163-3a11-4c90-8d45-0899577d579e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:15.727507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa418849-897e-40c4-a101-419f1f34fbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:15.727507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418849-897e-40c4-a101-419f1f34fbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:15.727507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418849-897e-40c4-a101-419f1f34fbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:15.727507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418849-897e-40c4-a101-419f1f34fbc9 None admin] PATH_INFO: `/v3/groups/e134846c902046c9acf1f4f6ad98ad1c` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:15.727972 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa418849-897e-40c4-a101-419f1f34fbc9 None admin] RBAC: Authorizing `identity:get_group(group_id=e134846c902046c9acf1f4f6ad98ad1c)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:15.728777 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa418849-897e-40c4-a101-419f1f34fbc9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:15.730368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 226/451] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:15 2022] GET /identity/v3/groups/e134846c902046c9acf1f4f6ad98ad1c => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:15.737087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa418849-897e-40c4-a101-419f1f34fbc9 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:15.758715 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:15.792537 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa66027-d2fe-478a-a137-6f74edf9174a None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:15.824876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:15.833628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349c2ce-961e-4641-91fe-9a4b8886ec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:15.834257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349c2ce-961e-4641-91fe-9a4b8886ec86 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:15.834524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349c2ce-961e-4641-91fe-9a4b8886ec86 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:15.834816 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349c2ce-961e-4641-91fe-9a4b8886ec86 None admin] PATH_INFO: `/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:15.835972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349c2ce-961e-4641-91fe-9a4b8886ec86 None admin] RBAC: Authorizing `identity:get_project(project_id=e27bb360e92e43f2bdebf830fd0ff33b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:15.837438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349c2ce-961e-4641-91fe-9a4b8886ec86 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:15.839125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 226/452] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:49:15 2022] GET /identity/v3/projects/e27bb360e92e43f2bdebf830fd0ff33b => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:15.844894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349c2ce-961e-4641-91fe-9a4b8886ec86 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:15.850622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa418849-897e-40c4-a101-419f1f34fbc9 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:15.887158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8fe22-dca1-49a0-bb5d-073062472055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:15.887764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8fe22-dca1-49a0-bb5d-073062472055 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:15.888035 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8fe22-dca1-49a0-bb5d-073062472055 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:15.888299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8fe22-dca1-49a0-bb5d-073062472055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:15.889030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8fe22-dca1-49a0-bb5d-073062472055 None admin] RBAC: Adding query filter params (group.id=e134846c902046c9acf1f4f6ad98ad1c, role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=29b6132ef8cb45a795d9be0f08083084) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:15.889432 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8fe22-dca1-49a0-bb5d-073062472055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:15.890792 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8fe22-dca1-49a0-bb5d-073062472055 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:15.910633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 227/453] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 22 15:49:15 2022] GET /identity/v3/role_assignments?group.id=e134846c902046c9acf1f4f6ad98ad1c&scope.project.id=29b6132ef8cb45a795d9be0f08083084&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:15.957287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349c2ce-961e-4641-91fe-9a4b8886ec86 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:15.996419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac5761-8b46-4fcd-a79d-650aac471829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:15.997068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac5761-8b46-4fcd-a79d-650aac471829 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:15.997345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac5761-8b46-4fcd-a79d-650aac471829 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:15.997615 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac5761-8b46-4fcd-a79d-650aac471829 None admin] PATH_INFO: `/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:15.998833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac5761-8b46-4fcd-a79d-650aac471829 None admin] RBAC: Authorizing `identity:get_group(group_id=ea8a6c2f0cd24a7e9e030bd74e724a9f)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:16.000325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac5761-8b46-4fcd-a79d-650aac471829 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:16.001959 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 227/454] 10.222.0.77 () {56 vars in 1180 bytes} [Mon Aug 22 15:49:15 2022] GET /identity/v3/groups/ea8a6c2f0cd24a7e9e030bd74e724a9f => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:16.008630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8fe22-dca1-49a0-bb5d-073062472055 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:16.135766 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8fe22-dca1-49a0-bb5d-073062472055 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:16.171256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b97c1-cd26-4c2a-91b3-2bd4e79b916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:16.171872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b97c1-cd26-4c2a-91b3-2bd4e79b916c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:16.172147 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b97c1-cd26-4c2a-91b3-2bd4e79b916c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:16.172411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b97c1-cd26-4c2a-91b3-2bd4e79b916c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:16.173145 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b97c1-cd26-4c2a-91b3-2bd4e79b916c None admin] RBAC: Adding query filter params (group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f, role.id=64aca4dbf153454d8abb3af690d90c76, scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:16.173447 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b97c1-cd26-4c2a-91b3-2bd4e79b916c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:16.174917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b97c1-cd26-4c2a-91b3-2bd4e79b916c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:16.183740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 228/455] 10.222.0.77 () {56 vars in 1376 bytes} [Mon Aug 22 15:49:16 2022] GET /identity/v3/role_assignments?group.id=ea8a6c2f0cd24a7e9e030bd74e724a9f&scope.project.id=e27bb360e92e43f2bdebf830fd0ff33b&role.id=64aca4dbf153454d8abb3af690d90c76 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:18.822341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55920c6-bd81-4b02-a598-9db0836a2880 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:18.822894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55920c6-bd81-4b02-a598-9db0836a2880 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:18.822894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55920c6-bd81-4b02-a598-9db0836a2880 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:18.824595 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 228/456] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:18.830460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb8c44-2bfc-4dd2-bfb5-0b999df17251 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:18.830962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb8c44-2bfc-4dd2-bfb5-0b999df17251 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:18.831035 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb8c44-2bfc-4dd2-bfb5-0b999df17251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:18.841587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:18.856329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-20eb8c44-2bfc-4dd2-bfb5-0b999df17251 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:18.857541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-20eb8c44-2bfc-4dd2-bfb5-0b999df17251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:18.934820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b7e65-be16-4a36-bdcc-82b2916e35c4 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:18.935461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b7e65-be16-4a36-bdcc-82b2916e35c4 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:18.935930 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b7e65-be16-4a36-bdcc-82b2916e35c4 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:18.938518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 229/457] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:49:18.945325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bde6b6-022d-4d9f-86eb-f80d3c1e0823 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:18.945642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bde6b6-022d-4d9f-86eb-f80d3c1e0823 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:18.945878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bde6b6-022d-4d9f-86eb-f80d3c1e0823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:18.961873 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:18.974494 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 229/458] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:49:18.975504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-78bde6b6-022d-4d9f-86eb-f80d3c1e0823 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:18.983481 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-78bde6b6-022d-4d9f-86eb-f80d3c1e0823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:19.076946 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 230/459] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:19.241064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a687f7-7ebc-4d93-ae08-7fbc32f15bfa None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:19.241394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a687f7-7ebc-4d93-ae08-7fbc32f15bfa None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:19.241628 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a687f7-7ebc-4d93-ae08-7fbc32f15bfa None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:19.243317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 230/460] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:19.249115 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cf4ac-a3d6-4ec1-a01b-ba960a4f8d7e None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:19.249405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cf4ac-a3d6-4ec1-a01b-ba960a4f8d7e None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:19.249670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cf4ac-a3d6-4ec1-a01b-ba960a4f8d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:19.274000 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-e28cf4ac-a3d6-4ec1-a01b-ba960a4f8d7e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:19.275275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e28cf4ac-a3d6-4ec1-a01b-ba960a4f8d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:19.326868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a687f7-7ebc-4d93-ae08-7fbc32f15bfa None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:19.400215 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 231/461] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:19.442720 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cf4ac-a3d6-4ec1-a01b-ba960a4f8d7e None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:19.522160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a687f7-7ebc-4d93-ae08-7fbc32f15bfa None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:19.559495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:19.568719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a46b16-33f0-44c7-b128-98c3b74878ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:19.570065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a46b16-33f0-44c7-b128-98c3b74878ae None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:19.570829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a46b16-33f0-44c7-b128-98c3b74878ae None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:19.571672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a46b16-33f0-44c7-b128-98c3b74878ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:19.575644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:19.586364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a46b16-33f0-44c7-b128-98c3b74878ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:19.591623 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a46b16-33f0-44c7-b128-98c3b74878ae None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-32a46b16-33f0-44c7-b128-98c3b74878ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:19.625829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:19.627076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:19.628250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:19.628250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:19.628250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:19.633174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 231/462] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:19.641079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cf4ac-a3d6-4ec1-a01b-ba960a4f8d7e None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:19.645658 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a46b16-33f0-44c7-b128-98c3b74878ae None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:19.694517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7c05b-0609-4b96-ae11-54ec3b56c701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:19.695594 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7c05b-0609-4b96-ae11-54ec3b56c701 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:19.696076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7c05b-0609-4b96-ae11-54ec3b56c701 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:19.696535 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7c05b-0609-4b96-ae11-54ec3b56c701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:19.708108 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7c05b-0609-4b96-ae11-54ec3b56c701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:19.710023 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7c05b-0609-4b96-ae11-54ec3b56c701 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-9ca7c05b-0609-4b96-ae11-54ec3b56c701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:19.726265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:19.727245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:19.728081 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:19.728081 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:19.728081 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:19.730287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 232/463] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:19.731841 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df29419-0bfc-4cf6-ace9-71a3d76ead75 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:19.732342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df29419-0bfc-4cf6-ace9-71a3d76ead75 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:19.732802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df29419-0bfc-4cf6-ace9-71a3d76ead75 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:19.734621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 233/464] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:19.745280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19334ebd-7fdf-4458-9ae8-f2e42c45eb2e None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:19.745594 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19334ebd-7fdf-4458-9ae8-f2e42c45eb2e None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:19.749154 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19334ebd-7fdf-4458-9ae8-f2e42c45eb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:19.767305 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-19334ebd-7fdf-4458-9ae8-f2e42c45eb2e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:19.768554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-19334ebd-7fdf-4458-9ae8-f2e42c45eb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:19.782864 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a46b16-33f0-44c7-b128-98c3b74878ae None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:19.821632 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757f3a7-0b20-4b1a-a2e6-91e25814a223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:19.822245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757f3a7-0b20-4b1a-a2e6-91e25814a223 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:19.822521 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757f3a7-0b20-4b1a-a2e6-91e25814a223 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:19.822821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757f3a7-0b20-4b1a-a2e6-91e25814a223 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:19.823481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757f3a7-0b20-4b1a-a2e6-91e25814a223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:19.823783 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757f3a7-0b20-4b1a-a2e6-91e25814a223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:19.825248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757f3a7-0b20-4b1a-a2e6-91e25814a223 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:19.839353 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 232/465] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:19.841374 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757f3a7-0b20-4b1a-a2e6-91e25814a223 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:19.862730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 234/466] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:19.864209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19334ebd-7fdf-4458-9ae8-f2e42c45eb2e None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:19.910768 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:19.928157 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:19.979413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757f3a7-0b20-4b1a-a2e6-91e25814a223 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:19.992232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19334ebd-7fdf-4458-9ae8-f2e42c45eb2e None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:20.015601 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b96fcb-ae36-42e6-bc6b-61a6152c8ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:20.016210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b96fcb-ae36-42e6-bc6b-61a6152c8ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:20.016557 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b96fcb-ae36-42e6-bc6b-61a6152c8ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:20.016744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b96fcb-ae36-42e6-bc6b-61a6152c8ae4 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:20.017389 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b96fcb-ae36-42e6-bc6b-61a6152c8ae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:20.017684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b96fcb-ae36-42e6-bc6b-61a6152c8ae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:20.019111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b96fcb-ae36-42e6-bc6b-61a6152c8ae4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:20.031511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995cfbe-0443-4557-9831-7d231c67ff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:20.031692 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 233/467] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:20.032543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b96fcb-ae36-42e6-bc6b-61a6152c8ae4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:20.032858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995cfbe-0443-4557-9831-7d231c67ff5f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:20.033457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995cfbe-0443-4557-9831-7d231c67ff5f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:20.033916 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995cfbe-0443-4557-9831-7d231c67ff5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:20.045851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995cfbe-0443-4557-9831-7d231c67ff5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:20.047733 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995cfbe-0443-4557-9831-7d231c67ff5f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-d995cfbe-0443-4557-9831-7d231c67ff5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:20.063489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:20.064458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:20.065314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:20.065314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:20.065314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:20.072322 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 235/468] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:20.073495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995cfbe-0443-4557-9831-7d231c67ff5f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:20.136965 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b96fcb-ae36-42e6-bc6b-61a6152c8ae4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:20.145489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:20.174655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:20.175877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fb6c2-6070-42e5-b4dd-0494a8fc4c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:20.176612 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb6c2-6070-42e5-b4dd-0494a8fc4c3c None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:20.176924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb6c2-6070-42e5-b4dd-0494a8fc4c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:20.177171 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb6c2-6070-42e5-b4dd-0494a8fc4c3c None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:20.177745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995cfbe-0443-4557-9831-7d231c67ff5f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:20.178112 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fb6c2-6070-42e5-b4dd-0494a8fc4c3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:20.180084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fb6c2-6070-42e5-b4dd-0494a8fc4c3c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:20.207014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 234/469] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:49:20 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:49:20.207948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fb6c2-6070-42e5-b4dd-0494a8fc4c3c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:20.216468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05608539-5e9a-4ddc-9e89-50214ea4e9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:20.217104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05608539-5e9a-4ddc-9e89-50214ea4e9b3 None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:20.217379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05608539-5e9a-4ddc-9e89-50214ea4e9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:20.217644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05608539-5e9a-4ddc-9e89-50214ea4e9b3 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:20.218317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05608539-5e9a-4ddc-9e89-50214ea4e9b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:20.220427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05608539-5e9a-4ddc-9e89-50214ea4e9b3 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:20.245378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 236/470] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:49:20 2022] POST /identity/v3/users => generated 248 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:49:20.246346 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05608539-5e9a-4ddc-9e89-50214ea4e9b3 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:20.352705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fb6c2-6070-42e5-b4dd-0494a8fc4c3c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:20.379888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05608539-5e9a-4ddc-9e89-50214ea4e9b3 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:20.394929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5037e1-6892-448f-97af-f75b2de0b422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:20.395996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5037e1-6892-448f-97af-f75b2de0b422 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:20.398015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5037e1-6892-448f-97af-f75b2de0b422 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:20.398015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5037e1-6892-448f-97af-f75b2de0b422 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:20.398629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5037e1-6892-448f-97af-f75b2de0b422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:20.398977 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5037e1-6892-448f-97af-f75b2de0b422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:20.400445 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5037e1-6892-448f-97af-f75b2de0b422 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:20.415129 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 235/471] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:20.415947 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500fe2c-bc26-4adb-840f-b8903e06fe58 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:20.416225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500fe2c-bc26-4adb-840f-b8903e06fe58 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:20.416870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500fe2c-bc26-4adb-840f-b8903e06fe58 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:20.418399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 236/472] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:20.422771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500fe2c-bc26-4adb-840f-b8903e06fe58 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:20.427758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2511b-091a-4287-911c-eba6151d0878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:20.428607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2511b-091a-4287-911c-eba6151d0878 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:20.428878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2511b-091a-4287-911c-eba6151d0878 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:20.429156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2511b-091a-4287-911c-eba6151d0878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:20.443921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2511b-091a-4287-911c-eba6151d0878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:20.445776 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2511b-091a-4287-911c-eba6151d0878 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:20.458449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-bec2511b-091a-4287-911c-eba6151d0878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:20.461769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:20.462802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:20.463632 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:20.463632 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:20.463632 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:20.463791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 237/473] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:20.470101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c8aec-4892-42aa-932c-1455f2c84604 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:20.470386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c8aec-4892-42aa-932c-1455f2c84604 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:20.470686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c8aec-4892-42aa-932c-1455f2c84604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:20.492153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-ad6c8aec-4892-42aa-932c-1455f2c84604 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:20.493375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ad6c8aec-4892-42aa-932c-1455f2c84604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:20.496616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:20.551315 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500fe2c-bc26-4adb-840f-b8903e06fe58 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:20.587768 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 238/474] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:20.589143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c8aec-4892-42aa-932c-1455f2c84604 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:20.593910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002dd88-1807-4258-8fc9-5e3f0235a44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:20.594527 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002dd88-1807-4258-8fc9-5e3f0235a44e None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:20.594836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002dd88-1807-4258-8fc9-5e3f0235a44e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:20.595119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002dd88-1807-4258-8fc9-5e3f0235a44e None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:20.595826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002dd88-1807-4258-8fc9-5e3f0235a44e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:20.597287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002dd88-1807-4258-8fc9-5e3f0235a44e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:20.632512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 237/475] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:49:20 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:49:20.729032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c8aec-4892-42aa-932c-1455f2c84604 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:20.776453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d198cbe-30f7-48be-9e84-f474574c6532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:20.777367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d198cbe-30f7-48be-9e84-f474574c6532 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:20.777815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d198cbe-30f7-48be-9e84-f474574c6532 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:20.778216 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d198cbe-30f7-48be-9e84-f474574c6532 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:20.779066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d198cbe-30f7-48be-9e84-f474574c6532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:20.779501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d198cbe-30f7-48be-9e84-f474574c6532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:20.781036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d198cbe-30f7-48be-9e84-f474574c6532 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:20.792948 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:20.800229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 239/476] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:20.805593 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002dd88-1807-4258-8fc9-5e3f0235a44e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:20.859547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d198cbe-30f7-48be-9e84-f474574c6532 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:20.943169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:20.979855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002dd88-1807-4258-8fc9-5e3f0235a44e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:20.997992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d198cbe-30f7-48be-9e84-f474574c6532 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:21.039551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294440e7-b826-4b8b-813f-0ed5b4199865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:21.040183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294440e7-b826-4b8b-813f-0ed5b4199865 None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:21.040462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294440e7-b826-4b8b-813f-0ed5b4199865 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:21.040732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294440e7-b826-4b8b-813f-0ed5b4199865 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:21.041511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294440e7-b826-4b8b-813f-0ed5b4199865 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:21.043026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294440e7-b826-4b8b-813f-0ed5b4199865 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:21.047962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff6fbe-a78c-404b-8493-78769c9a5dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:21.049238 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6fbe-a78c-404b-8493-78769c9a5dd6 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:21.049723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6fbe-a78c-404b-8493-78769c9a5dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:21.050034 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6fbe-a78c-404b-8493-78769c9a5dd6 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:21.050914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff6fbe-a78c-404b-8493-78769c9a5dd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:21.052419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.sql.core [None req-294440e7-b826-4b8b-813f-0ed5b4199865 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 15:49:21.052419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 15:49:21.052419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [parameters: {'id': '61c8fbad38394020b59d748277798835', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 15:49:21.052419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81660) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 15:49:21.052729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff6fbe-a78c-404b-8493-78769c9a5dd6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-294440e7-b826-4b8b-813f-0ed5b4199865 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application conn.query(q) Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application result.read() Aug 22 15:49:21.071932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return ref.to_dict() Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 15:49:21.073178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application next(self.gen) Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application yield resource Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application next(self.gen) Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise self.value Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application session.commit() Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 15:49:21.074591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self.session.flush() Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application compat.raise_( Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 15:49:21.076149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 15:49:21.080713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application conn.query(q) Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application result.read() Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 15:49:21.082620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [parameters: {'id': '61c8fbad38394020b59d748277798835', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:21.084438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 15:49:21.086426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:21.088689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 240/477] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Aug 22 15:49:20 2022] POST /identity/v3/roles => generated 144 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:21.088809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 238/478] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:49:20 2022] POST /identity/v3/users => generated 249 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:49:21.095864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294440e7-b826-4b8b-813f-0ed5b4199865 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:21.173662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:21.218462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294440e7-b826-4b8b-813f-0ed5b4199865 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:21.257331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058d78d-3301-491a-8ce8-7f5d4a1483b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:21.257905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058d78d-3301-491a-8ce8-7f5d4a1483b0 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:21.258181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058d78d-3301-491a-8ce8-7f5d4a1483b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:21.258449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058d78d-3301-491a-8ce8-7f5d4a1483b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:21.269442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058d78d-3301-491a-8ce8-7f5d4a1483b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-2058d78d-3301-491a-8ce8-7f5d4a1483b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:21.274742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:21.275608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:21.276392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:21.276392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:21.276392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:21.276392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:21.276392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:21.276392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:21.276392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:21.276392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:21.276392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:21.276392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:21.276392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 15:49:21.276392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:21.280760 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 241/479] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:49:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:21.282154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff6fbe-a78c-404b-8493-78769c9a5dd6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:21.401676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff6fbe-a78c-404b-8493-78769c9a5dd6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:21.437746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ab12a-aab6-4f4d-b24b-c1e7df0b1989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:21.438419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ab12a-aab6-4f4d-b24b-c1e7df0b1989 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:21.438727 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ab12a-aab6-4f4d-b24b-c1e7df0b1989 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:21.439050 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ab12a-aab6-4f4d-b24b-c1e7df0b1989 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:21.439825 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ab12a-aab6-4f4d-b24b-c1e7df0b1989 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:21.440077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ab12a-aab6-4f4d-b24b-c1e7df0b1989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:21.441804 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ab12a-aab6-4f4d-b24b-c1e7df0b1989 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:21.443356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:21.456396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 239/480] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:22.624659 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a38de-2857-4428-a327-ee0d08b6ec38 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:22.625340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a38de-2857-4428-a327-ee0d08b6ec38 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:22.625340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a38de-2857-4428-a327-ee0d08b6ec38 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:22.626741 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 242/481] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:22.632158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0838d8-fddb-48d6-880a-9a2cfc5f03c2 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:22.632687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0838d8-fddb-48d6-880a-9a2cfc5f03c2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:22.632687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0838d8-fddb-48d6-880a-9a2cfc5f03c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:22.659770 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4c0838d8-fddb-48d6-880a-9a2cfc5f03c2 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:22.660999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4c0838d8-fddb-48d6-880a-9a2cfc5f03c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:22.678495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaab44-b027-4b8f-97eb-d4a8d3b28a31 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:22.678793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaab44-b027-4b8f-97eb-d4a8d3b28a31 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:22.679133 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecaab44-b027-4b8f-97eb-d4a8d3b28a31 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:22.680814 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 243/482] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:22.685967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ea6ea-5dac-4647-9e37-8d71f8de7771 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:22.686267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ea6ea-5dac-4647-9e37-8d71f8de7771 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:22.686552 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ea6ea-5dac-4647-9e37-8d71f8de7771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:22.719076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-7e3ea6ea-5dac-4647-9e37-8d71f8de7771 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:22.720347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7e3ea6ea-5dac-4647-9e37-8d71f8de7771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:22.770408 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 240/483] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:22.840618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 244/484] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:49:23.058432 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0838d8-fddb-48d6-880a-9a2cfc5f03c2 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:23.199913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0838d8-fddb-48d6-880a-9a2cfc5f03c2 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:23.227333 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:23.237233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db7691-3006-49eb-a884-e6129aca81f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:23.238259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db7691-3006-49eb-a884-e6129aca81f7 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:23.238767 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db7691-3006-49eb-a884-e6129aca81f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:23.239230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db7691-3006-49eb-a884-e6129aca81f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:23.246269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f2887-3214-4953-a094-5b35d817178f None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:23.246882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f2887-3214-4953-a094-5b35d817178f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:23.247355 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f2887-3214-4953-a094-5b35d817178f None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:23.249156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 245/485] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:49:23.255354 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db7691-3006-49eb-a884-e6129aca81f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:23.260273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c03b-f373-4dbc-8eab-f85ef708f03c None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:23.260559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c03b-f373-4dbc-8eab-f85ef708f03c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:23.260833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0c03b-f373-4dbc-8eab-f85ef708f03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-a8db7691-3006-49eb-a884-e6129aca81f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:23.261437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:23.262311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:23.263127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:23.263127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:23.263127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:23.263127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:23.263127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:23.263127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:23.263127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:23.263127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:23.263127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:23.263127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:23.263127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:23.263127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:23.265671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 241/486] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:23.271745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db7691-3006-49eb-a884-e6129aca81f7 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:23.303738 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-50b0c03b-f373-4dbc-8eab-f85ef708f03c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:23.304946 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-50b0c03b-f373-4dbc-8eab-f85ef708f03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:23.367007 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:23.373742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 246/487] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:23.381012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0c03b-f373-4dbc-8eab-f85ef708f03c None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:23.450314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db7691-3006-49eb-a884-e6129aca81f7 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:23.547097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db258b-e551-4af0-9d3c-2fd786c9aa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:23.547721 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db258b-e551-4af0-9d3c-2fd786c9aa63 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:23.547995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db258b-e551-4af0-9d3c-2fd786c9aa63 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:23.548262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db258b-e551-4af0-9d3c-2fd786c9aa63 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:23.548942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db258b-e551-4af0-9d3c-2fd786c9aa63 None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:23.549235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db258b-e551-4af0-9d3c-2fd786c9aa63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:23.550633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db258b-e551-4af0-9d3c-2fd786c9aa63 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:23.568891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 242/488] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:23.575225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db258b-e551-4af0-9d3c-2fd786c9aa63 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:23.615532 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0c03b-f373-4dbc-8eab-f85ef708f03c None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:23.664608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9787cf-c3e8-4ba0-ab52-0992270f9125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:23.665679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9787cf-c3e8-4ba0-ab52-0992270f9125 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:23.665968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9787cf-c3e8-4ba0-ab52-0992270f9125 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:23.666234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9787cf-c3e8-4ba0-ab52-0992270f9125 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:23.668593 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:23.681555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9787cf-c3e8-4ba0-ab52-0992270f9125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-7a9787cf-c3e8-4ba0-ab52-0992270f9125 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:23.688799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:23.690045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:23.691703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:23.691703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:23.691703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:23.691703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:23.691703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:23.691703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:23.691703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:23.691703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:23.691703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:23.691703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:23.691703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:23.691703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:23.691703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 247/489] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:23.691703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9787cf-c3e8-4ba0-ab52-0992270f9125 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:23.740039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db258b-e551-4af0-9d3c-2fd786c9aa63 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:23.749348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:23.778319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e610736-db67-42b6-8add-ee861a76e469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:23.779295 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e610736-db67-42b6-8add-ee861a76e469 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:23.779747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e610736-db67-42b6-8add-ee861a76e469 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:23.780189 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e610736-db67-42b6-8add-ee861a76e469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:23.792174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e610736-db67-42b6-8add-ee861a76e469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:23.794008 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e610736-db67-42b6-8add-ee861a76e469 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-3e610736-db67-42b6-8add-ee861a76e469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:23.815626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:23.817397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:23.819049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:23.819049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:23.819049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:23.819049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 243/490] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:23.819049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e610736-db67-42b6-8add-ee861a76e469 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:23.831226 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9787cf-c3e8-4ba0-ab52-0992270f9125 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:23.872590 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1a406-4c43-4ee0-ba8c-061c666ae622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:23.873149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a406-4c43-4ee0-ba8c-061c666ae622 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:23.873447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a406-4c43-4ee0-ba8c-061c666ae622 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:23.873701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1a406-4c43-4ee0-ba8c-061c666ae622 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:23.885880 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1a406-4c43-4ee0-ba8c-061c666ae622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-d4b1a406-4c43-4ee0-ba8c-061c666ae622 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:23.891105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:23.892414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:23.893258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:23.893258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:23.893258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:23.893258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:23.893258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:23.893258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:23.893258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:23.893258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:23.893258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:23.893258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:23.893258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:23.893258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:23.893258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 248/491] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:23.893934 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db747210-f8ad-4390-ab8b-f47f71236903 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:23.893934 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db747210-f8ad-4390-ab8b-f47f71236903 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:23.894051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db747210-f8ad-4390-ab8b-f47f71236903 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:23.899498 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 249/492] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:23.900413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db747210-f8ad-4390-ab8b-f47f71236903 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:23.941127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:23.944389 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e610736-db67-42b6-8add-ee861a76e469 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:23.991955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314d81c-62c6-4da0-9ec6-e0a793f9fb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:23.992720 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d81c-62c6-4da0-9ec6-e0a793f9fb72 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:23.993153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d81c-62c6-4da0-9ec6-e0a793f9fb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:23.993570 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d81c-62c6-4da0-9ec6-e0a793f9fb72 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:23.994400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d81c-62c6-4da0-9ec6-e0a793f9fb72 None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:23.994785 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d81c-62c6-4da0-9ec6-e0a793f9fb72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:23.996458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d81c-62c6-4da0-9ec6-e0a793f9fb72 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:24.005715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 244/493] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:24.006576 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314d81c-62c6-4da0-9ec6-e0a793f9fb72 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:24.039405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db747210-f8ad-4390-ab8b-f47f71236903 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:24.042308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:24.080844 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07946e78-1010-4719-82cb-e05fc669fc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:24.081569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07946e78-1010-4719-82cb-e05fc669fc15 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:24.081847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07946e78-1010-4719-82cb-e05fc669fc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:24.082160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07946e78-1010-4719-82cb-e05fc669fc15 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:24.082953 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07946e78-1010-4719-82cb-e05fc669fc15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:24.083261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07946e78-1010-4719-82cb-e05fc669fc15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:24.084693 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07946e78-1010-4719-82cb-e05fc669fc15 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:24.097115 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 250/494] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:24.098389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e3b10-0e92-4d30-9771-9678d5741bae None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:24.098728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e3b10-0e92-4d30-9771-9678d5741bae None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:24.098980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e3b10-0e92-4d30-9771-9678d5741bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:24.118712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314d81c-62c6-4da0-9ec6-e0a793f9fb72 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:24.118998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-095e3b10-0e92-4d30-9771-9678d5741bae None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:24.120034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-095e3b10-0e92-4d30-9771-9678d5741bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:24.158365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4101bae-9e5b-44c1-bb0e-1f1d2d7cb144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:24.159176 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4101bae-9e5b-44c1-bb0e-1f1d2d7cb144 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:24.159626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4101bae-9e5b-44c1-bb0e-1f1d2d7cb144 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:24.159946 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4101bae-9e5b-44c1-bb0e-1f1d2d7cb144 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:24.160930 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4101bae-9e5b-44c1-bb0e-1f1d2d7cb144 None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:24.161439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4101bae-9e5b-44c1-bb0e-1f1d2d7cb144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:24.163233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4101bae-9e5b-44c1-bb0e-1f1d2d7cb144 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:24.175343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 245/495] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:24.176194 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4101bae-9e5b-44c1-bb0e-1f1d2d7cb144 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:24.191694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 251/496] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:24.197370 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b26ade-8485-4870-8a11-b2c0d8c38707 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:24.197655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b26ade-8485-4870-8a11-b2c0d8c38707 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:24.197932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b26ade-8485-4870-8a11-b2c0d8c38707 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:24.199508 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 252/497] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:24.200334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b26ade-8485-4870-8a11-b2c0d8c38707 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:24.214265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:24.309141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:24.316357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4101bae-9e5b-44c1-bb0e-1f1d2d7cb144 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:24.324231 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b26ade-8485-4870-8a11-b2c0d8c38707 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:24.358883 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9e618-388b-4fca-95ca-8a5e79e04141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:24.359483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9e618-388b-4fca-95ca-8a5e79e04141 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:24.359755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9e618-388b-4fca-95ca-8a5e79e04141 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:24.360022 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9e618-388b-4fca-95ca-8a5e79e04141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:24.366086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e25e2e-f80e-42f2-a208-fa3443a0e321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:24.366750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e25e2e-f80e-42f2-a208-fa3443a0e321 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:24.367029 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e25e2e-f80e-42f2-a208-fa3443a0e321 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:24.367303 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e25e2e-f80e-42f2-a208-fa3443a0e321 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:24.372963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9e618-388b-4fca-95ca-8a5e79e04141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:24.374427 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9e618-388b-4fca-95ca-8a5e79e04141 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:24.377367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e25e2e-f80e-42f2-a208-fa3443a0e321 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:24.378871 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e25e2e-f80e-42f2-a208-fa3443a0e321 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-a1f9e618-388b-4fca-95ca-8a5e79e04141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:24.388812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:24.389726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:24.390549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:24.390549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:24.390549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:24.390549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 246/498] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:24.390786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9e618-388b-4fca-95ca-8a5e79e04141 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-84e25e2e-f80e-42f2-a208-fa3443a0e321 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:24.398009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:24.398960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:24.400445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:24.400445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:24.400445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:24.400445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:24.400445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:24.400445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:24.400445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:24.400445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:24.400445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:49:24.400445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:24.402771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 253/499] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 22 15:49:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:24.405147 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8efc2e-820f-477a-8239-e825c80b3753 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:24.405877 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8efc2e-820f-477a-8239-e825c80b3753 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:24.406116 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8efc2e-820f-477a-8239-e825c80b3753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:24.427804 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-0f8efc2e-820f-477a-8239-e825c80b3753 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:24.429009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0f8efc2e-820f-477a-8239-e825c80b3753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:24.475431 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:24.496241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 254/500] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:24.497107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8efc2e-820f-477a-8239-e825c80b3753 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:24.499520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9e618-388b-4fca-95ca-8a5e79e04141 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:24.532784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba535a90-92ce-4788-a558-df1dfa1dccbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:24.533525 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba535a90-92ce-4788-a558-df1dfa1dccbb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:24.533796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba535a90-92ce-4788-a558-df1dfa1dccbb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:24.534075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba535a90-92ce-4788-a558-df1dfa1dccbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:24.545351 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba535a90-92ce-4788-a558-df1dfa1dccbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:24.546879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba535a90-92ce-4788-a558-df1dfa1dccbb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ba535a90-92ce-4788-a558-df1dfa1dccbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:24.562833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:24.563801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:24.564647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:24.564647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:24.564647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:24.564647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 247/501] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:24.564858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba535a90-92ce-4788-a558-df1dfa1dccbb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:24.596711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:24.619965 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8efc2e-820f-477a-8239-e825c80b3753 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:24.661056 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d3852-9d79-4904-9976-4c0f28780356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:24.661665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d3852-9d79-4904-9976-4c0f28780356 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:24.661983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d3852-9d79-4904-9976-4c0f28780356 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:24.662195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d3852-9d79-4904-9976-4c0f28780356 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:24.662902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d3852-9d79-4904-9976-4c0f28780356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:24.663158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d3852-9d79-4904-9976-4c0f28780356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:24.664621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d3852-9d79-4904-9976-4c0f28780356 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:24.669289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba535a90-92ce-4788-a558-df1dfa1dccbb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:24.681827 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 255/502] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:24.681827 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d3852-9d79-4904-9976-4c0f28780356 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:24.701484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:24.710148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e1d5d-06e2-4554-bb41-cfb37700c01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:24.710806 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e1d5d-06e2-4554-bb41-cfb37700c01d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:24.711086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e1d5d-06e2-4554-bb41-cfb37700c01d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:24.711356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e1d5d-06e2-4554-bb41-cfb37700c01d None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:24.712089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e1d5d-06e2-4554-bb41-cfb37700c01d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:24.712390 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e1d5d-06e2-4554-bb41-cfb37700c01d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:24.713833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e1d5d-06e2-4554-bb41-cfb37700c01d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:24.750458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 248/503] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 22 15:49:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:24.751347 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e1d5d-06e2-4554-bb41-cfb37700c01d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:24.785306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d3852-9d79-4904-9976-4c0f28780356 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:24.818454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ba5dd-7731-4d6e-bc88-150152af4fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:24.819101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ba5dd-7731-4d6e-bc88-150152af4fcd None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:24.819371 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ba5dd-7731-4d6e-bc88-150152af4fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:24.819636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ba5dd-7731-4d6e-bc88-150152af4fcd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:24.830019 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ba5dd-7731-4d6e-bc88-150152af4fcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-c84ba5dd-7731-4d6e-bc88-150152af4fcd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:24.835141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:24.836031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:24.836812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:24.836812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:24.836812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:24.836812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:24.836812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:24.836812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:24.836812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:24.836812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:24.836812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:24.836812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:24.836812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:24.836812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:24.836812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 256/504] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:24.837463 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ba5dd-7731-4d6e-bc88-150152af4fcd None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:24.841622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:24.861407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e1d5d-06e2-4554-bb41-cfb37700c01d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:24.899015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75004874-f48c-4bb7-9a56-0266d5ae7706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:24.899633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75004874-f48c-4bb7-9a56-0266d5ae7706 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:24.899897 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75004874-f48c-4bb7-9a56-0266d5ae7706 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:24.900169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75004874-f48c-4bb7-9a56-0266d5ae7706 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:24.900835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75004874-f48c-4bb7-9a56-0266d5ae7706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:24.901127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75004874-f48c-4bb7-9a56-0266d5ae7706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:24.902623 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75004874-f48c-4bb7-9a56-0266d5ae7706 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:24.914061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 249/505] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:24.914909 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75004874-f48c-4bb7-9a56-0266d5ae7706 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:24.946202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ba5dd-7731-4d6e-bc88-150152af4fcd None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:24.961666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:24.981056 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70138fb-4aeb-4d35-873e-5c13ba655ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:24.981697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70138fb-4aeb-4d35-873e-5c13ba655ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:24.981974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70138fb-4aeb-4d35-873e-5c13ba655ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:24.982244 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70138fb-4aeb-4d35-873e-5c13ba655ac9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:24.990049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70138fb-4aeb-4d35-873e-5c13ba655ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:24.991720 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70138fb-4aeb-4d35-873e-5c13ba655ac9 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-d70138fb-4aeb-4d35-873e-5c13ba655ac9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:25.003073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:25.004065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:25.004954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:25.004954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:25.004954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:25.004954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:25.004954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:25.004954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:25.004954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:25.004954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:25.004954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 15:49:25.004954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:25.004954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 257/506] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:25.004954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70138fb-4aeb-4d35-873e-5c13ba655ac9 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:25.019583 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75004874-f48c-4bb7-9a56-0266d5ae7706 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:25.053815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3243a-6ba6-4fc7-afab-bd1a989109ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:25.054428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3243a-6ba6-4fc7-afab-bd1a989109ce None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:25.054737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3243a-6ba6-4fc7-afab-bd1a989109ce None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:25.055017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3243a-6ba6-4fc7-afab-bd1a989109ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:25.066348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:25.106076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70138fb-4aeb-4d35-873e-5c13ba655ac9 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:25.124854 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3243a-6ba6-4fc7-afab-bd1a989109ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:25.126352 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3243a-6ba6-4fc7-afab-bd1a989109ce None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:25.139953 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b29444-092b-486c-8110-4e21cb30c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:25.140580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29444-092b-486c-8110-4e21cb30c903 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:25.140863 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29444-092b-486c-8110-4e21cb30c903 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:25.141134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29444-092b-486c-8110-4e21cb30c903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:25.152046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b29444-092b-486c-8110-4e21cb30c903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:25.153529 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b29444-092b-486c-8110-4e21cb30c903 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-f3b29444-092b-486c-8110-4e21cb30c903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:25.167635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:25.168604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:25.169561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:25.169561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:25.169561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:25.169561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 258/507] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:25.171398 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b29444-092b-486c-8110-4e21cb30c903 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:25.173083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:25.227382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 250/508] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:25.228210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3243a-6ba6-4fc7-afab-bd1a989109ce None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:25.272420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b29444-092b-486c-8110-4e21cb30c903 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:25.286330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:25.308852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a4196-c00a-4e7a-9822-854771e891e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:25.309469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a4196-c00a-4e7a-9822-854771e891e7 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:25.309772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a4196-c00a-4e7a-9822-854771e891e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:25.310037 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a4196-c00a-4e7a-9822-854771e891e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:25.310733 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a4196-c00a-4e7a-9822-854771e891e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:25.311035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a4196-c00a-4e7a-9822-854771e891e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:25.312433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a4196-c00a-4e7a-9822-854771e891e7 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:25.320881 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 259/509] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:25.321774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a4196-c00a-4e7a-9822-854771e891e7 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:25.328645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3243a-6ba6-4fc7-afab-bd1a989109ce None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:25.364238 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caa275-2c45-4f50-87bb-a5478c8c97ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:25.364937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caa275-2c45-4f50-87bb-a5478c8c97ba None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:25.365212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caa275-2c45-4f50-87bb-a5478c8c97ba None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:25.365487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caa275-2c45-4f50-87bb-a5478c8c97ba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:25.373057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19caa275-2c45-4f50-87bb-a5478c8c97ba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:25.374535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19caa275-2c45-4f50-87bb-a5478c8c97ba None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-19caa275-2c45-4f50-87bb-a5478c8c97ba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:25.387453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:25.388537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:25.389755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:25.389755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:25.389755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:25.389755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:25.389755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:25.389755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:25.389755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:25.389755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:25.389755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:49:25.389755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:25.389755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 251/510] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:25.389755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caa275-2c45-4f50-87bb-a5478c8c97ba None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:25.398416 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:25.427243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a4196-c00a-4e7a-9822-854771e891e7 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:25.461241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03fc52-971d-42d0-8c6c-8987340a5a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:25.461829 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03fc52-971d-42d0-8c6c-8987340a5a23 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:25.462099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03fc52-971d-42d0-8c6c-8987340a5a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:25.462363 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03fc52-971d-42d0-8c6c-8987340a5a23 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:25.463113 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03fc52-971d-42d0-8c6c-8987340a5a23 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:25.463410 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03fc52-971d-42d0-8c6c-8987340a5a23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:25.464886 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03fc52-971d-42d0-8c6c-8987340a5a23 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:25.491714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caa275-2c45-4f50-87bb-a5478c8c97ba None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:25.500657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 260/511] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Aug 22 15:49:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:25.501548 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03fc52-971d-42d0-8c6c-8987340a5a23 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:25.526835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854fcd5-d2c5-41e6-a652-d42d5ca6b497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:25.527476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854fcd5-d2c5-41e6-a652-d42d5ca6b497 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:25.527756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854fcd5-d2c5-41e6-a652-d42d5ca6b497 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:25.528083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854fcd5-d2c5-41e6-a652-d42d5ca6b497 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:25.528672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854fcd5-d2c5-41e6-a652-d42d5ca6b497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:25.528994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854fcd5-d2c5-41e6-a652-d42d5ca6b497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:25.530455 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854fcd5-d2c5-41e6-a652-d42d5ca6b497 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:25.543609 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 252/512] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:25.544470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854fcd5-d2c5-41e6-a652-d42d5ca6b497 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:25.544690 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:25.617935 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:25.625284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03fc52-971d-42d0-8c6c-8987340a5a23 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:25.653722 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854fcd5-d2c5-41e6-a652-d42d5ca6b497 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:25.660309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe7d56-cb3e-4a01-9065-10931c5685ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:25.661349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe7d56-cb3e-4a01-9065-10931c5685ba None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:25.661637 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe7d56-cb3e-4a01-9065-10931c5685ba None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:25.661910 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe7d56-cb3e-4a01-9065-10931c5685ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:25.672933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe7d56-cb3e-4a01-9065-10931c5685ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:25.674419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe7d56-cb3e-4a01-9065-10931c5685ba None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:25.687501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093c352-0521-4648-91b0-6f437a8b82d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:25.688502 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093c352-0521-4648-91b0-6f437a8b82d6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:25.688502 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093c352-0521-4648-91b0-6f437a8b82d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:25.688668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093c352-0521-4648-91b0-6f437a8b82d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-a2fe7d56-cb3e-4a01-9065-10931c5685ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:25.688929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:25.690051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:25.691257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:25.691257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:25.691257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:25.691257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 261/513] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:25.691257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe7d56-cb3e-4a01-9065-10931c5685ba None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:25.699677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093c352-0521-4648-91b0-6f437a8b82d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:25.701159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093c352-0521-4648-91b0-6f437a8b82d6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-9093c352-0521-4648-91b0-6f437a8b82d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:25.715899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:25.717031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:25.718091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:25.718091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:25.718091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:25.718091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 253/514] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:25.718091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093c352-0521-4648-91b0-6f437a8b82d6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:25.780834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:25.797360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe7d56-cb3e-4a01-9065-10931c5685ba None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:25.817048 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093c352-0521-4648-91b0-6f437a8b82d6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:25.832489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dff146-bafd-401e-9698-b88024ea8b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:25.833105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dff146-bafd-401e-9698-b88024ea8b2c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:25.833378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dff146-bafd-401e-9698-b88024ea8b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:25.833637 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dff146-bafd-401e-9698-b88024ea8b2c None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:25.834371 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dff146-bafd-401e-9698-b88024ea8b2c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:25.834729 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dff146-bafd-401e-9698-b88024ea8b2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:25.834859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:25.836190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dff146-bafd-401e-9698-b88024ea8b2c None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:25.853474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645ddc1-c716-442d-b229-0cb8e1dc2b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:25.853686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 262/515] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Aug 22 15:49:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:25.854083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645ddc1-c716-442d-b229-0cb8e1dc2b18 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:25.854357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645ddc1-c716-442d-b229-0cb8e1dc2b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:25.854466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dff146-bafd-401e-9698-b88024ea8b2c None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:25.854685 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645ddc1-c716-442d-b229-0cb8e1dc2b18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:25.926809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645ddc1-c716-442d-b229-0cb8e1dc2b18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:25.928300 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645ddc1-c716-442d-b229-0cb8e1dc2b18 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:25.957684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dff146-bafd-401e-9698-b88024ea8b2c None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:25.993181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f692d-ba4a-4a19-ab9a-5aaefb91b848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:25.993793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f692d-ba4a-4a19-ab9a-5aaefb91b848 None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:25.994056 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f692d-ba4a-4a19-ab9a-5aaefb91b848 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:25.994322 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f692d-ba4a-4a19-ab9a-5aaefb91b848 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:25.994993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f692d-ba4a-4a19-ab9a-5aaefb91b848 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:25.996481 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f692d-ba4a-4a19-ab9a-5aaefb91b848 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:26.014433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:26.027088 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 263/516] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:49:25 2022] POST /identity/v3/users => generated 247 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:49:26.027924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f692d-ba4a-4a19-ab9a-5aaefb91b848 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:26.029281 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 254/517] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:26.030363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645ddc1-c716-442d-b229-0cb8e1dc2b18 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:26.058779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:26.154771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f692d-ba4a-4a19-ab9a-5aaefb91b848 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:26.156265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645ddc1-c716-442d-b229-0cb8e1dc2b18 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:26.195765 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a579950-4812-44b2-af75-404a7b7d1e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:26.195978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5b55b-3ae0-4d1e-bbe9-7ce224e4eb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:26.197029 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a579950-4812-44b2-af75-404a7b7d1e20 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:26.197157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5b55b-3ae0-4d1e-bbe9-7ce224e4eb67 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:26.197233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a579950-4812-44b2-af75-404a7b7d1e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:26.197299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5b55b-3ae0-4d1e-bbe9-7ce224e4eb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:26.197365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a579950-4812-44b2-af75-404a7b7d1e20 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:26.197428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5b55b-3ae0-4d1e-bbe9-7ce224e4eb67 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:26.198294 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a579950-4812-44b2-af75-404a7b7d1e20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:26.198564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5b55b-3ae0-4d1e-bbe9-7ce224e4eb67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:26.198667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a579950-4812-44b2-af75-404a7b7d1e20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:26.198737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5b55b-3ae0-4d1e-bbe9-7ce224e4eb67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:26.200586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a579950-4812-44b2-af75-404a7b7d1e20 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:26.200706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5b55b-3ae0-4d1e-bbe9-7ce224e4eb67 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:26.212476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 264/518] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:26.213599 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a579950-4812-44b2-af75-404a7b7d1e20 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:26.219644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 255/519] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:26.220518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5b55b-3ae0-4d1e-bbe9-7ce224e4eb67 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:26.281037 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:26.309513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:26.333006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a579950-4812-44b2-af75-404a7b7d1e20 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:26.333901 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5b55b-3ae0-4d1e-bbe9-7ce224e4eb67 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:26.370244 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49448c3-600b-461d-8eae-f7e06aff613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:26.370848 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1109d-a77b-4439-9ef5-73cfbcd0844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:26.371026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49448c3-600b-461d-8eae-f7e06aff613b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:26.371170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49448c3-600b-461d-8eae-f7e06aff613b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:26.371447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49448c3-600b-461d-8eae-f7e06aff613b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:26.371594 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1109d-a77b-4439-9ef5-73cfbcd0844f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:26.371742 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1109d-a77b-4439-9ef5-73cfbcd0844f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:26.372012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1109d-a77b-4439-9ef5-73cfbcd0844f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:26.383719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1109d-a77b-4439-9ef5-73cfbcd0844f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:26.385171 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1109d-a77b-4439-9ef5-73cfbcd0844f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-fea1109d-a77b-4439-9ef5-73cfbcd0844f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:26.401966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:26.403184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:26.409385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:26.409385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:26.409385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:26.409385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 256/520] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:26.409385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1109d-a77b-4439-9ef5-73cfbcd0844f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:26.449233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49448c3-600b-461d-8eae-f7e06aff613b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:26.450990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49448c3-600b-461d-8eae-f7e06aff613b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:26.509967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:26.524595 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1109d-a77b-4439-9ef5-73cfbcd0844f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:26.555641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:26.563736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86f5d5-ddfb-4369-b8cf-50a15e9e847c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:26.564277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86f5d5-ddfb-4369-b8cf-50a15e9e847c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:26.564541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86f5d5-ddfb-4369-b8cf-50a15e9e847c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:26.564804 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86f5d5-ddfb-4369-b8cf-50a15e9e847c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:26.569796 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 265/521] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:26.571115 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49448c3-600b-461d-8eae-f7e06aff613b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:26.575564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86f5d5-ddfb-4369-b8cf-50a15e9e847c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:26.576275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86f5d5-ddfb-4369-b8cf-50a15e9e847c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-8d86f5d5-ddfb-4369-b8cf-50a15e9e847c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:26.588245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:26.589208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:26.590049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:26.590049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:26.590049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:26.590049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:26.590049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:26.590049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:26.590049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:26.590049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:26.590049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 257/522] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:26.592529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86f5d5-ddfb-4369-b8cf-50a15e9e847c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:26.685313 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49448c3-600b-461d-8eae-f7e06aff613b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:26.702915 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86f5d5-ddfb-4369-b8cf-50a15e9e847c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:26.721803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40de762-1930-4334-a9ea-f086dd8f5a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:26.722441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40de762-1930-4334-a9ea-f086dd8f5a8b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:26.722751 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40de762-1930-4334-a9ea-f086dd8f5a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:26.723028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40de762-1930-4334-a9ea-f086dd8f5a8b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:26.730394 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40de762-1930-4334-a9ea-f086dd8f5a8b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:26.731957 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40de762-1930-4334-a9ea-f086dd8f5a8b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:26.739138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ac9c9-8699-4586-b612-dc78e49b86fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:26.739764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ac9c9-8699-4586-b612-dc78e49b86fb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:26.740045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ac9c9-8699-4586-b612-dc78e49b86fb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:26.740319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ac9c9-8699-4586-b612-dc78e49b86fb None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:26.740996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ac9c9-8699-4586-b612-dc78e49b86fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:26.741300 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ac9c9-8699-4586-b612-dc78e49b86fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:26.742725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ac9c9-8699-4586-b612-dc78e49b86fb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-c40de762-1930-4334-a9ea-f086dd8f5a8b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:26.745476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:26.746485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:26.747507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:26.747507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:26.747507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:26.747507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:26.747507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:26.747507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:26.747507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:26.747507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:26.747507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 15:49:26.747507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:26.747507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 266/523] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:26.747507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40de762-1930-4334-a9ea-f086dd8f5a8b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:26.762143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 258/524] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:26.763345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ac9c9-8699-4586-b612-dc78e49b86fb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:26.775121 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:26.824438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:26.860406 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40de762-1930-4334-a9ea-f086dd8f5a8b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:26.880728 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ac9c9-8699-4586-b612-dc78e49b86fb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:26.897355 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a2eb8-190c-438c-ab81-f5d03744398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:26.897988 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a2eb8-190c-438c-ab81-f5d03744398f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:26.898260 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a2eb8-190c-438c-ab81-f5d03744398f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:26.898531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a2eb8-190c-438c-ab81-f5d03744398f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:26.910436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a2eb8-190c-438c-ab81-f5d03744398f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:26.911940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a2eb8-190c-438c-ab81-f5d03744398f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:26.918257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eb79d-20ec-40ef-a8a4-1240b15166dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:26.919217 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eb79d-20ec-40ef-a8a4-1240b15166dd None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:26.919473 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eb79d-20ec-40ef-a8a4-1240b15166dd None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:26.919858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eb79d-20ec-40ef-a8a4-1240b15166dd None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:26.920718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7eb79d-20ec-40ef-a8a4-1240b15166dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:26.921120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7eb79d-20ec-40ef-a8a4-1240b15166dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:26.922738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7eb79d-20ec-40ef-a8a4-1240b15166dd None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-454a2eb8-190c-438c-ab81-f5d03744398f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:26.926401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:26.927509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:26.928560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:26.928560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:26.928560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:26.932259 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 267/525] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:26.932969 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a2eb8-190c-438c-ab81-f5d03744398f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:26.949375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 259/526] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:26.949375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eb79d-20ec-40ef-a8a4-1240b15166dd None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:27.013145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:27.046307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a2eb8-190c-438c-ab81-f5d03744398f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:27.055545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eb79d-20ec-40ef-a8a4-1240b15166dd None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:27.068588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:27.080684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ea00c-f83f-4668-afd9-cba2ea816b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:27.081227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ea00c-f83f-4668-afd9-cba2ea816b17 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:27.081501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ea00c-f83f-4668-afd9-cba2ea816b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:27.081774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ea00c-f83f-4668-afd9-cba2ea816b17 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:27.082515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ea00c-f83f-4668-afd9-cba2ea816b17 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:27.082849 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ea00c-f83f-4668-afd9-cba2ea816b17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:27.084306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ea00c-f83f-4668-afd9-cba2ea816b17 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:27.097773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fc435-323b-4128-8040-74c6c7974d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:27.098781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fc435-323b-4128-8040-74c6c7974d01 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:27.099062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fc435-323b-4128-8040-74c6c7974d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:27.099337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fc435-323b-4128-8040-74c6c7974d01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:27.106863 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 268/527] 10.222.0.77 () {56 vars in 1139 bytes} [Mon Aug 22 15:49:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:27.106863 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ea00c-f83f-4668-afd9-cba2ea816b17 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:27.108440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fc435-323b-4128-8040-74c6c7974d01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:27.110068 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fc435-323b-4128-8040-74c6c7974d01 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-e63fc435-323b-4128-8040-74c6c7974d01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:27.122652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:27.123945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:27.124809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:27.124809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:27.124809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:27.124809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:27.124809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:27.124809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:27.124809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:27.124809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:27.124809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 260/528] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:27.124809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fc435-323b-4128-8040-74c6c7974d01 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:27.221905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ea00c-f83f-4668-afd9-cba2ea816b17 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:27.232868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fc435-323b-4128-8040-74c6c7974d01 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:27.252458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:27.259023 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69729bd2-4931-4fd2-a2fb-f026e7d34791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:27.259648 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69729bd2-4931-4fd2-a2fb-f026e7d34791 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:27.259919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69729bd2-4931-4fd2-a2fb-f026e7d34791 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:27.260190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69729bd2-4931-4fd2-a2fb-f026e7d34791 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:27.260862 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69729bd2-4931-4fd2-a2fb-f026e7d34791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:27.261161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69729bd2-4931-4fd2-a2fb-f026e7d34791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:27.262547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69729bd2-4931-4fd2-a2fb-f026e7d34791 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:27.273610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 269/529] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:27.274403 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69729bd2-4931-4fd2-a2fb-f026e7d34791 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:27.283764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a29ff-c1b7-4a20-80fb-9a502419af35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:27.284388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a29ff-c1b7-4a20-80fb-9a502419af35 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:27.284663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a29ff-c1b7-4a20-80fb-9a502419af35 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:27.284933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a29ff-c1b7-4a20-80fb-9a502419af35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:27.285670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a29ff-c1b7-4a20-80fb-9a502419af35 None admin] RBAC: Adding query filter params (role.id=2160bd7482684f0295250953180cc1b9, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=20e4a18ab77642baa9adb9a4b49fbcc2) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:27.285976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a29ff-c1b7-4a20-80fb-9a502419af35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:27.287474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a29ff-c1b7-4a20-80fb-9a502419af35 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:27.294001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 261/530] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:49:27 2022] GET /identity/v3/role_assignments?user.id=20e4a18ab77642baa9adb9a4b49fbcc2&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=2160bd7482684f0295250953180cc1b9 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:27.295366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a29ff-c1b7-4a20-80fb-9a502419af35 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:27.354848 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:27.425860 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69729bd2-4931-4fd2-a2fb-f026e7d34791 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:27.459472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a29ff-c1b7-4a20-80fb-9a502419af35 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:27.465439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bf48b-b1da-4ac7-988d-8b541ad9d1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:27.466213 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bf48b-b1da-4ac7-988d-8b541ad9d1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:27.466492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bf48b-b1da-4ac7-988d-8b541ad9d1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:27.466873 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bf48b-b1da-4ac7-988d-8b541ad9d1d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:27.508984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42021d0d-b8bd-4cfa-83dc-06e322459388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:27.509879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42021d0d-b8bd-4cfa-83dc-06e322459388 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:27.510581 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42021d0d-b8bd-4cfa-83dc-06e322459388 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:27.511096 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42021d0d-b8bd-4cfa-83dc-06e322459388 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:27.512074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42021d0d-b8bd-4cfa-83dc-06e322459388 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:27.513443 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42021d0d-b8bd-4cfa-83dc-06e322459388 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:27.515126 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42021d0d-b8bd-4cfa-83dc-06e322459388 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:27.531775 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 262/531] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:27.533031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42021d0d-b8bd-4cfa-83dc-06e322459388 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:27.544620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:27.559055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bf48b-b1da-4ac7-988d-8b541ad9d1d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:27.560787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2bf48b-b1da-4ac7-988d-8b541ad9d1d3 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:27.672165 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 270/532] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:27.674189 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:27.677674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bf48b-b1da-4ac7-988d-8b541ad9d1d3 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:27.684522 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42021d0d-b8bd-4cfa-83dc-06e322459388 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:27.732513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8716b-cdc8-47ca-b6f4-7a88abc13f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:27.733833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8716b-cdc8-47ca-b6f4-7a88abc13f3c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:27.734829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8716b-cdc8-47ca-b6f4-7a88abc13f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:27.735265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8716b-cdc8-47ca-b6f4-7a88abc13f3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:27.745907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8716b-cdc8-47ca-b6f4-7a88abc13f3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:27.747607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8716b-cdc8-47ca-b6f4-7a88abc13f3c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-5cb8716b-cdc8-47ca-b6f4-7a88abc13f3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:27.763708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:27.764843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:27.765913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:27.765913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:27.765913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:27.765913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:27.765913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:27.765913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:27.765913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:27.765913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:27.768836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 263/533] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:27.769781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8716b-cdc8-47ca-b6f4-7a88abc13f3c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:27.791347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:27.804879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2bf48b-b1da-4ac7-988d-8b541ad9d1d3 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:27.841993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e73790-c663-49a1-baaf-98abec916a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:27.842951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e73790-c663-49a1-baaf-98abec916a1f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:27.843334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e73790-c663-49a1-baaf-98abec916a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:27.843702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e73790-c663-49a1-baaf-98abec916a1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:27.844581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e73790-c663-49a1-baaf-98abec916a1f None admin] RBAC: Adding query filter params (role.id=2160bd7482684f0295250953180cc1b9, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=3f7c46f4dc084a948bd09ca9b86c2748) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:27.845308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e73790-c663-49a1-baaf-98abec916a1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:27.847264 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e73790-c663-49a1-baaf-98abec916a1f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:27.855089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 271/534] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:49:27 2022] GET /identity/v3/role_assignments?user.id=3f7c46f4dc084a948bd09ca9b86c2748&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=2160bd7482684f0295250953180cc1b9 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:27.860430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e73790-c663-49a1-baaf-98abec916a1f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:27.914405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8716b-cdc8-47ca-b6f4-7a88abc13f3c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:28.001448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02381bb3-dfc3-4954-af58-0348ff0172f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:28.002061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02381bb3-dfc3-4954-af58-0348ff0172f1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:28.002338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02381bb3-dfc3-4954-af58-0348ff0172f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:28.002916 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02381bb3-dfc3-4954-af58-0348ff0172f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:28.013732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e73790-c663-49a1-baaf-98abec916a1f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:28.017698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02381bb3-dfc3-4954-af58-0348ff0172f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:28.019543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02381bb3-dfc3-4954-af58-0348ff0172f1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-02381bb3-dfc3-4954-af58-0348ff0172f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:28.040062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:28.041153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:28.042276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:28.042276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:28.042276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:28.043193 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 264/535] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:28.044642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d116c-856b-45f7-9f3a-8f36cf22bef9 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:28.044972 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d116c-856b-45f7-9f3a-8f36cf22bef9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:28.045294 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d116c-856b-45f7-9f3a-8f36cf22bef9 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:28.050711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 265/536] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:28.051651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d116c-856b-45f7-9f3a-8f36cf22bef9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:28.061856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99573bff-fab1-493f-9a9e-4a24440d50f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:28.062534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99573bff-fab1-493f-9a9e-4a24440d50f5 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:28.062854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99573bff-fab1-493f-9a9e-4a24440d50f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:28.063135 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99573bff-fab1-493f-9a9e-4a24440d50f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:28.063845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99573bff-fab1-493f-9a9e-4a24440d50f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:28.064160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99573bff-fab1-493f-9a9e-4a24440d50f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:28.064407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:28.066007 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99573bff-fab1-493f-9a9e-4a24440d50f5 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:28.086931 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 272/537] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:28.093234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341542e-fd80-4a6f-bca1-8de745bd8cab None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:28.093524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341542e-fd80-4a6f-bca1-8de745bd8cab None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:28.093800 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341542e-fd80-4a6f-bca1-8de745bd8cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:28.112232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-5341542e-fd80-4a6f-bca1-8de745bd8cab None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:28.113534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5341542e-fd80-4a6f-bca1-8de745bd8cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:28.125968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:28.175145 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d116c-856b-45f7-9f3a-8f36cf22bef9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:28.206772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 273/538] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:28.208081 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341542e-fd80-4a6f-bca1-8de745bd8cab None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:28.214038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e00b70-329d-4f71-9502-8a30dab52321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:28.214742 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e00b70-329d-4f71-9502-8a30dab52321 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:28.215024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e00b70-329d-4f71-9502-8a30dab52321 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:28.215295 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e00b70-329d-4f71-9502-8a30dab52321 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:28.216002 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e00b70-329d-4f71-9502-8a30dab52321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:28.216393 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e00b70-329d-4f71-9502-8a30dab52321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:28.217845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e00b70-329d-4f71-9502-8a30dab52321 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:28.231080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 266/539] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:28.236593 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e00b70-329d-4f71-9502-8a30dab52321 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:28.313831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:28.366023 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e00b70-329d-4f71-9502-8a30dab52321 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:28.404728 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a93549-4195-4100-b219-3e4e7a080ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:28.405371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a93549-4195-4100-b219-3e4e7a080ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:28.405694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a93549-4195-4100-b219-3e4e7a080ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:28.405976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a93549-4195-4100-b219-3e4e7a080ce0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:28.406166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341542e-fd80-4a6f-bca1-8de745bd8cab None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:28.413377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a93549-4195-4100-b219-3e4e7a080ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:28.414898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a93549-4195-4100-b219-3e4e7a080ce0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c2a93549-4195-4100-b219-3e4e7a080ce0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:28.427429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:28.428345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:28.429174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:28.429174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:28.429174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:28.429174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:28.429174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:28.429174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:28.429174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:28.429174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:28.429174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 267/540] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:28.435216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a93549-4195-4100-b219-3e4e7a080ce0 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:28.531381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e16e6-2f13-4702-9388-2527f169a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:28.532021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e16e6-2f13-4702-9388-2527f169a511 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:28.532307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e16e6-2f13-4702-9388-2527f169a511 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:28.532584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e16e6-2f13-4702-9388-2527f169a511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:28.533339 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e16e6-2f13-4702-9388-2527f169a511 None admin] RBAC: Adding query filter params (role.id=2160bd7482684f0295250953180cc1b9, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=80b255bd61e3445ab154f01fea9a95b9) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:28.533648 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e16e6-2f13-4702-9388-2527f169a511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:28.535206 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e16e6-2f13-4702-9388-2527f169a511 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:28.541856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a93549-4195-4100-b219-3e4e7a080ce0 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:28.555892 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 274/541] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:49:28 2022] GET /identity/v3/role_assignments?user.id=80b255bd61e3445ab154f01fea9a95b9&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=2160bd7482684f0295250953180cc1b9 => generated 259 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:28.556946 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e16e6-2f13-4702-9388-2527f169a511 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:28.575646 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:28.583005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:28.605404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8a95a-0426-42dc-a207-795ea12ce7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:28.606041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8a95a-0426-42dc-a207-795ea12ce7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:28.606321 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8a95a-0426-42dc-a207-795ea12ce7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:28.606627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8a95a-0426-42dc-a207-795ea12ce7f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:28.607344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8a95a-0426-42dc-a207-795ea12ce7f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:28.607649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8a95a-0426-42dc-a207-795ea12ce7f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:28.610480 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8a95a-0426-42dc-a207-795ea12ce7f0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:28.643448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 268/542] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:28.649834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8a95a-0426-42dc-a207-795ea12ce7f0 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:28.789095 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e16e6-2f13-4702-9388-2527f169a511 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:28.790167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8a95a-0426-42dc-a207-795ea12ce7f0 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:28.829633 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d7c13-3a97-4c52-a20f-3d0d1067a87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:28.830335 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7c13-3a97-4c52-a20f-3d0d1067a87e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:28.830459 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7c13-3a97-4c52-a20f-3d0d1067a87e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:28.830833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7c13-3a97-4c52-a20f-3d0d1067a87e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:28.834630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7164e3-bb22-48fb-a27e-46af75e970b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:28.835263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7164e3-bb22-48fb-a27e-46af75e970b5 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:28.835540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7164e3-bb22-48fb-a27e-46af75e970b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:28.835812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7164e3-bb22-48fb-a27e-46af75e970b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:28.836846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7164e3-bb22-48fb-a27e-46af75e970b5 None admin] RBAC: Adding query filter params (role.id=2160bd7482684f0295250953180cc1b9, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=104abc0b38524a2f95ffe96c5872362c) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:28.837250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7164e3-bb22-48fb-a27e-46af75e970b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:28.839007 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7164e3-bb22-48fb-a27e-46af75e970b5 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:28.843347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d7c13-3a97-4c52-a20f-3d0d1067a87e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:28.846084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 269/543] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:49:28 2022] GET /identity/v3/role_assignments?user.id=104abc0b38524a2f95ffe96c5872362c&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=2160bd7482684f0295250953180cc1b9 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-906d7c13-3a97-4c52-a20f-3d0d1067a87e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:28.857408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:28.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:28.862271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:28.862271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:28.862271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:28.862271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:28.862271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:28.862271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:28.862271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:28.862271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:28.862271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:28.862271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:28.862271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:28.862271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:28.862271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 275/544] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:28.868139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7164e3-bb22-48fb-a27e-46af75e970b5 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:28.966637 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:29.054562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7164e3-bb22-48fb-a27e-46af75e970b5 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:29.099738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d656a8-76b4-4b2b-a344-5e4ab499d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:29.100281 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d656a8-76b4-4b2b-a344-5e4ab499d268 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:29.100559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d656a8-76b4-4b2b-a344-5e4ab499d268 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:29.100833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d656a8-76b4-4b2b-a344-5e4ab499d268 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:29.101516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d656a8-76b4-4b2b-a344-5e4ab499d268 None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:29.101818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d656a8-76b4-4b2b-a344-5e4ab499d268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:29.103256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d656a8-76b4-4b2b-a344-5e4ab499d268 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:29.112706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 270/545] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:29.118699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d7c13-3a97-4c52-a20f-3d0d1067a87e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:29.215618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:29.266446 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d7c13-3a97-4c52-a20f-3d0d1067a87e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:29.321159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ce9c2-4c40-4fef-9c84-393c3c5aa2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:29.321812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ce9c2-4c40-4fef-9c84-393c3c5aa2ff None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:29.322093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ce9c2-4c40-4fef-9c84-393c3c5aa2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:29.322367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ce9c2-4c40-4fef-9c84-393c3c5aa2ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:29.335330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ce9c2-4c40-4fef-9c84-393c3c5aa2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:29.336859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ce9c2-4c40-4fef-9c84-393c3c5aa2ff None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-3d9ce9c2-4c40-4fef-9c84-393c3c5aa2ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:29.351859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:29.352777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:29.353607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:29.353607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:29.353607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:29.353607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 276/546] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:29.359257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d656a8-76b4-4b2b-a344-5e4ab499d268 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:29.392145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e7e1-e5ac-4ffd-996b-7ee558799aa7 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:29.392458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e7e1-e5ac-4ffd-996b-7ee558799aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:29.392691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2e7e1-e5ac-4ffd-996b-7ee558799aa7 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:29.394049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 277/547] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:49:29.400415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47f38f-53c2-4d00-993c-4b1822221e05 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:29.400797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47f38f-53c2-4d00-993c-4b1822221e05 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:29.401078 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47f38f-53c2-4d00-993c-4b1822221e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:29.428010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-4f47f38f-53c2-4d00-993c-4b1822221e05 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:29.429235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4f47f38f-53c2-4d00-993c-4b1822221e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:29.536069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d656a8-76b4-4b2b-a344-5e4ab499d268 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:29.549258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 278/548] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:49:29.566732 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:29.596793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54ca12-7a62-457b-8701-86ac2df22e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:29.597420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ca12-7a62-457b-8701-86ac2df22e83 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:29.597696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ca12-7a62-457b-8701-86ac2df22e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:29.597972 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ca12-7a62-457b-8701-86ac2df22e83 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:29.599098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54ca12-7a62-457b-8701-86ac2df22e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:29.599385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54ca12-7a62-457b-8701-86ac2df22e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:29.601808 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54ca12-7a62-457b-8701-86ac2df22e83 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:29.628163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 271/549] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:29.633698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47f38f-53c2-4d00-993c-4b1822221e05 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:29.697285 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:29.762099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47f38f-53c2-4d00-993c-4b1822221e05 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:29.812720 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58376a77-b19e-4558-b56f-4bf8981a1a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:29.813365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58376a77-b19e-4558-b56f-4bf8981a1a02 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:29.813646 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58376a77-b19e-4558-b56f-4bf8981a1a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:29.813914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58376a77-b19e-4558-b56f-4bf8981a1a02 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:29.827794 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58376a77-b19e-4558-b56f-4bf8981a1a02 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:29.829361 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58376a77-b19e-4558-b56f-4bf8981a1a02 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-58376a77-b19e-4558-b56f-4bf8981a1a02 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:29.842030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:29.845136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:29.847461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:29.847461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:29.847461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:29.847461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:29.847461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:29.847461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:29.847461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:29.847461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:29.847461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:49:29.847461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:29.847461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 279/550] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:49:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:29.854619 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54ca12-7a62-457b-8701-86ac2df22e83 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:29.897060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58376a77-b19e-4558-b56f-4bf8981a1a02 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:30.021995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54ca12-7a62-457b-8701-86ac2df22e83 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:30.063572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58376a77-b19e-4558-b56f-4bf8981a1a02 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:30.083237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:30.091691 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692b3d3-9cd6-4554-b84d-e618021ce9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:30.092381 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692b3d3-9cd6-4554-b84d-e618021ce9ce None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:30.092660 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692b3d3-9cd6-4554-b84d-e618021ce9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:30.092930 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692b3d3-9cd6-4554-b84d-e618021ce9ce None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:30.093689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692b3d3-9cd6-4554-b84d-e618021ce9ce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:30.093990 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692b3d3-9cd6-4554-b84d-e618021ce9ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:30.095598 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692b3d3-9cd6-4554-b84d-e618021ce9ce None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:30.110171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaef1e-e98d-489e-bdd3-93608105375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:30.110852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaef1e-e98d-489e-bdd3-93608105375d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:30.111128 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaef1e-e98d-489e-bdd3-93608105375d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:30.111398 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaef1e-e98d-489e-bdd3-93608105375d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:30.116441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 272/551] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Aug 22 15:49:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:30.117743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d867c-2cc9-4453-9fa4-9a004daceb98 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:30.118038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d867c-2cc9-4453-9fa4-9a004daceb98 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:30.118303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d867c-2cc9-4453-9fa4-9a004daceb98 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:30.123887 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aaef1e-e98d-489e-bdd3-93608105375d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:30.128492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 273/552] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:30.128492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d867c-2cc9-4453-9fa4-9a004daceb98 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-e8aaef1e-e98d-489e-bdd3-93608105375d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:30.134837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:30.135890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:30.136770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:30.136770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:30.136770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:30.136770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:30.136770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:30.136770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:30.136770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:30.136770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:30.136770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:30.136770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:30.136770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:30.136770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:30.139619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 280/553] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:30.141041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451822c-561e-4531-bd08-667d148fa76d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:30.141492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451822c-561e-4531-bd08-667d148fa76d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:30.141929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451822c-561e-4531-bd08-667d148fa76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:30.161478 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-4451822c-561e-4531-bd08-667d148fa76d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:30.163026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4451822c-561e-4531-bd08-667d148fa76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:30.163508 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:30.247045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 281/554] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:30.248449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451822c-561e-4531-bd08-667d148fa76d None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:30.267980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d867c-2cc9-4453-9fa4-9a004daceb98 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:30.308657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056963d-4033-4faa-88da-89efa5061d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:30.309273 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056963d-4033-4faa-88da-89efa5061d9c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:30.309551 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056963d-4033-4faa-88da-89efa5061d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:30.309937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056963d-4033-4faa-88da-89efa5061d9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:30.392139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056963d-4033-4faa-88da-89efa5061d9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:30.393747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056963d-4033-4faa-88da-89efa5061d9c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:30.428158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:30.468101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:30.474428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451822c-561e-4531-bd08-667d148fa76d None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:30.517226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 274/555] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:30.523220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056963d-4033-4faa-88da-89efa5061d9c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:30.576835 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e14213-1fb5-4c8b-90fc-04a72b360158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:30.577615 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e14213-1fb5-4c8b-90fc-04a72b360158 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:30.577960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e14213-1fb5-4c8b-90fc-04a72b360158 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:30.578296 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e14213-1fb5-4c8b-90fc-04a72b360158 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:30.579100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e14213-1fb5-4c8b-90fc-04a72b360158 None admin] RBAC: Adding query filter params (name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:30.579452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e14213-1fb5-4c8b-90fc-04a72b360158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:30.580964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e14213-1fb5-4c8b-90fc-04a72b360158 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:30.600184 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 282/556] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:30.607910 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e14213-1fb5-4c8b-90fc-04a72b360158 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:30.650721 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056963d-4033-4faa-88da-89efa5061d9c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:30.686478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:30.700255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c54f86-b56e-4d39-a63a-0027621d8af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:30.701524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c54f86-b56e-4d39-a63a-0027621d8af4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:30.702118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c54f86-b56e-4d39-a63a-0027621d8af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:30.702802 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c54f86-b56e-4d39-a63a-0027621d8af4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:30.720631 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c54f86-b56e-4d39-a63a-0027621d8af4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:30.722124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c54f86-b56e-4d39-a63a-0027621d8af4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-d1c54f86-b56e-4d39-a63a-0027621d8af4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:30.738654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:30.739661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:30.740514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:30.740514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:30.740514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:30.740514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 275/557] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:30.741189 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c54f86-b56e-4d39-a63a-0027621d8af4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:30.772473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e14213-1fb5-4c8b-90fc-04a72b360158 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:30.809423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe09301-18bd-41a1-a441-93030dda036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:30.810235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe09301-18bd-41a1-a441-93030dda036b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:30.810507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe09301-18bd-41a1-a441-93030dda036b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:30.811151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe09301-18bd-41a1-a441-93030dda036b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:30.825755 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe09301-18bd-41a1-a441-93030dda036b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:30.827282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe09301-18bd-41a1-a441-93030dda036b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-2fe09301-18bd-41a1-a441-93030dda036b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:30.846207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:30.849001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:30.850343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:30.850343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:30.850343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:30.850343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 283/558] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:30.850343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe09301-18bd-41a1-a441-93030dda036b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:30.869540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:30.878967 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c54f86-b56e-4d39-a63a-0027621d8af4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:30.924884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78485b-5b88-4924-bcd1-efa8b7afd2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:30.925864 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78485b-5b88-4924-bcd1-efa8b7afd2db None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:30.926207 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78485b-5b88-4924-bcd1-efa8b7afd2db None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:30.926570 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78485b-5b88-4924-bcd1-efa8b7afd2db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:30.938496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78485b-5b88-4924-bcd1-efa8b7afd2db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-1f78485b-5b88-4924-bcd1-efa8b7afd2db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:30.944492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:30.946420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:30.948009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:30.948009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:30.948009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:30.948009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:30.948009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:30.948009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:30.948009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:30.948009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:30.948009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:30.948009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:30.948009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:30.948009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:30.951924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 276/559] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:30.952965 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78485b-5b88-4924-bcd1-efa8b7afd2db None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:30.975657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe09301-18bd-41a1-a441-93030dda036b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:31.002175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:31.041985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be80f0-d7d0-4394-98cc-77d7dea2edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:31.042889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be80f0-d7d0-4394-98cc-77d7dea2edcc None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:31.043194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be80f0-d7d0-4394-98cc-77d7dea2edcc None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:31.043602 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be80f0-d7d0-4394-98cc-77d7dea2edcc None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:31.044339 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be80f0-d7d0-4394-98cc-77d7dea2edcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:31.044884 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be80f0-d7d0-4394-98cc-77d7dea2edcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:31.047885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be80f0-d7d0-4394-98cc-77d7dea2edcc None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:31.071752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 284/560] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:31.073345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be80f0-d7d0-4394-98cc-77d7dea2edcc None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:31.092932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78485b-5b88-4924-bcd1-efa8b7afd2db None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:31.135670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15477a-28b8-4f6e-851b-c1e90eb44ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:31.136465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15477a-28b8-4f6e-851b-c1e90eb44ffe None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:31.136823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15477a-28b8-4f6e-851b-c1e90eb44ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:31.137136 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15477a-28b8-4f6e-851b-c1e90eb44ffe None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:31.138138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15477a-28b8-4f6e-851b-c1e90eb44ffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:31.138636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15477a-28b8-4f6e-851b-c1e90eb44ffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:31.140762 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15477a-28b8-4f6e-851b-c1e90eb44ffe None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:31.159463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 277/561] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:31.160471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15477a-28b8-4f6e-851b-c1e90eb44ffe None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:31.165595 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:31.198388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be80f0-d7d0-4394-98cc-77d7dea2edcc None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:31.238783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefe8fd-a329-4965-8194-a1ff95c194b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:31.239404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefe8fd-a329-4965-8194-a1ff95c194b2 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:31.239685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefe8fd-a329-4965-8194-a1ff95c194b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:31.239953 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefe8fd-a329-4965-8194-a1ff95c194b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:31.240635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefe8fd-a329-4965-8194-a1ff95c194b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:31.240931 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefe8fd-a329-4965-8194-a1ff95c194b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:31.242352 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefe8fd-a329-4965-8194-a1ff95c194b2 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:31.251472 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 285/562] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:31.252837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e129164-034d-4936-bb69-cca089eea17c None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:31.253123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e129164-034d-4936-bb69-cca089eea17c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:31.253433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e129164-034d-4936-bb69-cca089eea17c None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:31.254689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 286/563] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:31.255892 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511b093-9a6b-45d8-9221-def36508b8ed None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:31.256167 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511b093-9a6b-45d8-9221-def36508b8ed None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:31.256437 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511b093-9a6b-45d8-9221-def36508b8ed None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:31.262818 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 287/564] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:31.262818 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511b093-9a6b-45d8-9221-def36508b8ed None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:31.318549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15477a-28b8-4f6e-851b-c1e90eb44ffe None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:31.320243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:31.360408 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf7973-baf6-4560-ae05-ef638c081094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:31.361280 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf7973-baf6-4560-ae05-ef638c081094 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:31.361642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf7973-baf6-4560-ae05-ef638c081094 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:31.362025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf7973-baf6-4560-ae05-ef638c081094 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:31.371998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf7973-baf6-4560-ae05-ef638c081094 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:31.373868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf7973-baf6-4560-ae05-ef638c081094 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-bfbf7973-baf6-4560-ae05-ef638c081094 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:31.386336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:31.388053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:31.389795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:31.389795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:31.389795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:31.389795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:31.389795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:31.389795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:31.389795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:31.389795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:31.389795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 278/565] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:31.392797 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d16570-f06a-4240-b242-c2e64fadbf99 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:31.393578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d16570-f06a-4240-b242-c2e64fadbf99 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:31.393748 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d16570-f06a-4240-b242-c2e64fadbf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:31.401470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511b093-9a6b-45d8-9221-def36508b8ed None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:31.420651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-98d16570-f06a-4240-b242-c2e64fadbf99 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:31.422545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-98d16570-f06a-4240-b242-c2e64fadbf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:31.452132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444184f-abdd-4c9b-aa34-b2e5f74c513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:31.452702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444184f-abdd-4c9b-aa34-b2e5f74c513e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:31.452985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444184f-abdd-4c9b-aa34-b2e5f74c513e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:31.453261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444184f-abdd-4c9b-aa34-b2e5f74c513e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:31.456372 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:31.462384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444184f-abdd-4c9b-aa34-b2e5f74c513e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:31.464551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444184f-abdd-4c9b-aa34-b2e5f74c513e None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-1444184f-abdd-4c9b-aa34-b2e5f74c513e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:31.477118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:31.478541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:31.480177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:31.480177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:31.480177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:31.480177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:31.480177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:31.480177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:31.480177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:31.480177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:31.480177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:49:31.480177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:31.480177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 288/566] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 22 15:49:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:31.480177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444184f-abdd-4c9b-aa34-b2e5f74c513e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:31.507816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 279/567] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:31.509132 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cf1ad-2c33-4a81-bd34-bae151805d93 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:31.509438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cf1ad-2c33-4a81-bd34-bae151805d93 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:31.509684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cf1ad-2c33-4a81-bd34-bae151805d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:31.546320 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-247cf1ad-2c33-4a81-bd34-bae151805d93 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:31.548464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-247cf1ad-2c33-4a81-bd34-bae151805d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:31.606204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444184f-abdd-4c9b-aa34-b2e5f74c513e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:31.646720 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 280/568] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:31.646720 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cf1ad-2c33-4a81-bd34-bae151805d93 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:31.663763 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fafce6-4e79-46c0-8ba2-24d9619b5894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:31.665100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fafce6-4e79-46c0-8ba2-24d9619b5894 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:31.665543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fafce6-4e79-46c0-8ba2-24d9619b5894 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:31.666144 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fafce6-4e79-46c0-8ba2-24d9619b5894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:31.683579 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fafce6-4e79-46c0-8ba2-24d9619b5894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:31.685976 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fafce6-4e79-46c0-8ba2-24d9619b5894 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:31.689643 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-d5fafce6-4e79-46c0-8ba2-24d9619b5894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:31.709053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:31.710236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:31.711366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:31.711366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:31.711366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:31.717727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 289/569] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:31.719006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fafce6-4e79-46c0-8ba2-24d9619b5894 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:31.780594 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:31.823100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cf1ad-2c33-4a81-bd34-bae151805d93 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:31.852315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fafce6-4e79-46c0-8ba2-24d9619b5894 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:31.873244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b300-fb9a-4311-bce7-fd68aa736912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:31.873866 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b300-fb9a-4311-bce7-fd68aa736912 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:31.874142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b300-fb9a-4311-bce7-fd68aa736912 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:31.874410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42b300-fb9a-4311-bce7-fd68aa736912 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:31.875158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42b300-fb9a-4311-bce7-fd68aa736912 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:31.875463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42b300-fb9a-4311-bce7-fd68aa736912 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:31.876963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42b300-fb9a-4311-bce7-fd68aa736912 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:31.890446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 281/570] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:31.891432 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b300-fb9a-4311-bce7-fd68aa736912 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:31.904292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7d6e3-202b-4c95-a891-3f78a242b2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:31.904923 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d6e3-202b-4c95-a891-3f78a242b2ba None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:31.905247 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d6e3-202b-4c95-a891-3f78a242b2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:31.905524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d6e3-202b-4c95-a891-3f78a242b2ba None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:31.906403 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7d6e3-202b-4c95-a891-3f78a242b2ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:31.906757 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7d6e3-202b-4c95-a891-3f78a242b2ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:31.908244 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7d6e3-202b-4c95-a891-3f78a242b2ba None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:31.935099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 290/571] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 22 15:49:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:31.935099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7d6e3-202b-4c95-a891-3f78a242b2ba None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:32.013045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:32.034963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42b300-fb9a-4311-bce7-fd68aa736912 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:32.063301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7d6e3-202b-4c95-a891-3f78a242b2ba None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:32.072971 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd97def-ea67-4a08-af52-6a3982cedb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:32.073772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:32.074109 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd97def-ea67-4a08-af52-6a3982cedb42 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:32.074396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd97def-ea67-4a08-af52-6a3982cedb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:32.074696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd97def-ea67-4a08-af52-6a3982cedb42 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:32.077165 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd97def-ea67-4a08-af52-6a3982cedb42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:32.077165 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd97def-ea67-4a08-af52-6a3982cedb42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:32.077916 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd97def-ea67-4a08-af52-6a3982cedb42 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:32.093691 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 282/572] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:32.094421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd97def-ea67-4a08-af52-6a3982cedb42 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:32.109206 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ea106-588a-40ef-a90e-b5e2be52c2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:32.110179 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ea106-588a-40ef-a90e-b5e2be52c2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:32.110452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ea106-588a-40ef-a90e-b5e2be52c2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:32.110762 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ea106-588a-40ef-a90e-b5e2be52c2a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:32.127212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ea106-588a-40ef-a90e-b5e2be52c2a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-d43ea106-588a-40ef-a90e-b5e2be52c2a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:32.135079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:32.136698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:32.138212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:32.138212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:32.138212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:32.138212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:32.138212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:32.138212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:32.138212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:32.138212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:32.138212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:32.138212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:32.138212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:32.138212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:32.138212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 291/573] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:32.138212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ea106-588a-40ef-a90e-b5e2be52c2a6 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:32.213965 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd97def-ea67-4a08-af52-6a3982cedb42 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:32.249289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a299b-b4c4-4b61-b138-0cb959d2830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:32.249899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a299b-b4c4-4b61-b138-0cb959d2830c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:32.250173 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a299b-b4c4-4b61-b138-0cb959d2830c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:32.250442 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a299b-b4c4-4b61-b138-0cb959d2830c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:32.251217 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a299b-b4c4-4b61-b138-0cb959d2830c None admin] RBAC: Adding query filter params (role.id=2160bd7482684f0295250953180cc1b9, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=7d8a49035be2479b87c797bf53c9919b) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:32.251527 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a299b-b4c4-4b61-b138-0cb959d2830c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:32.252980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a299b-b4c4-4b61-b138-0cb959d2830c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:32.258788 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 283/574] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:49:32 2022] GET /identity/v3/role_assignments?user.id=7d8a49035be2479b87c797bf53c9919b&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=2160bd7482684f0295250953180cc1b9 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:32.259627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a299b-b4c4-4b61-b138-0cb959d2830c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:32.270306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:32.300745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ea106-588a-40ef-a90e-b5e2be52c2a6 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:32.353458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5513de8-f5d8-4feb-b58c-3445777f5ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:32.354190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5513de8-f5d8-4feb-b58c-3445777f5ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:32.354449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5513de8-f5d8-4feb-b58c-3445777f5ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:32.354870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5513de8-f5d8-4feb-b58c-3445777f5ed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:32.367431 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5513de8-f5d8-4feb-b58c-3445777f5ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:32.368942 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5513de8-f5d8-4feb-b58c-3445777f5ed2 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-f5513de8-f5d8-4feb-b58c-3445777f5ed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:32.386432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:32.388055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:32.389143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:32.389143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:32.389143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:32.389143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 292/575] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:32.389143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5513de8-f5d8-4feb-b58c-3445777f5ed2 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:32.421425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a299b-b4c4-4b61-b138-0cb959d2830c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:32.421811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:32.467641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fc783-abda-4b7e-b231-4033eb1e35a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:32.468287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fc783-abda-4b7e-b231-4033eb1e35a9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:32.468566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fc783-abda-4b7e-b231-4033eb1e35a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:32.468841 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fc783-abda-4b7e-b231-4033eb1e35a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:32.481497 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fc783-abda-4b7e-b231-4033eb1e35a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-f85fc783-abda-4b7e-b231-4033eb1e35a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:32.487159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:32.488449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:32.489338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:32.489338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:32.489338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:32.489338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:32.489338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:32.489338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:32.489338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:32.489338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:32.489338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:32.489338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:32.489338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:32.489338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:32.489338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 284/576] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:32.490018 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fc783-abda-4b7e-b231-4033eb1e35a9 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:32.573935 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5513de8-f5d8-4feb-b58c-3445777f5ed2 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:32.582865 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:32.624050 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f10c65-5816-4cdf-b220-3a8c038e1517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:32.624970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f10c65-5816-4cdf-b220-3a8c038e1517 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:32.624970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f10c65-5816-4cdf-b220-3a8c038e1517 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:32.625279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f10c65-5816-4cdf-b220-3a8c038e1517 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:32.636041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f10c65-5816-4cdf-b220-3a8c038e1517 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:32.637549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f10c65-5816-4cdf-b220-3a8c038e1517 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:32.647272 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fc783-abda-4b7e-b231-4033eb1e35a9 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-32f10c65-5816-4cdf-b220-3a8c038e1517 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:32.652014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:32.655688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:32.657016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:32.657016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:32.657016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:32.657016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:32.657016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:32.657016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:32.657016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:32.657016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:32.657016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 15:49:32.657016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:32.657016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 293/577] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:32.657016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f10c65-5816-4cdf-b220-3a8c038e1517 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:32.696122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ddc11-ac9e-4d23-ae86-4ba49a2587c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:32.696755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ddc11-ac9e-4d23-ae86-4ba49a2587c8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:32.697034 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ddc11-ac9e-4d23-ae86-4ba49a2587c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:32.697309 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ddc11-ac9e-4d23-ae86-4ba49a2587c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:32.698072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ddc11-ac9e-4d23-ae86-4ba49a2587c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:32.698384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ddc11-ac9e-4d23-ae86-4ba49a2587c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:32.699836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ddc11-ac9e-4d23-ae86-4ba49a2587c8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:32.709302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 285/578] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:32.709949 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ddc11-ac9e-4d23-ae86-4ba49a2587c8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:32.790381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:32.823768 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f10c65-5816-4cdf-b220-3a8c038e1517 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:32.855723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ddc11-ac9e-4d23-ae86-4ba49a2587c8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:32.864879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a41ebc-b387-41c4-92fd-1ceed53cc1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:32.865659 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a41ebc-b387-41c4-92fd-1ceed53cc1dc None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:32.865943 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a41ebc-b387-41c4-92fd-1ceed53cc1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:32.866285 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a41ebc-b387-41c4-92fd-1ceed53cc1dc None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:32.866951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a41ebc-b387-41c4-92fd-1ceed53cc1dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:32.867256 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a41ebc-b387-41c4-92fd-1ceed53cc1dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:32.868778 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a41ebc-b387-41c4-92fd-1ceed53cc1dc None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:32.885472 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 294/579] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:32.886736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a41ebc-b387-41c4-92fd-1ceed53cc1dc None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:32.898474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:32.910224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37721b3d-d780-4544-83c0-e45653a5b35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:32.911326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37721b3d-d780-4544-83c0-e45653a5b35e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:32.911674 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37721b3d-d780-4544-83c0-e45653a5b35e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:32.912124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37721b3d-d780-4544-83c0-e45653a5b35e None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:32.913380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37721b3d-d780-4544-83c0-e45653a5b35e None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:32.913843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37721b3d-d780-4544-83c0-e45653a5b35e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:32.916688 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37721b3d-d780-4544-83c0-e45653a5b35e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:32.934201 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 286/580] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:32.935784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37721b3d-d780-4544-83c0-e45653a5b35e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:33.023358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a41ebc-b387-41c4-92fd-1ceed53cc1dc None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:33.097773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35047b3-3a92-4440-9b71-51fb439ce882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:33.098635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37721b3d-d780-4544-83c0-e45653a5b35e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:33.099550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35047b3-3a92-4440-9b71-51fb439ce882 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:33.100300 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35047b3-3a92-4440-9b71-51fb439ce882 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:33.101029 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35047b3-3a92-4440-9b71-51fb439ce882 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:33.102800 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35047b3-3a92-4440-9b71-51fb439ce882 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:33.103694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35047b3-3a92-4440-9b71-51fb439ce882 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:33.106578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35047b3-3a92-4440-9b71-51fb439ce882 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:33.121026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:33.138494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 295/581] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Aug 22 15:49:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:33.140150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35047b3-3a92-4440-9b71-51fb439ce882 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:33.169122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0024964-8db0-4ced-9e09-afa2f8b882bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:33.170163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0024964-8db0-4ced-9e09-afa2f8b882bb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:33.170625 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0024964-8db0-4ced-9e09-afa2f8b882bb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:33.171074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0024964-8db0-4ced-9e09-afa2f8b882bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:33.191453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0024964-8db0-4ced-9e09-afa2f8b882bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:33.194069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0024964-8db0-4ced-9e09-afa2f8b882bb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c0024964-8db0-4ced-9e09-afa2f8b882bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:33.219801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:33.220931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:33.221823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:33.221823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:33.221823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:33.221823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 287/582] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:33.222984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0024964-8db0-4ced-9e09-afa2f8b882bb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:33.288380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:33.293971 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35047b3-3a92-4440-9b71-51fb439ce882 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:33.363577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a5a7d-fd0c-478f-98cd-52eac80ae457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:33.364161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a5a7d-fd0c-478f-98cd-52eac80ae457 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:33.364438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a5a7d-fd0c-478f-98cd-52eac80ae457 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:33.364709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a5a7d-fd0c-478f-98cd-52eac80ae457 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:33.374618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a5a7d-fd0c-478f-98cd-52eac80ae457 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:33.376450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a5a7d-fd0c-478f-98cd-52eac80ae457 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:33.380469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0024964-8db0-4ced-9e09-afa2f8b882bb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-260a5a7d-fd0c-478f-98cd-52eac80ae457 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:33.392547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:33.393516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:33.394521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:33.394521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:33.394521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:33.394521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:33.394521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:33.394521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:33.394521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:33.394521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:33.398405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 296/583] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:33.399382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a5a7d-fd0c-478f-98cd-52eac80ae457 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:33.421344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1990de-eda9-441d-adf7-4d76cb1c47ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:33.422071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1990de-eda9-441d-adf7-4d76cb1c47ab None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:33.422357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1990de-eda9-441d-adf7-4d76cb1c47ab None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:33.422675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1990de-eda9-441d-adf7-4d76cb1c47ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:33.434225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1990de-eda9-441d-adf7-4d76cb1c47ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:33.435735 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1990de-eda9-441d-adf7-4d76cb1c47ab None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-9e1990de-eda9-441d-adf7-4d76cb1c47ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:33.456222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:33.457555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:33.458562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:33.458562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:33.458562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:33.458562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 288/584] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:33.458562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1990de-eda9-441d-adf7-4d76cb1c47ab None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:33.483701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:33.538642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a5a7d-fd0c-478f-98cd-52eac80ae457 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:33.585719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5a9d6-be5b-480e-8ebd-41c3f6f13c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:33.586586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5a9d6-be5b-480e-8ebd-41c3f6f13c8d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:33.587050 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5a9d6-be5b-480e-8ebd-41c3f6f13c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:33.587413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5a9d6-be5b-480e-8ebd-41c3f6f13c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:33.602484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5a9d6-be5b-480e-8ebd-41c3f6f13c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:33.605491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea5a9d6-be5b-480e-8ebd-41c3f6f13c8d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:33.610664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:33.627128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1990de-eda9-441d-adf7-4d76cb1c47ab None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-eea5a9d6-be5b-480e-8ebd-41c3f6f13c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:33.629046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:33.631805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:33.639580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:33.639580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:33.639580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:33.639580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 297/585] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:33.639580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5a9d6-be5b-480e-8ebd-41c3f6f13c8d None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:33.705402 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc08391-ed66-4c54-b5ad-1c11948749ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:33.706364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc08391-ed66-4c54-b5ad-1c11948749ed None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:33.706919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc08391-ed66-4c54-b5ad-1c11948749ed None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:33.707125 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc08391-ed66-4c54-b5ad-1c11948749ed None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:33.708051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc08391-ed66-4c54-b5ad-1c11948749ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:33.708545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc08391-ed66-4c54-b5ad-1c11948749ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:33.710527 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc08391-ed66-4c54-b5ad-1c11948749ed None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:33.730808 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 289/586] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:33.732241 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc08391-ed66-4c54-b5ad-1c11948749ed None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:33.828682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5a9d6-be5b-480e-8ebd-41c3f6f13c8d None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:33.841527 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:33.875629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb3b7f-23b6-47a7-b8dd-441a6af7c7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:33.876417 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb3b7f-23b6-47a7-b8dd-441a6af7c7ea None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:33.876752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb3b7f-23b6-47a7-b8dd-441a6af7c7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:33.877237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb3b7f-23b6-47a7-b8dd-441a6af7c7ea None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:33.878079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb3b7f-23b6-47a7-b8dd-441a6af7c7ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:33.878504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb3b7f-23b6-47a7-b8dd-441a6af7c7ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:33.880038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb3b7f-23b6-47a7-b8dd-441a6af7c7ea None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:33.893082 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 298/587] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:33.894427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb3b7f-23b6-47a7-b8dd-441a6af7c7ea None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:33.912684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc08391-ed66-4c54-b5ad-1c11948749ed None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:33.967467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22717d25-1d4e-48f3-80ae-880d984787aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:33.968112 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22717d25-1d4e-48f3-80ae-880d984787aa None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:33.968365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22717d25-1d4e-48f3-80ae-880d984787aa None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:33.968636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22717d25-1d4e-48f3-80ae-880d984787aa None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:33.969294 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22717d25-1d4e-48f3-80ae-880d984787aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:33.969595 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22717d25-1d4e-48f3-80ae-880d984787aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:33.971073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22717d25-1d4e-48f3-80ae-880d984787aa None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:33.983899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 290/588] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:33.989383 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22717d25-1d4e-48f3-80ae-880d984787aa None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:34.008232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:34.023553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb3b7f-23b6-47a7-b8dd-441a6af7c7ea None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:34.066367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84885d04-cc4e-4c46-899b-21ac04ba854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:34.067051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84885d04-cc4e-4c46-899b-21ac04ba854e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:34.067398 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84885d04-cc4e-4c46-899b-21ac04ba854e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:34.067665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84885d04-cc4e-4c46-899b-21ac04ba854e None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:34.068368 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84885d04-cc4e-4c46-899b-21ac04ba854e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:34.068678 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84885d04-cc4e-4c46-899b-21ac04ba854e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:34.070130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84885d04-cc4e-4c46-899b-21ac04ba854e None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:34.082961 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 299/589] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:34.083803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84885d04-cc4e-4c46-899b-21ac04ba854e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:34.131259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22717d25-1d4e-48f3-80ae-880d984787aa None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:34.132972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:34.200402 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804676b-70fb-4e5b-9be3-be37dbc1b1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:34.201247 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804676b-70fb-4e5b-9be3-be37dbc1b1ff None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:34.201457 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804676b-70fb-4e5b-9be3-be37dbc1b1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:34.201835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804676b-70fb-4e5b-9be3-be37dbc1b1ff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:34.211006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804676b-70fb-4e5b-9be3-be37dbc1b1ff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:34.212545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804676b-70fb-4e5b-9be3-be37dbc1b1ff None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c804676b-70fb-4e5b-9be3-be37dbc1b1ff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:34.232641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:34.234704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:34.236108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:34.236108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:34.236108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:34.236108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:34.236108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:34.236108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:34.236108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:34.236108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:34.236108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 15:49:34.236108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:34.236108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 291/590] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:34.236108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804676b-70fb-4e5b-9be3-be37dbc1b1ff None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:34.252770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84885d04-cc4e-4c46-899b-21ac04ba854e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:34.292788 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fb16c-4423-4fa5-a506-bbf408660a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:34.293468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fb16c-4423-4fa5-a506-bbf408660a2f None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:34.293745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fb16c-4423-4fa5-a506-bbf408660a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:34.294014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fb16c-4423-4fa5-a506-bbf408660a2f None admin] PATH_INFO: `/v3/projects/318c7f21f9d14e149f668863f748e89f/users/20e4a18ab77642baa9adb9a4b49fbcc2/roles/2160bd7482684f0295250953180cc1b9` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:34.315753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fb16c-4423-4fa5-a506-bbf408660a2f None admin] RBAC: Authorizing `identity:create_grant(project_id=318c7f21f9d14e149f668863f748e89f, user_id=20e4a18ab77642baa9adb9a4b49fbcc2, role_id=2160bd7482684f0295250953180cc1b9)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:34.317311 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fb16c-4423-4fa5-a506-bbf408660a2f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:34.324028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:34.335749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 300/591] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:49:34 2022] PUT /identity/v3/projects/318c7f21f9d14e149f668863f748e89f/users/20e4a18ab77642baa9adb9a4b49fbcc2/roles/2160bd7482684f0295250953180cc1b9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:49:34.336653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fb16c-4423-4fa5-a506-bbf408660a2f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:34.372513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804676b-70fb-4e5b-9be3-be37dbc1b1ff None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:34.433294 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc420c-a404-43ec-8cfd-84f789bdaa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:34.434345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc420c-a404-43ec-8cfd-84f789bdaa98 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:34.434791 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc420c-a404-43ec-8cfd-84f789bdaa98 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:34.435218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc420c-a404-43ec-8cfd-84f789bdaa98 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:34.447909 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc420c-a404-43ec-8cfd-84f789bdaa98 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:34.449469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc420c-a404-43ec-8cfd-84f789bdaa98 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:34.452034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-99bc420c-a404-43ec-8cfd-84f789bdaa98 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:34.472254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:34.473743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:34.475871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:34.475871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:34.475871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:34.475871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:34.475871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:34.475871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:34.475871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:34.475871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:34.475871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:49:34.475871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:34.475871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 292/592] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:34.475871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06b15-97cc-4a5b-878a-b402df64b99f None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:34.477064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06b15-97cc-4a5b-878a-b402df64b99f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:34.477064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06b15-97cc-4a5b-878a-b402df64b99f None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:34.483640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 293/593] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:34.484956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb06b15-97cc-4a5b-878a-b402df64b99f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:34.497803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fb16c-4423-4fa5-a506-bbf408660a2f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:34.550336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f6a25-366c-49ca-8057-1aebf3a2dde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:34.551279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f6a25-366c-49ca-8057-1aebf3a2dde3 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:34.551694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f6a25-366c-49ca-8057-1aebf3a2dde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:34.552041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f6a25-366c-49ca-8057-1aebf3a2dde3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:34.562565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f6a25-366c-49ca-8057-1aebf3a2dde3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:34.564929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f6a25-366c-49ca-8057-1aebf3a2dde3 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-e15f6a25-366c-49ca-8057-1aebf3a2dde3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:34.577756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:34.578963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:34.579851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:34.579851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:34.579851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:34.579851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:34.579851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:34.579851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:34.579851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:34.579851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:34.579851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 301/594] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:34.579851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f6a25-366c-49ca-8057-1aebf3a2dde3 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:34.648942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb06b15-97cc-4a5b-878a-b402df64b99f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:34.705826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211e772-00e5-4289-9049-cb3e8b61a6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:34.706558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211e772-00e5-4289-9049-cb3e8b61a6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:34.706960 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211e772-00e5-4289-9049-cb3e8b61a6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:34.707289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211e772-00e5-4289-9049-cb3e8b61a6c6 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:34.708191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211e772-00e5-4289-9049-cb3e8b61a6c6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:34.708580 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211e772-00e5-4289-9049-cb3e8b61a6c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:34.710461 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211e772-00e5-4289-9049-cb3e8b61a6c6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:34.713026 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:34.737613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 294/595] 10.222.0.77 () {56 vars in 1139 bytes} [Mon Aug 22 15:49:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:34.738796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518eb06-dee2-4ef6-8fe1-13c47daec44f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:34.739090 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518eb06-dee2-4ef6-8fe1-13c47daec44f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:34.739360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518eb06-dee2-4ef6-8fe1-13c47daec44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:34.743739 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f6a25-366c-49ca-8057-1aebf3a2dde3 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:34.759519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f518eb06-dee2-4ef6-8fe1-13c47daec44f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:34.760867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f518eb06-dee2-4ef6-8fe1-13c47daec44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:34.803770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785fb7b-dcb3-4357-81b6-9a864e79306b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:34.804391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785fb7b-dcb3-4357-81b6-9a864e79306b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:34.804662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785fb7b-dcb3-4357-81b6-9a864e79306b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:34.804946 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785fb7b-dcb3-4357-81b6-9a864e79306b None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:34.805682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785fb7b-dcb3-4357-81b6-9a864e79306b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:34.805981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785fb7b-dcb3-4357-81b6-9a864e79306b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:34.807686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785fb7b-dcb3-4357-81b6-9a864e79306b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:34.824022 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:34.841079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 302/596] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Aug 22 15:49:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:34.841869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785fb7b-dcb3-4357-81b6-9a864e79306b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:34.874876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 295/597] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:34.874876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518eb06-dee2-4ef6-8fe1-13c47daec44f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:35.011249 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785fb7b-dcb3-4357-81b6-9a864e79306b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:35.024581 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518eb06-dee2-4ef6-8fe1-13c47daec44f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:35.052909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2de65-ade8-45e2-b101-abc6e54cc0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:35.053737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2de65-ade8-45e2-b101-abc6e54cc0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:35.054155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2de65-ade8-45e2-b101-abc6e54cc0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:35.054392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2de65-ade8-45e2-b101-abc6e54cc0d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:35.055668 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2de65-ade8-45e2-b101-abc6e54cc0d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:35.056194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2de65-ade8-45e2-b101-abc6e54cc0d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:35.057877 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2de65-ade8-45e2-b101-abc6e54cc0d0 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:35.067691 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:35.073086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 303/598] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:35.074230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2de65-ade8-45e2-b101-abc6e54cc0d0 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:35.087411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45650e07-bfc1-47c6-8575-3d28d0584a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:35.089154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45650e07-bfc1-47c6-8575-3d28d0584a67 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:35.089910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45650e07-bfc1-47c6-8575-3d28d0584a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:35.090783 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45650e07-bfc1-47c6-8575-3d28d0584a67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:35.113421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45650e07-bfc1-47c6-8575-3d28d0584a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:35.117669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45650e07-bfc1-47c6-8575-3d28d0584a67 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:35.144981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-45650e07-bfc1-47c6-8575-3d28d0584a67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:35.152107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:35.153314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:35.154387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:35.154387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:35.154387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:35.160937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 296/599] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:35.160937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45650e07-bfc1-47c6-8575-3d28d0584a67 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:35.217196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2de65-ade8-45e2-b101-abc6e54cc0d0 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:35.261209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4fd49-e8c7-4d05-b45f-f8d5475fa34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:35.262588 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4fd49-e8c7-4d05-b45f-f8d5475fa34d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:35.262915 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4fd49-e8c7-4d05-b45f-f8d5475fa34d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:35.263313 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4fd49-e8c7-4d05-b45f-f8d5475fa34d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:35.275641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45650e07-bfc1-47c6-8575-3d28d0584a67 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:35.283182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4fd49-e8c7-4d05-b45f-f8d5475fa34d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:35.284786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4fd49-e8c7-4d05-b45f-f8d5475fa34d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-7dc4fd49-e8c7-4d05-b45f-f8d5475fa34d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:35.307865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:35.309699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:35.311356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:35.311356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:35.311356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:35.311356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 304/600] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:35.311356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4fd49-e8c7-4d05-b45f-f8d5475fa34d None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:35.344690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c5fea-c37b-4a1d-9973-1c250c32efa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:35.345552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5fea-c37b-4a1d-9973-1c250c32efa8 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:35.345929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5fea-c37b-4a1d-9973-1c250c32efa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:35.346299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5fea-c37b-4a1d-9973-1c250c32efa8 None admin] PATH_INFO: `/v3/projects/318c7f21f9d14e149f668863f748e89f/users/3f7c46f4dc084a948bd09ca9b86c2748/roles/2160bd7482684f0295250953180cc1b9` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:35.365707 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c5fea-c37b-4a1d-9973-1c250c32efa8 None admin] RBAC: Authorizing `identity:create_grant(project_id=318c7f21f9d14e149f668863f748e89f, user_id=3f7c46f4dc084a948bd09ca9b86c2748, role_id=2160bd7482684f0295250953180cc1b9)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:35.367462 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c5fea-c37b-4a1d-9973-1c250c32efa8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:35.392824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 297/601] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:49:35 2022] PUT /identity/v3/projects/318c7f21f9d14e149f668863f748e89f/users/3f7c46f4dc084a948bd09ca9b86c2748/roles/2160bd7482684f0295250953180cc1b9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:49:35.394859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c5fea-c37b-4a1d-9973-1c250c32efa8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:35.461469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:35.476745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4fd49-e8c7-4d05-b45f-f8d5475fa34d None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:35.492986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:35.544754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167fb0a-252d-4998-bb64-3eafed7a2ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:35.546269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167fb0a-252d-4998-bb64-3eafed7a2ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:35.547093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167fb0a-252d-4998-bb64-3eafed7a2ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:35.547779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167fb0a-252d-4998-bb64-3eafed7a2ac5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:35.571657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167fb0a-252d-4998-bb64-3eafed7a2ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-6167fb0a-252d-4998-bb64-3eafed7a2ac5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:35.582171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:35.584427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:35.586272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:35.586272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:35.586272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:35.586272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:35.586272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:35.586272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:35.586272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:35.586272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:35.586272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:35.586272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:35.586272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:35.586272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:35.595210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 305/602] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:35.597442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167fb0a-252d-4998-bb64-3eafed7a2ac5 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:35.617484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c5fea-c37b-4a1d-9973-1c250c32efa8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:35.675245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983beb0-f4f5-4d19-9b8c-272ee878342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:35.675918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983beb0-f4f5-4d19-9b8c-272ee878342f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:35.676328 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983beb0-f4f5-4d19-9b8c-272ee878342f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:35.676649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983beb0-f4f5-4d19-9b8c-272ee878342f None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:35.677460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983beb0-f4f5-4d19-9b8c-272ee878342f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:35.677835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983beb0-f4f5-4d19-9b8c-272ee878342f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:35.680102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983beb0-f4f5-4d19-9b8c-272ee878342f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:35.701255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 298/603] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:35.702559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983beb0-f4f5-4d19-9b8c-272ee878342f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:35.808680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167fb0a-252d-4998-bb64-3eafed7a2ac5 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:35.836289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:35.859800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983beb0-f4f5-4d19-9b8c-272ee878342f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:35.868497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb24360-6aa0-4492-9102-9fe4172eb57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:35.869938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb24360-6aa0-4492-9102-9fe4172eb57f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:35.870675 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb24360-6aa0-4492-9102-9fe4172eb57f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:35.871340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb24360-6aa0-4492-9102-9fe4172eb57f None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:35.872768 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb24360-6aa0-4492-9102-9fe4172eb57f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:35.873532 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb24360-6aa0-4492-9102-9fe4172eb57f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:35.876161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb24360-6aa0-4492-9102-9fe4172eb57f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:35.900299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 306/604] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:35.901855 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb24360-6aa0-4492-9102-9fe4172eb57f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:35.925515 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90e83e-ece4-4993-978f-ec8236aef21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:35.926306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90e83e-ece4-4993-978f-ec8236aef21d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:35.926712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90e83e-ece4-4993-978f-ec8236aef21d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:35.927193 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90e83e-ece4-4993-978f-ec8236aef21d None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:35.928489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90e83e-ece4-4993-978f-ec8236aef21d None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:35.928887 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90e83e-ece4-4993-978f-ec8236aef21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:35.930804 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90e83e-ece4-4993-978f-ec8236aef21d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:35.946643 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 299/605] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:35.946643 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90e83e-ece4-4993-978f-ec8236aef21d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:35.966710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:36.067862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90e83e-ece4-4993-978f-ec8236aef21d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:36.097601 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb24360-6aa0-4492-9102-9fe4172eb57f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:36.109771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee979-c83c-4401-a7e4-1341667155d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:36.110423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee979-c83c-4401-a7e4-1341667155d7 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:36.110756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee979-c83c-4401-a7e4-1341667155d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:36.111014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee979-c83c-4401-a7e4-1341667155d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:36.119782 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee979-c83c-4401-a7e4-1341667155d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:36.121293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee979-c83c-4401-a7e4-1341667155d7 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-f49ee979-c83c-4401-a7e4-1341667155d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:36.135496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:36.137099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:36.139396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:36.139396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:36.139396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:36.139396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:36.139396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:36.139396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:36.139396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:36.139396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:36.139396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 300/606] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:36.139396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee979-c83c-4401-a7e4-1341667155d7 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:36.149942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:36.168190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5e939-e0ec-45e4-935d-1d7bd2911a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:36.169748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5e939-e0ec-45e4-935d-1d7bd2911a21 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:36.170481 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5e939-e0ec-45e4-935d-1d7bd2911a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:36.171241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5e939-e0ec-45e4-935d-1d7bd2911a21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:36.183811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5e939-e0ec-45e4-935d-1d7bd2911a21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:36.186997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5e939-e0ec-45e4-935d-1d7bd2911a21 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-eed5e939-e0ec-45e4-935d-1d7bd2911a21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:36.207761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:36.209556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:36.211572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:36.211572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:36.211572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:36.211572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:36.211572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:36.211572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:36.211572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:36.211572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:36.215076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 307/607] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:36.216786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5e939-e0ec-45e4-935d-1d7bd2911a21 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:36.271607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee979-c83c-4401-a7e4-1341667155d7 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:36.336402 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aae6e-15a8-4d9f-b02a-9a9934586a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:36.337634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aae6e-15a8-4d9f-b02a-9a9934586a2c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:36.338005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aae6e-15a8-4d9f-b02a-9a9934586a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:36.338491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aae6e-15a8-4d9f-b02a-9a9934586a2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:36.348260 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:36.356306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aae6e-15a8-4d9f-b02a-9a9934586a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:36.358202 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aae6e-15a8-4d9f-b02a-9a9934586a2c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:36.369465 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5e939-e0ec-45e4-935d-1d7bd2911a21 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-755aae6e-15a8-4d9f-b02a-9a9934586a2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:36.375127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:36.376867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:36.378392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:36.378392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:36.378392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:36.381139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 301/608] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:36.382065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aae6e-15a8-4d9f-b02a-9a9934586a2c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:36.415380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45720120-9fbb-410a-8277-cb10acb4fecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:36.416024 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45720120-9fbb-410a-8277-cb10acb4fecf None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:36.416380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45720120-9fbb-410a-8277-cb10acb4fecf None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:36.416992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45720120-9fbb-410a-8277-cb10acb4fecf None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:36.418494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45720120-9fbb-410a-8277-cb10acb4fecf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:36.419157 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45720120-9fbb-410a-8277-cb10acb4fecf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:36.421745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45720120-9fbb-410a-8277-cb10acb4fecf None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:36.451091 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 308/609] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:36.452751 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d6804-1fe0-4a96-abf4-029be31e6244 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:36.453033 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d6804-1fe0-4a96-abf4-029be31e6244 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:36.453302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d6804-1fe0-4a96-abf4-029be31e6244 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:36.455039 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 309/610] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:36.455387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d6804-1fe0-4a96-abf4-029be31e6244 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:36.457988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:36.507856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aae6e-15a8-4d9f-b02a-9a9934586a2c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:36.560483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91387a2d-4d84-407e-9b34-d384671e8d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:36.561402 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387a2d-4d84-407e-9b34-d384671e8d91 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:36.561838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387a2d-4d84-407e-9b34-d384671e8d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:36.562268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91387a2d-4d84-407e-9b34-d384671e8d91 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:36.563224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91387a2d-4d84-407e-9b34-d384671e8d91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:36.563524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91387a2d-4d84-407e-9b34-d384671e8d91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:36.565499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91387a2d-4d84-407e-9b34-d384671e8d91 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:36.584538 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 302/611] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:36.585846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91387a2d-4d84-407e-9b34-d384671e8d91 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:36.603414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d6804-1fe0-4a96-abf4-029be31e6244 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:36.649746 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207b308-5d36-4405-b974-be6e3c1346b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:36.650578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207b308-5d36-4405-b974-be6e3c1346b4 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:36.651010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207b308-5d36-4405-b974-be6e3c1346b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:36.651376 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207b308-5d36-4405-b974-be6e3c1346b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:36.652154 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207b308-5d36-4405-b974-be6e3c1346b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:36.652550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207b308-5d36-4405-b974-be6e3c1346b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:36.654078 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207b308-5d36-4405-b974-be6e3c1346b4 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:36.672530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 310/612] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:36.679619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618444d7-c1a0-4fe5-8ae4-63a644be189b None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:36.679619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618444d7-c1a0-4fe5-8ae4-63a644be189b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:36.679619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618444d7-c1a0-4fe5-8ae4-63a644be189b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:36.705376 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-618444d7-c1a0-4fe5-8ae4-63a644be189b None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:36.707234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-618444d7-c1a0-4fe5-8ae4-63a644be189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:36.710807 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:36.750570 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91387a2d-4d84-407e-9b34-d384671e8d91 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:36.773817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:36.797074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95928d97-7c36-4e29-baf0-9ef982a103fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:36.797941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 311/613] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:36.799400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618444d7-c1a0-4fe5-8ae4-63a644be189b None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:36.802287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95928d97-7c36-4e29-baf0-9ef982a103fe None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:36.803023 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95928d97-7c36-4e29-baf0-9ef982a103fe None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:36.803861 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95928d97-7c36-4e29-baf0-9ef982a103fe None admin] PATH_INFO: `/v3/projects/318c7f21f9d14e149f668863f748e89f/users/80b255bd61e3445ab154f01fea9a95b9/roles/2160bd7482684f0295250953180cc1b9` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:36.828576 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95928d97-7c36-4e29-baf0-9ef982a103fe None admin] RBAC: Authorizing `identity:create_grant(project_id=318c7f21f9d14e149f668863f748e89f, user_id=80b255bd61e3445ab154f01fea9a95b9, role_id=2160bd7482684f0295250953180cc1b9)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:36.831993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95928d97-7c36-4e29-baf0-9ef982a103fe None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:36.860234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 303/614] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:49:36 2022] PUT /identity/v3/projects/318c7f21f9d14e149f668863f748e89f/users/80b255bd61e3445ab154f01fea9a95b9/roles/2160bd7482684f0295250953180cc1b9 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:49:36.861038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95928d97-7c36-4e29-baf0-9ef982a103fe None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:36.937377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618444d7-c1a0-4fe5-8ae4-63a644be189b None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:37.017414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9e37a-89a1-4074-a56e-4ae422553a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:37.019747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9e37a-89a1-4074-a56e-4ae422553a6f None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:37.020200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9e37a-89a1-4074-a56e-4ae422553a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:37.020656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9e37a-89a1-4074-a56e-4ae422553a6f None admin] PATH_INFO: `/v3/projects/318c7f21f9d14e149f668863f748e89f/users/104abc0b38524a2f95ffe96c5872362c/roles/2160bd7482684f0295250953180cc1b9` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:37.023668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95928d97-7c36-4e29-baf0-9ef982a103fe None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:37.045419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:37.084119 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9e37a-89a1-4074-a56e-4ae422553a6f None admin] RBAC: Authorizing `identity:create_grant(project_id=318c7f21f9d14e149f668863f748e89f, user_id=104abc0b38524a2f95ffe96c5872362c, role_id=2160bd7482684f0295250953180cc1b9)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:37.085634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9e37a-89a1-4074-a56e-4ae422553a6f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:37.100735 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e988ac0-72dc-441b-86ae-acc90c9cf891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:37.103093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e988ac0-72dc-441b-86ae-acc90c9cf891 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:37.103993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e988ac0-72dc-441b-86ae-acc90c9cf891 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:37.104471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e988ac0-72dc-441b-86ae-acc90c9cf891 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:37.115437 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 312/615] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:49:36 2022] PUT /identity/v3/projects/318c7f21f9d14e149f668863f748e89f/users/104abc0b38524a2f95ffe96c5872362c/roles/2160bd7482684f0295250953180cc1b9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:49:37.121788 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e988ac0-72dc-441b-86ae-acc90c9cf891 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:37.125150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e988ac0-72dc-441b-86ae-acc90c9cf891 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-8e988ac0-72dc-441b-86ae-acc90c9cf891 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:37.149987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:37.151156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:37.152124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:37.152124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:37.152124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:37.152124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:37.152124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:37.152124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:37.152124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:37.152124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:37.152124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:49:37.152124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:37.152681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 304/616] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:49:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:37.160418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9e37a-89a1-4074-a56e-4ae422553a6f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:37.303579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e988ac0-72dc-441b-86ae-acc90c9cf891 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:37.344445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9e37a-89a1-4074-a56e-4ae422553a6f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:37.385705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:37.420195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e4347-8dfa-4b0b-9e0c-f69046455795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:37.421028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e4347-8dfa-4b0b-9e0c-f69046455795 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:37.421327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e4347-8dfa-4b0b-9e0c-f69046455795 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:37.421724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e4347-8dfa-4b0b-9e0c-f69046455795 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:37.423000 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e4347-8dfa-4b0b-9e0c-f69046455795 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:37.423527 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e4347-8dfa-4b0b-9e0c-f69046455795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:37.426375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e4347-8dfa-4b0b-9e0c-f69046455795 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:37.461365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 313/617] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Aug 22 15:49:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:37.467141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e4347-8dfa-4b0b-9e0c-f69046455795 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:37.480956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e988ac0-72dc-441b-86ae-acc90c9cf891 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:37.521846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ff2ec-abdc-4233-a048-81bc904082c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:37.522879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ff2ec-abdc-4233-a048-81bc904082c0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:37.523382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ff2ec-abdc-4233-a048-81bc904082c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:37.523912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ff2ec-abdc-4233-a048-81bc904082c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:37.537379 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ff2ec-abdc-4233-a048-81bc904082c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-663ff2ec-abdc-4233-a048-81bc904082c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:37.543747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:37.544798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:37.545690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:37.545690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:37.545690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:37.545690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:37.545690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:37.545690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:37.545690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:37.545690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:37.545690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:37.545690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:37.545690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:37.545690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:37.548622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 305/618] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:37.558793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ff2ec-abdc-4233-a048-81bc904082c0 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:37.571736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:37.652107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e4347-8dfa-4b0b-9e0c-f69046455795 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:37.699015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:37.720254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ff2ec-abdc-4233-a048-81bc904082c0 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:37.722935 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79b260-27e4-425a-a119-0c1ccfcba49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:37.723611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79b260-27e4-425a-a119-0c1ccfcba49f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:37.723885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79b260-27e4-425a-a119-0c1ccfcba49f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:37.724153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79b260-27e4-425a-a119-0c1ccfcba49f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:37.748158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79b260-27e4-425a-a119-0c1ccfcba49f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:37.749684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79b260-27e4-425a-a119-0c1ccfcba49f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-5d79b260-27e4-425a-a119-0c1ccfcba49f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:37.780734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:37.781912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:37.782828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:37.782828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:37.782828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:37.782828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 314/619] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:37.790121 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79b260-27e4-425a-a119-0c1ccfcba49f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:37.802802 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cf9f8-ccdd-42ad-b4c4-7a0d61f4704e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:37.803440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cf9f8-ccdd-42ad-b4c4-7a0d61f4704e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:37.803721 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cf9f8-ccdd-42ad-b4c4-7a0d61f4704e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:37.803991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cf9f8-ccdd-42ad-b4c4-7a0d61f4704e None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:37.804678 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cf9f8-ccdd-42ad-b4c4-7a0d61f4704e None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:37.804976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cf9f8-ccdd-42ad-b4c4-7a0d61f4704e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:37.806396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cf9f8-ccdd-42ad-b4c4-7a0d61f4704e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:37.823758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 306/620] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:37.831483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cf9f8-ccdd-42ad-b4c4-7a0d61f4704e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:37.947942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cf9f8-ccdd-42ad-b4c4-7a0d61f4704e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:37.984539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:37.984745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b091b-f6e8-40d7-a3d2-c7a3dae33935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:37.985231 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b091b-f6e8-40d7-a3d2-c7a3dae33935 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:37.985853 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b091b-f6e8-40d7-a3d2-c7a3dae33935 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:37.985853 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b091b-f6e8-40d7-a3d2-c7a3dae33935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:37.992367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79b260-27e4-425a-a119-0c1ccfcba49f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:37.998393 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b091b-f6e8-40d7-a3d2-c7a3dae33935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:37.999941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b091b-f6e8-40d7-a3d2-c7a3dae33935 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-a08b091b-f6e8-40d7-a3d2-c7a3dae33935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:38.016044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:38.017058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:38.017961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:38.017961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:38.017961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:38.017961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 307/621] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:38.018848 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcce5a-03aa-47fd-8412-5eadaa509637 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:38.019133 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcce5a-03aa-47fd-8412-5eadaa509637 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:38.019406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcce5a-03aa-47fd-8412-5eadaa509637 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:38.022661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 308/622] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:38.025846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcce5a-03aa-47fd-8412-5eadaa509637 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:38.030638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:38.050228 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f827c-9007-4f02-be23-79f6296aac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:38.051091 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f827c-9007-4f02-be23-79f6296aac74 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:38.051463 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f827c-9007-4f02-be23-79f6296aac74 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:38.051837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f827c-9007-4f02-be23-79f6296aac74 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:38.052612 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f827c-9007-4f02-be23-79f6296aac74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:38.053078 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f827c-9007-4f02-be23-79f6296aac74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:38.055608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f827c-9007-4f02-be23-79f6296aac74 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:38.074749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 315/623] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:38.076798 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f93957-5274-4903-bcdd-cbddc5a57fbf None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:38.077356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f93957-5274-4903-bcdd-cbddc5a57fbf None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:38.077924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f93957-5274-4903-bcdd-cbddc5a57fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:38.102791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-04f93957-5274-4903-bcdd-cbddc5a57fbf None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:38.105269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-04f93957-5274-4903-bcdd-cbddc5a57fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:38.183236 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcce5a-03aa-47fd-8412-5eadaa509637 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:38.213983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 316/624] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:38.215743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f93957-5274-4903-bcdd-cbddc5a57fbf None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:38.253263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ae591-47a3-409e-bd46-bb7511fad7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:38.254621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ae591-47a3-409e-bd46-bb7511fad7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:38.255244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ae591-47a3-409e-bd46-bb7511fad7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:38.255800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ae591-47a3-409e-bd46-bb7511fad7a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:38.257241 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ae591-47a3-409e-bd46-bb7511fad7a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:38.260061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ae591-47a3-409e-bd46-bb7511fad7a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:38.262629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ae591-47a3-409e-bd46-bb7511fad7a1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:38.311612 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 309/625] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:38.320929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ae591-47a3-409e-bd46-bb7511fad7a1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:38.438679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:38.469295 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:38.487854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f93957-5274-4903-bcdd-cbddc5a57fbf None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:38.540422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ae591-47a3-409e-bd46-bb7511fad7a1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:38.605897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f8c8b-0342-4d37-a5b9-f8a7e9021389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:38.606881 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f8c8b-0342-4d37-a5b9-f8a7e9021389 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:38.607306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f8c8b-0342-4d37-a5b9-f8a7e9021389 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:38.607744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f8c8b-0342-4d37-a5b9-f8a7e9021389 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:38.611886 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56905e54-7f32-4946-b517-3dc7214efa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:38.613954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56905e54-7f32-4946-b517-3dc7214efa69 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:38.618358 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56905e54-7f32-4946-b517-3dc7214efa69 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:38.618787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56905e54-7f32-4946-b517-3dc7214efa69 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:38.620826 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f8c8b-0342-4d37-a5b9-f8a7e9021389 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:38.622828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f8c8b-0342-4d37-a5b9-f8a7e9021389 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:38.635787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56905e54-7f32-4946-b517-3dc7214efa69 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:38.637550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56905e54-7f32-4946-b517-3dc7214efa69 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-1b7f8c8b-0342-4d37-a5b9-f8a7e9021389 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:38.642076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:38.643149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:38.644058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:38.644058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:38.644058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:38.644058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:38.644058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:38.644058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:38.644058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:38.644058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:38.649258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 317/626] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:38.650537 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f8c8b-0342-4d37-a5b9-f8a7e9021389 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-56905e54-7f32-4946-b517-3dc7214efa69 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:38.655778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:38.656838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:38.657815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:38.657815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:38.657815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:38.657815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:38.657815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:38.657815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:38.657815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:38.657815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:38.657815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:49:38.657815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:38.661716 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 310/627] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 22 15:49:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:38.667298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56905e54-7f32-4946-b517-3dc7214efa69 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:38.775697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f8c8b-0342-4d37-a5b9-f8a7e9021389 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:38.819444 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba363a2-366b-4261-9f62-5cc0a18ed28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:38.820098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba363a2-366b-4261-9f62-5cc0a18ed28f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:38.820374 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba363a2-366b-4261-9f62-5cc0a18ed28f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:38.820714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba363a2-366b-4261-9f62-5cc0a18ed28f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:38.824199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56905e54-7f32-4946-b517-3dc7214efa69 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:38.832833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba363a2-366b-4261-9f62-5cc0a18ed28f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-fba363a2-366b-4261-9f62-5cc0a18ed28f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:38.840895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:38.842309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:38.844098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:38.844098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:38.844098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:38.844098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:38.844098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:38.844098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:38.844098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:38.844098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:38.844098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:38.844098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:38.844098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:38.844098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:38.847417 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 318/628] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:38.848445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba363a2-366b-4261-9f62-5cc0a18ed28f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:38.861412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:38.871935 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:38.887229 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51c26f-567e-4398-9573-d65af8cbe372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:38.888364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51c26f-567e-4398-9573-d65af8cbe372 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:38.888848 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51c26f-567e-4398-9573-d65af8cbe372 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:38.889441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51c26f-567e-4398-9573-d65af8cbe372 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:38.890519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51c26f-567e-4398-9573-d65af8cbe372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:38.891106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51c26f-567e-4398-9573-d65af8cbe372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:38.892826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51c26f-567e-4398-9573-d65af8cbe372 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:38.908105 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 311/629] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:38.909469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51c26f-567e-4398-9573-d65af8cbe372 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:39.007964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba363a2-366b-4261-9f62-5cc0a18ed28f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:39.049147 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609c5e4-0d55-4b79-8032-6651e68e12fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:39.049677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609c5e4-0d55-4b79-8032-6651e68e12fa None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:39.049943 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609c5e4-0d55-4b79-8032-6651e68e12fa None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:39.050219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609c5e4-0d55-4b79-8032-6651e68e12fa None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:39.051093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609c5e4-0d55-4b79-8032-6651e68e12fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:39.051467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609c5e4-0d55-4b79-8032-6651e68e12fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:39.053166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609c5e4-0d55-4b79-8032-6651e68e12fa None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:39.078660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 319/630] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 22 15:49:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:39.078660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609c5e4-0d55-4b79-8032-6651e68e12fa None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:39.092516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51c26f-567e-4398-9573-d65af8cbe372 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:39.132965 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70019af3-5a35-4cac-8f0e-e27313aa6914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:39.133993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70019af3-5a35-4cac-8f0e-e27313aa6914 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:39.134484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70019af3-5a35-4cac-8f0e-e27313aa6914 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:39.135162 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70019af3-5a35-4cac-8f0e-e27313aa6914 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:39.136173 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70019af3-5a35-4cac-8f0e-e27313aa6914 None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:39.136679 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70019af3-5a35-4cac-8f0e-e27313aa6914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:39.138300 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70019af3-5a35-4cac-8f0e-e27313aa6914 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:39.148840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 312/631] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:39.150104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70019af3-5a35-4cac-8f0e-e27313aa6914 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:39.170530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:39.213221 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609c5e4-0d55-4b79-8032-6651e68e12fa None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:39.220249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:39.255806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e3616-61e0-4cae-b05f-cea2008a7f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:39.257009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e3616-61e0-4cae-b05f-cea2008a7f45 None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:39.257469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e3616-61e0-4cae-b05f-cea2008a7f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:39.257763 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e3616-61e0-4cae-b05f-cea2008a7f45 None admin] PATH_INFO: `/v3/projects/318c7f21f9d14e149f668863f748e89f/users/7d8a49035be2479b87c797bf53c9919b/roles/2160bd7482684f0295250953180cc1b9` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:39.276296 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e3616-61e0-4cae-b05f-cea2008a7f45 None admin] RBAC: Authorizing `identity:create_grant(project_id=318c7f21f9d14e149f668863f748e89f, user_id=7d8a49035be2479b87c797bf53c9919b, role_id=2160bd7482684f0295250953180cc1b9)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:39.278083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e3616-61e0-4cae-b05f-cea2008a7f45 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:39.298937 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 320/632] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:49:39 2022] PUT /identity/v3/projects/318c7f21f9d14e149f668863f748e89f/users/7d8a49035be2479b87c797bf53c9919b/roles/2160bd7482684f0295250953180cc1b9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:49:39.300058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e3616-61e0-4cae-b05f-cea2008a7f45 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:39.300718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70019af3-5a35-4cac-8f0e-e27313aa6914 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:39.351846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974d640-d9b6-42b3-b33b-ca301f1191ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:39.352690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974d640-d9b6-42b3-b33b-ca301f1191ca None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:39.353095 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974d640-d9b6-42b3-b33b-ca301f1191ca None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:39.353514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974d640-d9b6-42b3-b33b-ca301f1191ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:39.445849 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e3616-61e0-4cae-b05f-cea2008a7f45 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:39.455785 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974d640-d9b6-42b3-b33b-ca301f1191ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:39.458234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974d640-d9b6-42b3-b33b-ca301f1191ca None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:39.467074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:39.497267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd46480-a37e-4e36-9b30-36890b02f1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:39.498092 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46480-a37e-4e36-9b30-36890b02f1ab None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:39.498436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46480-a37e-4e36-9b30-36890b02f1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:39.498905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd46480-a37e-4e36-9b30-36890b02f1ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:39.514187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd46480-a37e-4e36-9b30-36890b02f1ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:39.516043 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd46480-a37e-4e36-9b30-36890b02f1ab None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:39.522197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-9bd46480-a37e-4e36-9b30-36890b02f1ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:39.536737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:39.538543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:39.539623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:39.539623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:39.539623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:39.546923 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 321/633] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:39.549650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd46480-a37e-4e36-9b30-36890b02f1ab None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:39.596280 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 313/634] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:39.597340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273b8f-1e29-4462-8724-f85165cc6912 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:39.597624 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273b8f-1e29-4462-8724-f85165cc6912 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:39.597902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22273b8f-1e29-4462-8724-f85165cc6912 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:39.605061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 314/635] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:39.605568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22273b8f-1e29-4462-8724-f85165cc6912 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:39.726382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd46480-a37e-4e36-9b30-36890b02f1ab None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:39.777199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22273b8f-1e29-4462-8724-f85165cc6912 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:39.784114 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0d6cf-5d04-48f9-987c-33e2c2d9d79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:39.784817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0d6cf-5d04-48f9-987c-33e2c2d9d79d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:39.785195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0d6cf-5d04-48f9-987c-33e2c2d9d79d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:39.785520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0d6cf-5d04-48f9-987c-33e2c2d9d79d None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:39.786239 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0d6cf-5d04-48f9-987c-33e2c2d9d79d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:39.786686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0d6cf-5d04-48f9-987c-33e2c2d9d79d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:39.788781 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0d6cf-5d04-48f9-987c-33e2c2d9d79d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:39.804565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 322/636] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:39.811254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf79520-8c77-43df-8896-6f265048e4b4 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:39.811778 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf79520-8c77-43df-8896-6f265048e4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:39.812202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf79520-8c77-43df-8896-6f265048e4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:39.821968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dae1f-42b7-4980-9f8d-956ec50e3cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:39.822914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dae1f-42b7-4980-9f8d-956ec50e3cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:39.823280 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dae1f-42b7-4980-9f8d-956ec50e3cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:39.823641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dae1f-42b7-4980-9f8d-956ec50e3cb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:39.834169 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1cf79520-8c77-43df-8896-6f265048e4b4 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:39.836055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dae1f-42b7-4980-9f8d-956ec50e3cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:39.836217 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1cf79520-8c77-43df-8896-6f265048e4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:39.837759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dae1f-42b7-4980-9f8d-956ec50e3cb2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:39.841819 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-6e0dae1f-42b7-4980-9f8d-956ec50e3cb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:39.858579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:39.861687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:39.864954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:39.864954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:39.864954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:39.864954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 315/637] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:39.864954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dae1f-42b7-4980-9f8d-956ec50e3cb2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:39.870067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:39.929790 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 323/638] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:39.931421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafb4fd-09df-4d85-8375-75c7e28e1777 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:39.931899 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafb4fd-09df-4d85-8375-75c7e28e1777 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:39.932315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafb4fd-09df-4d85-8375-75c7e28e1777 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:39.940146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 324/639] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:39.940146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafb4fd-09df-4d85-8375-75c7e28e1777 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:40.035482 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dae1f-42b7-4980-9f8d-956ec50e3cb2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:40.110786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bae7c-df7a-4cf2-8e39-f07ec4806184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:40.112946 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bae7c-df7a-4cf2-8e39-f07ec4806184 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:40.113849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bae7c-df7a-4cf2-8e39-f07ec4806184 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:40.114700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bae7c-df7a-4cf2-8e39-f07ec4806184 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:40.118327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafb4fd-09df-4d85-8375-75c7e28e1777 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:40.127739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bae7c-df7a-4cf2-8e39-f07ec4806184 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:40.133861 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bae7c-df7a-4cf2-8e39-f07ec4806184 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-dc4bae7c-df7a-4cf2-8e39-f07ec4806184 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:40.163036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:40.164754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:40.166195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:40.166195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:40.166195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:40.166195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:40.166195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:40.166195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:40.166195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:40.166195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:40.166195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 15:49:40.166195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:40.175168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 316/640] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:40.177501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0f0b0-f01a-4bd8-b9fa-962d0457e7ec None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:40.178100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0f0b0-f01a-4bd8-b9fa-962d0457e7ec None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:40.178423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0f0b0-f01a-4bd8-b9fa-962d0457e7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:40.185714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca998d7-63c7-4cc5-a108-479fe290d925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:40.187345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca998d7-63c7-4cc5-a108-479fe290d925 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:40.188110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca998d7-63c7-4cc5-a108-479fe290d925 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:40.188852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca998d7-63c7-4cc5-a108-479fe290d925 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:40.190505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca998d7-63c7-4cc5-a108-479fe290d925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:40.191230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca998d7-63c7-4cc5-a108-479fe290d925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:40.195851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca998d7-63c7-4cc5-a108-479fe290d925 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:40.211480 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-dee0f0b0-f01a-4bd8-b9fa-962d0457e7ec None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:40.213639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-dee0f0b0-f01a-4bd8-b9fa-962d0457e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:40.217532 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 325/641] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:40.222255 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca998d7-63c7-4cc5-a108-479fe290d925 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:40.255227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:40.290539 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:40.316736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 317/642] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:40.318916 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0f0b0-f01a-4bd8-b9fa-962d0457e7ec None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:40.402913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca998d7-63c7-4cc5-a108-479fe290d925 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:40.475515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55ad6a-755e-4ece-8949-66fe0ebbb287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:40.476860 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55ad6a-755e-4ece-8949-66fe0ebbb287 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:40.477160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55ad6a-755e-4ece-8949-66fe0ebbb287 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:40.477670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55ad6a-755e-4ece-8949-66fe0ebbb287 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:40.479097 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55ad6a-755e-4ece-8949-66fe0ebbb287 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:40.479857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55ad6a-755e-4ece-8949-66fe0ebbb287 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:40.482381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55ad6a-755e-4ece-8949-66fe0ebbb287 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:40.502094 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0f0b0-f01a-4bd8-b9fa-962d0457e7ec None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:40.524750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 326/643] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Aug 22 15:49:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:40.524994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55ad6a-755e-4ece-8949-66fe0ebbb287 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:40.567260 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949324f-f748-4fc0-96c5-9046c484e5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:40.568888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949324f-f748-4fc0-96c5-9046c484e5ae None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:40.569642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949324f-f748-4fc0-96c5-9046c484e5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:40.570447 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949324f-f748-4fc0-96c5-9046c484e5ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:40.591359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949324f-f748-4fc0-96c5-9046c484e5ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7949324f-f748-4fc0-96c5-9046c484e5ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:40.601080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:40.603010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:40.605380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:40.605380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:40.605380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:40.605380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:40.605380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:40.605380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:40.605380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:40.605380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:40.605380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:40.605380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:40.605380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:40.605380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:40.605380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 318/644] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:40.605380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949324f-f748-4fc0-96c5-9046c484e5ae None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:40.677378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:40.692127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:40.741721 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55ad6a-755e-4ece-8949-66fe0ebbb287 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:40.748232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949324f-f748-4fc0-96c5-9046c484e5ae None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:40.789323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871064a9-e4ab-435a-b6b5-2a582922527e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:40.790427 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871064a9-e4ab-435a-b6b5-2a582922527e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:40.790827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871064a9-e4ab-435a-b6b5-2a582922527e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:40.791064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871064a9-e4ab-435a-b6b5-2a582922527e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:40.794406 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d7a3d-06c8-4606-817b-aafe68cc3176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:40.796073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d7a3d-06c8-4606-817b-aafe68cc3176 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:40.796073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d7a3d-06c8-4606-817b-aafe68cc3176 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:40.796073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d7a3d-06c8-4606-817b-aafe68cc3176 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:40.806982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d7a3d-06c8-4606-817b-aafe68cc3176 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:40.806982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d7a3d-06c8-4606-817b-aafe68cc3176 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-130d7a3d-06c8-4606-817b-aafe68cc3176 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:40.826936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:40.828364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:40.829958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:40.829958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:40.829958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:40.829958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:40.829958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:40.829958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:40.829958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:40.829958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:40.829958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 327/645] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:40.829958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d7a3d-06c8-4606-817b-aafe68cc3176 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:40.888218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871064a9-e4ab-435a-b6b5-2a582922527e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:40.890620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871064a9-e4ab-435a-b6b5-2a582922527e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:40.968157 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d7a3d-06c8-4606-817b-aafe68cc3176 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:40.971074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:41.012585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2ee52-f0ed-40bd-be38-0d37e0f7b2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:41.013241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2ee52-f0ed-40bd-be38-0d37e0f7b2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:41.013509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2ee52-f0ed-40bd-be38-0d37e0f7b2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:41.013776 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2ee52-f0ed-40bd-be38-0d37e0f7b2a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:41.018943 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:41.034846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2ee52-f0ed-40bd-be38-0d37e0f7b2a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-2cb2ee52-f0ed-40bd-be38-0d37e0f7b2a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:41.041470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:41.043329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:41.045005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:41.045005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:41.045005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:41.045005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:41.045005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:41.045005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:41.045005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:41.045005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:41.045005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:41.045005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:41.045005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:41.045005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:41.045005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 328/646] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:41.045005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2ee52-f0ed-40bd-be38-0d37e0f7b2a2 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:41.047687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 319/647] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:41.055605 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871064a9-e4ab-435a-b6b5-2a582922527e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:41.174283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2ee52-f0ed-40bd-be38-0d37e0f7b2a2 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:41.193845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871064a9-e4ab-435a-b6b5-2a582922527e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:41.219829 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630de5e-2741-4a3b-bbf6-21d83a2df3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:41.221000 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630de5e-2741-4a3b-bbf6-21d83a2df3ea None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:41.221634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630de5e-2741-4a3b-bbf6-21d83a2df3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:41.222137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630de5e-2741-4a3b-bbf6-21d83a2df3ea None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:41.223223 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630de5e-2741-4a3b-bbf6-21d83a2df3ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:41.223531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630de5e-2741-4a3b-bbf6-21d83a2df3ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:41.224958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630de5e-2741-4a3b-bbf6-21d83a2df3ea None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:41.231381 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0becd33-d0c4-4512-ae94-177225aa484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:41.232007 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0becd33-d0c4-4512-ae94-177225aa484c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:41.232276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0becd33-d0c4-4512-ae94-177225aa484c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:41.232553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0becd33-d0c4-4512-ae94-177225aa484c None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:41.233276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0becd33-d0c4-4512-ae94-177225aa484c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:41.233592 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0becd33-d0c4-4512-ae94-177225aa484c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:41.235124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0becd33-d0c4-4512-ae94-177225aa484c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:41.240001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 329/648] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:41.241039 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630de5e-2741-4a3b-bbf6-21d83a2df3ea None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:41.254651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 320/649] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:41.254651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0becd33-d0c4-4512-ae94-177225aa484c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:41.267331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:41.332534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:41.394420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630de5e-2741-4a3b-bbf6-21d83a2df3ea None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:41.395601 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0becd33-d0c4-4512-ae94-177225aa484c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:41.442653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af453b2-76f3-41e2-ac82-38fa57a135a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:41.444298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af453b2-76f3-41e2-ac82-38fa57a135a4 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:41.444298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af453b2-76f3-41e2-ac82-38fa57a135a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:41.444298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af453b2-76f3-41e2-ac82-38fa57a135a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:41.444983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af453b2-76f3-41e2-ac82-38fa57a135a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:41.444983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af453b2-76f3-41e2-ac82-38fa57a135a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:41.446235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af453b2-76f3-41e2-ac82-38fa57a135a4 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:41.460740 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 330/650] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:41.460740 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af453b2-76f3-41e2-ac82-38fa57a135a4 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:41.467286 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd479af-6fe9-4073-8f9f-b0772f694710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:41.468229 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd479af-6fe9-4073-8f9f-b0772f694710 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:41.468679 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd479af-6fe9-4073-8f9f-b0772f694710 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:41.469123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd479af-6fe9-4073-8f9f-b0772f694710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:41.482425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd479af-6fe9-4073-8f9f-b0772f694710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:41.484206 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd479af-6fe9-4073-8f9f-b0772f694710 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-abd479af-6fe9-4073-8f9f-b0772f694710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:41.501877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:41.503097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:41.504491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:41.504491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:41.504491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:41.504491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 321/651] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:41.504491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd479af-6fe9-4073-8f9f-b0772f694710 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:41.579981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af453b2-76f3-41e2-ac82-38fa57a135a4 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:41.580445 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:41.609235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:41.631726 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c83f67-0494-4c46-9e1c-3f36fcff152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:41.632452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c83f67-0494-4c46-9e1c-3f36fcff152c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:41.632779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c83f67-0494-4c46-9e1c-3f36fcff152c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:41.633142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c83f67-0494-4c46-9e1c-3f36fcff152c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:41.635368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd479af-6fe9-4073-8f9f-b0772f694710 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:41.646472 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c83f67-0494-4c46-9e1c-3f36fcff152c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:41.648015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c83f67-0494-4c46-9e1c-3f36fcff152c None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-04c83f67-0494-4c46-9e1c-3f36fcff152c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:41.664211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:41.665241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:41.666200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:41.666200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:41.666200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:41.666200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 331/652] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:41.666424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c83f67-0494-4c46-9e1c-3f36fcff152c None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:41.691430 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1bc27-9a9d-4250-b09b-16e75f062849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:41.692053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1bc27-9a9d-4250-b09b-16e75f062849 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:41.692328 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1bc27-9a9d-4250-b09b-16e75f062849 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:41.692606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1bc27-9a9d-4250-b09b-16e75f062849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:41.693381 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1bc27-9a9d-4250-b09b-16e75f062849 None admin] RBAC: Adding query filter params (role.id=2160bd7482684f0295250953180cc1b9, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=20e4a18ab77642baa9adb9a4b49fbcc2) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:41.693689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1bc27-9a9d-4250-b09b-16e75f062849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:41.695235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1bc27-9a9d-4250-b09b-16e75f062849 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:41.705364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 322/653] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:49:41 2022] GET /identity/v3/role_assignments?user.id=20e4a18ab77642baa9adb9a4b49fbcc2&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=2160bd7482684f0295250953180cc1b9 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:41.706912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc55454-7314-4e33-a074-3e17abe6d177 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:41.707306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc55454-7314-4e33-a074-3e17abe6d177 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:41.707547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc55454-7314-4e33-a074-3e17abe6d177 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:41.708901 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 323/654] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:41.709563 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc55454-7314-4e33-a074-3e17abe6d177 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:41.831233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c83f67-0494-4c46-9e1c-3f36fcff152c None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:41.862841 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc55454-7314-4e33-a074-3e17abe6d177 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:41.896299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895dfd6-f65a-4248-8ba3-73318a1e5762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:41.897282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895dfd6-f65a-4248-8ba3-73318a1e5762 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:41.897718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895dfd6-f65a-4248-8ba3-73318a1e5762 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:41.898145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895dfd6-f65a-4248-8ba3-73318a1e5762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:41.905593 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:41.917943 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895dfd6-f65a-4248-8ba3-73318a1e5762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:41.920186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895dfd6-f65a-4248-8ba3-73318a1e5762 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:41.923913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb30ad0-f449-410c-8492-0ace5d690624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:41.924923 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb30ad0-f449-410c-8492-0ace5d690624 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:41.926076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb30ad0-f449-410c-8492-0ace5d690624 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:41.926076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb30ad0-f449-410c-8492-0ace5d690624 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:41.926385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb30ad0-f449-410c-8492-0ace5d690624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:41.926519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb30ad0-f449-410c-8492-0ace5d690624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:41.927997 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb30ad0-f449-410c-8492-0ace5d690624 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-0895dfd6-f65a-4248-8ba3-73318a1e5762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:41.941773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:41.943933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:41.945993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:41.945993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:41.945993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:41.946356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 324/655] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:41.946356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb30ad0-f449-410c-8492-0ace5d690624 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:41.949250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 332/656] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:41.953913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ce082-4e19-48bc-a556-3df7a98a6135 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:41.953913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ce082-4e19-48bc-a556-3df7a98a6135 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:41.953913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ce082-4e19-48bc-a556-3df7a98a6135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:41.977204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-652ce082-4e19-48bc-a556-3df7a98a6135 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:41.978977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-652ce082-4e19-48bc-a556-3df7a98a6135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:42.005721 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:42.068317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb30ad0-f449-410c-8492-0ace5d690624 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:42.078394 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 333/657] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:42.079597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ce082-4e19-48bc-a556-3df7a98a6135 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:42.131414 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b405045-58f0-449e-8108-2633e1e879af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:42.131923 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b405045-58f0-449e-8108-2633e1e879af None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:42.132235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b405045-58f0-449e-8108-2633e1e879af None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:42.132461 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b405045-58f0-449e-8108-2633e1e879af None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:42.133103 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b405045-58f0-449e-8108-2633e1e879af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:42.133401 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b405045-58f0-449e-8108-2633e1e879af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:42.134872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b405045-58f0-449e-8108-2633e1e879af None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:42.151084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 325/658] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:42.152423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b405045-58f0-449e-8108-2633e1e879af None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:42.211313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:42.216964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ce082-4e19-48bc-a556-3df7a98a6135 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:42.260379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81be4b-5e5b-4a2e-826b-11b4461c2958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:42.261479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81be4b-5e5b-4a2e-826b-11b4461c2958 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:42.261954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81be4b-5e5b-4a2e-826b-11b4461c2958 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:42.262417 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81be4b-5e5b-4a2e-826b-11b4461c2958 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:42.272656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81be4b-5e5b-4a2e-826b-11b4461c2958 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:42.274792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81be4b-5e5b-4a2e-826b-11b4461c2958 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-8a81be4b-5e5b-4a2e-826b-11b4461c2958 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:42.290482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:42.291724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:42.292846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:42.292846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:42.292846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:42.292846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:42.292846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:42.292846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:42.292846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:42.292846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:42.295234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 334/659] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:42.296234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81be4b-5e5b-4a2e-826b-11b4461c2958 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:42.296537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b405045-58f0-449e-8108-2633e1e879af None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:42.316341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:42.356593 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a286c59-f010-4d8d-97ae-8adcf3d850be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:42.357229 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286c59-f010-4d8d-97ae-8adcf3d850be None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:42.357516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286c59-f010-4d8d-97ae-8adcf3d850be None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:42.357777 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286c59-f010-4d8d-97ae-8adcf3d850be None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:42.358446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a286c59-f010-4d8d-97ae-8adcf3d850be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:42.358778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a286c59-f010-4d8d-97ae-8adcf3d850be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:42.360212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a286c59-f010-4d8d-97ae-8adcf3d850be None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:42.373571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 326/660] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:42.374456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a286c59-f010-4d8d-97ae-8adcf3d850be None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:42.443856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81be4b-5e5b-4a2e-826b-11b4461c2958 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:42.483672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ec8da-00b8-4dc5-9ed7-2f53439a8c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:42.484336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ec8da-00b8-4dc5-9ed7-2f53439a8c60 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:42.484597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ec8da-00b8-4dc5-9ed7-2f53439a8c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:42.484867 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ec8da-00b8-4dc5-9ed7-2f53439a8c60 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:42.494513 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ec8da-00b8-4dc5-9ed7-2f53439a8c60 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:42.496950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ec8da-00b8-4dc5-9ed7-2f53439a8c60 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:42.506312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a286c59-f010-4d8d-97ae-8adcf3d850be None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:42.508075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-8b5ec8da-00b8-4dc5-9ed7-2f53439a8c60 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:42.512205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:42.513230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:42.514175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:42.514175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:42.514175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:42.514175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:42.514175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:42.514175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:42.514175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:42.514175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:42.514175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:49:42.514175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:42.518843 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 335/661] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:42.519849 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ec8da-00b8-4dc5-9ed7-2f53439a8c60 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:42.555359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fd767-a001-45af-85a8-599d4faab8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:42.555990 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd767-a001-45af-85a8-599d4faab8fd None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:42.556368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd767-a001-45af-85a8-599d4faab8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:42.556810 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fd767-a001-45af-85a8-599d4faab8fd None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:42.557688 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fd767-a001-45af-85a8-599d4faab8fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:42.558101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fd767-a001-45af-85a8-599d4faab8fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:42.559645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fd767-a001-45af-85a8-599d4faab8fd None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:42.578949 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 327/662] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:42.578949 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fd767-a001-45af-85a8-599d4faab8fd None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:42.629771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:42.659268 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ec8da-00b8-4dc5-9ed7-2f53439a8c60 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:42.708617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dc588-9efb-451f-9e78-7e83e922f8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:42.709680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dc588-9efb-451f-9e78-7e83e922f8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:42.710163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dc588-9efb-451f-9e78-7e83e922f8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:42.710630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dc588-9efb-451f-9e78-7e83e922f8d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:42.725121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fd767-a001-45af-85a8-599d4faab8fd None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:42.728894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dc588-9efb-451f-9e78-7e83e922f8d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-ca7dc588-9efb-451f-9e78-7e83e922f8d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:42.734947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:42.736006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:42.736954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:42.736954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:42.736954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:42.736954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:42.736954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:42.736954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:42.736954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:42.736954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:42.736954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:42.736954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:42.736954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:42.736954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:42.736954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 336/663] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:42.737653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dc588-9efb-451f-9e78-7e83e922f8d6 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:42.780745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea35dc-d64b-41e7-92a8-bf5e75bbc15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:42.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea35dc-d64b-41e7-92a8-bf5e75bbc15f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:42.781986 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea35dc-d64b-41e7-92a8-bf5e75bbc15f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:42.782376 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea35dc-d64b-41e7-92a8-bf5e75bbc15f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:42.792685 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea35dc-d64b-41e7-92a8-bf5e75bbc15f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:42.794193 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea35dc-d64b-41e7-92a8-bf5e75bbc15f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-edea35dc-d64b-41e7-92a8-bf5e75bbc15f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:42.807175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:42.808974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:42.810870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:42.810870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:42.810870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:42.810870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:42.810870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:42.810870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:42.810870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:42.810870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:42.810870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 15:49:42.810870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:42.810870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 328/664] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:42.810870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea35dc-d64b-41e7-92a8-bf5e75bbc15f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:42.846509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:42.863475 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dc588-9efb-451f-9e78-7e83e922f8d6 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:42.906890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4ad8e-3d02-4cfc-b4d7-39a67c80e0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:42.907601 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ad8e-3d02-4cfc-b4d7-39a67c80e0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:42.907824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ad8e-3d02-4cfc-b4d7-39a67c80e0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:42.908066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ad8e-3d02-4cfc-b4d7-39a67c80e0e3 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:42.908814 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4ad8e-3d02-4cfc-b4d7-39a67c80e0e3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:42.909118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4ad8e-3d02-4cfc-b4d7-39a67c80e0e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:42.910604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4ad8e-3d02-4cfc-b4d7-39a67c80e0e3 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:42.912687 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:42.936492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 337/665] 10.222.0.77 () {56 vars in 1137 bytes} [Mon Aug 22 15:49:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:42.937921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4ad8e-3d02-4cfc-b4d7-39a67c80e0e3 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:42.962166 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea35dc-d64b-41e7-92a8-bf5e75bbc15f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:43.000542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48765f-6270-4615-a9a9-3dcc59ec1b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:43.001161 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48765f-6270-4615-a9a9-3dcc59ec1b55 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:43.001435 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48765f-6270-4615-a9a9-3dcc59ec1b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:43.001695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48765f-6270-4615-a9a9-3dcc59ec1b55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:43.002440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48765f-6270-4615-a9a9-3dcc59ec1b55 None admin] RBAC: Adding query filter params (role.id=2160bd7482684f0295250953180cc1b9, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=3f7c46f4dc084a948bd09ca9b86c2748) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:43.002775 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48765f-6270-4615-a9a9-3dcc59ec1b55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:43.004353 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48765f-6270-4615-a9a9-3dcc59ec1b55 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:43.022686 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 329/666] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:49:42 2022] GET /identity/v3/role_assignments?user.id=3f7c46f4dc084a948bd09ca9b86c2748&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=2160bd7482684f0295250953180cc1b9 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:43.022686 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48765f-6270-4615-a9a9-3dcc59ec1b55 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:43.134944 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4ad8e-3d02-4cfc-b4d7-39a67c80e0e3 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:43.197804 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3225222-da62-460a-adfd-621c348ab3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:43.198773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225222-da62-460a-adfd-621c348ab3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:43.199233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225222-da62-460a-adfd-621c348ab3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:43.199508 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225222-da62-460a-adfd-621c348ab3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:43.200628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3225222-da62-460a-adfd-621c348ab3b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:43.200628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3225222-da62-460a-adfd-621c348ab3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:43.201230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:43.202053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3225222-da62-460a-adfd-621c348ab3b6 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:43.213716 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 338/667] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:43.214757 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3225222-da62-460a-adfd-621c348ab3b6 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:43.233405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48765f-6270-4615-a9a9-3dcc59ec1b55 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:43.280437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfac20-7d99-4884-9978-0266aee0fe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:43.281280 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfac20-7d99-4884-9978-0266aee0fe22 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:43.281678 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfac20-7d99-4884-9978-0266aee0fe22 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:43.282057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfac20-7d99-4884-9978-0266aee0fe22 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:43.283126 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfac20-7d99-4884-9978-0266aee0fe22 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:43.283511 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfac20-7d99-4884-9978-0266aee0fe22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:43.285673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfac20-7d99-4884-9978-0266aee0fe22 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:43.301610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:43.329024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 330/668] 10.222.0.77 () {56 vars in 1139 bytes} [Mon Aug 22 15:49:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:43.330469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfac20-7d99-4884-9978-0266aee0fe22 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:43.365622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3225222-da62-460a-adfd-621c348ab3b6 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:43.424015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441cbe1-1438-4824-92d7-6a2a076a8624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:43.424822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441cbe1-1438-4824-92d7-6a2a076a8624 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:43.425381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441cbe1-1438-4824-92d7-6a2a076a8624 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:43.425679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441cbe1-1438-4824-92d7-6a2a076a8624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:43.477021 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfac20-7d99-4884-9978-0266aee0fe22 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:43.511979 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441cbe1-1438-4824-92d7-6a2a076a8624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:43.517256 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441cbe1-1438-4824-92d7-6a2a076a8624 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:43.523255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a1183-7b2c-4029-aa33-6c86ee2790f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:43.525088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a1183-7b2c-4029-aa33-6c86ee2790f6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:43.525859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a1183-7b2c-4029-aa33-6c86ee2790f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:43.526463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a1183-7b2c-4029-aa33-6c86ee2790f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:43.541620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a1183-7b2c-4029-aa33-6c86ee2790f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:43.543996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a1183-7b2c-4029-aa33-6c86ee2790f6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:43.548087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-1f4a1183-7b2c-4029-aa33-6c86ee2790f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:43.566268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:43.567545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:43.568877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:43.568877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:43.568877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:43.572093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 331/669] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:43.573765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a1183-7b2c-4029-aa33-6c86ee2790f6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:43.589653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:43.652220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 339/670] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:43.653547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441cbe1-1438-4824-92d7-6a2a076a8624 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:43.712951 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a1183-7b2c-4029-aa33-6c86ee2790f6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:43.759301 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17333d2f-b2a3-48c5-81d9-fdbabdde70ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:43.760573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17333d2f-b2a3-48c5-81d9-fdbabdde70ce None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:43.761064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17333d2f-b2a3-48c5-81d9-fdbabdde70ce None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:43.761613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17333d2f-b2a3-48c5-81d9-fdbabdde70ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:43.819524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441cbe1-1438-4824-92d7-6a2a076a8624 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:43.867762 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b22929-60c2-4be9-8379-cb83c94ba2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:43.868754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b22929-60c2-4be9-8379-cb83c94ba2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:43.869267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b22929-60c2-4be9-8379-cb83c94ba2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:43.869937 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b22929-60c2-4be9-8379-cb83c94ba2e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:43.870731 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b22929-60c2-4be9-8379-cb83c94ba2e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:43.871371 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b22929-60c2-4be9-8379-cb83c94ba2e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:43.873236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b22929-60c2-4be9-8379-cb83c94ba2e0 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:43.881363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:43.893038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 340/671] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:43.894470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17333d2f-b2a3-48c5-81d9-fdbabdde70ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:43.894953 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b22929-60c2-4be9-8379-cb83c94ba2e0 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:43.896512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17333d2f-b2a3-48c5-81d9-fdbabdde70ce None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:43.920482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:44.033807 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b22929-60c2-4be9-8379-cb83c94ba2e0 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:44.053881 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 332/672] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:44.055818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17333d2f-b2a3-48c5-81d9-fdbabdde70ce None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:44.072205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784955cc-edc0-45d5-8383-fe3c9166336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:44.072848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784955cc-edc0-45d5-8383-fe3c9166336e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:44.073127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784955cc-edc0-45d5-8383-fe3c9166336e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:44.073395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784955cc-edc0-45d5-8383-fe3c9166336e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:44.085663 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784955cc-edc0-45d5-8383-fe3c9166336e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:44.087197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784955cc-edc0-45d5-8383-fe3c9166336e None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-784955cc-edc0-45d5-8383-fe3c9166336e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:44.103193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:44.105070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:44.107079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:44.107079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:44.107079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:44.107079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 341/673] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:44.107079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ac871-d1e2-40d0-90c5-ff0bcb58361b None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:44.107079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ac871-d1e2-40d0-90c5-ff0bcb58361b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:44.107079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ac871-d1e2-40d0-90c5-ff0bcb58361b None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:44.111792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 342/674] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:44.112756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ac871-d1e2-40d0-90c5-ff0bcb58361b None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:44.195051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:44.204606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17333d2f-b2a3-48c5-81d9-fdbabdde70ce None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:44.216026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:44.256764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac0e02-be7f-49f2-add5-f4f70cd152f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:44.257790 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac0e02-be7f-49f2-add5-f4f70cd152f2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:44.258287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac0e02-be7f-49f2-add5-f4f70cd152f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:44.258825 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac0e02-be7f-49f2-add5-f4f70cd152f2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:44.269257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ac871-d1e2-40d0-90c5-ff0bcb58361b None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:44.271820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac0e02-be7f-49f2-add5-f4f70cd152f2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:44.274393 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac0e02-be7f-49f2-add5-f4f70cd152f2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-66ac0e02-be7f-49f2-add5-f4f70cd152f2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:44.298083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:44.299081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:44.300058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:44.300058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:44.300058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:44.300058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:44.300058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:44.300058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:44.300058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:44.300058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:44.300058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:49:44.300058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:44.300058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 333/675] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:49:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:44.300058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac0e02-be7f-49f2-add5-f4f70cd152f2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:44.323796 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5a584-71b0-44e5-a962-98b3fdd36e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:44.325019 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5a584-71b0-44e5-a962-98b3fdd36e1f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:44.325413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5a584-71b0-44e5-a962-98b3fdd36e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:44.325762 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5a584-71b0-44e5-a962-98b3fdd36e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:44.340897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5a584-71b0-44e5-a962-98b3fdd36e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:44.342477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5a584-71b0-44e5-a962-98b3fdd36e1f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-3be5a584-71b0-44e5-a962-98b3fdd36e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:44.372486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:44.374224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:44.376477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:44.376477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:44.376477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:44.376477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 343/676] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:44.376477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b2d97-afe5-48f2-87e2-28566f6ff87e None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:44.376477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b2d97-afe5-48f2-87e2-28566f6ff87e None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:44.376477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b2d97-afe5-48f2-87e2-28566f6ff87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:44.398702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c33b2d97-afe5-48f2-87e2-28566f6ff87e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:44.400497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c33b2d97-afe5-48f2-87e2-28566f6ff87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:44.449798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac0e02-be7f-49f2-add5-f4f70cd152f2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:44.489188 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9dde-74d2-467b-965d-8794b58181ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:44.489892 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9dde-74d2-467b-965d-8794b58181ea None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:44.490267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9dde-74d2-467b-965d-8794b58181ea None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:44.490748 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9dde-74d2-467b-965d-8794b58181ea None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:44.491401 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b9dde-74d2-467b-965d-8794b58181ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:44.491768 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b9dde-74d2-467b-965d-8794b58181ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:44.492325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 344/677] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:44.492995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b2d97-afe5-48f2-87e2-28566f6ff87e None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:44.504529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b9dde-74d2-467b-965d-8794b58181ea None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:44.528995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 334/678] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:44.532157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9dde-74d2-467b-965d-8794b58181ea None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:44.569041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:44.586167 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:44.665104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9dde-74d2-467b-965d-8794b58181ea None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:44.676031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b2d97-afe5-48f2-87e2-28566f6ff87e None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:44.703583 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d3aa4-715e-4f11-915b-6c73dfc897a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:44.704488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d3aa4-715e-4f11-915b-6c73dfc897a4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:44.704909 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d3aa4-715e-4f11-915b-6c73dfc897a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:44.705322 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d3aa4-715e-4f11-915b-6c73dfc897a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:44.706161 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d3aa4-715e-4f11-915b-6c73dfc897a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:44.706644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d3aa4-715e-4f11-915b-6c73dfc897a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:44.708186 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d3aa4-715e-4f11-915b-6c73dfc897a4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:44.721531 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 335/679] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:44.722680 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d3aa4-715e-4f11-915b-6c73dfc897a4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:44.744139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e418a02-1350-40f8-b146-a0857a9ac974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:44.745292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e418a02-1350-40f8-b146-a0857a9ac974 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:44.745817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e418a02-1350-40f8-b146-a0857a9ac974 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:44.746407 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e418a02-1350-40f8-b146-a0857a9ac974 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:44.747934 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e418a02-1350-40f8-b146-a0857a9ac974 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:44.748575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e418a02-1350-40f8-b146-a0857a9ac974 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:44.751241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e418a02-1350-40f8-b146-a0857a9ac974 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:44.783415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 345/680] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Aug 22 15:49:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:44.784981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e418a02-1350-40f8-b146-a0857a9ac974 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:44.815856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:44.843835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d3aa4-715e-4f11-915b-6c73dfc897a4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:44.894250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e59ee-0105-4361-8931-4c62a85f438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:44.895262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e59ee-0105-4361-8931-4c62a85f438a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:44.895551 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e59ee-0105-4361-8931-4c62a85f438a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:44.895826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e59ee-0105-4361-8931-4c62a85f438a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:44.904125 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e59ee-0105-4361-8931-4c62a85f438a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:44.905654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e59ee-0105-4361-8931-4c62a85f438a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-389e59ee-0105-4361-8931-4c62a85f438a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:44.918306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:44.920265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:44.922267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:44.922267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:44.922267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:44.922267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:44.922267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:44.922267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:44.922267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:44.922267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:44.924310 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 336/681] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:44.925171 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e59ee-0105-4361-8931-4c62a85f438a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:44.961677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e418a02-1350-40f8-b146-a0857a9ac974 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:44.976459 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:45.023790 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9caa4b-61e2-4ccb-8f53-49b76be84b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:45.024824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9caa4b-61e2-4ccb-8f53-49b76be84b04 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:45.025475 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9caa4b-61e2-4ccb-8f53-49b76be84b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:45.025903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9caa4b-61e2-4ccb-8f53-49b76be84b04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:45.038175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9caa4b-61e2-4ccb-8f53-49b76be84b04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:45.040898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9caa4b-61e2-4ccb-8f53-49b76be84b04 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:45.043717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e59ee-0105-4361-8931-4c62a85f438a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-4f9caa4b-61e2-4ccb-8f53-49b76be84b04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:45.061520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:45.062578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:45.063497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:45.063497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:45.063497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:45.063497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:45.063497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:45.063497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:45.063497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:45.063497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:45.063930 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 346/682] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:45.065396 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9caa4b-61e2-4ccb-8f53-49b76be84b04 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:45.100103 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766193a-e14e-4d6e-938e-5269c3cb9c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:45.101061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766193a-e14e-4d6e-938e-5269c3cb9c18 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:45.101524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766193a-e14e-4d6e-938e-5269c3cb9c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:45.101991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766193a-e14e-4d6e-938e-5269c3cb9c18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:45.106806 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:45.120890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766193a-e14e-4d6e-938e-5269c3cb9c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-3766193a-e14e-4d6e-938e-5269c3cb9c18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:45.130098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:45.131282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:45.132263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:45.132263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:45.132263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:45.132263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:45.132263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:45.132263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:45.132263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:45.132263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:45.132263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:45.132263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:45.132263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:45.132263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:45.138862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 337/683] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:49:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:45.139971 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766193a-e14e-4d6e-938e-5269c3cb9c18 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:45.226820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9caa4b-61e2-4ccb-8f53-49b76be84b04 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:45.263933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766193a-e14e-4d6e-938e-5269c3cb9c18 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:45.283307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cd423-42f1-47f3-8ff3-613bc5967ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:45.283909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd423-42f1-47f3-8ff3-613bc5967ddf None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:45.284182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd423-42f1-47f3-8ff3-613bc5967ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:45.284457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd423-42f1-47f3-8ff3-613bc5967ddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:45.313932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e3701-2510-4ee1-bde7-e6d6552ac331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:45.315275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e3701-2510-4ee1-bde7-e6d6552ac331 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:45.315717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e3701-2510-4ee1-bde7-e6d6552ac331 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:45.316081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e3701-2510-4ee1-bde7-e6d6552ac331 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:45.317064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e3701-2510-4ee1-bde7-e6d6552ac331 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:45.317542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e3701-2510-4ee1-bde7-e6d6552ac331 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:45.320007 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e3701-2510-4ee1-bde7-e6d6552ac331 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:45.335196 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 338/684] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:45.336073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e3701-2510-4ee1-bde7-e6d6552ac331 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:45.337046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:45.390866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cd423-42f1-47f3-8ff3-613bc5967ddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:45.392698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cd423-42f1-47f3-8ff3-613bc5967ddf None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:45.402411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:45.451834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e3701-2510-4ee1-bde7-e6d6552ac331 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:45.490977 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e753d-20d6-4070-95dd-51eb0615260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:45.491592 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e753d-20d6-4070-95dd-51eb0615260c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:45.491902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e753d-20d6-4070-95dd-51eb0615260c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:45.492098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e753d-20d6-4070-95dd-51eb0615260c None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:45.492821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e753d-20d6-4070-95dd-51eb0615260c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:45.493118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e753d-20d6-4070-95dd-51eb0615260c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:45.494657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e753d-20d6-4070-95dd-51eb0615260c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:45.508051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 339/685] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:45.508961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e753d-20d6-4070-95dd-51eb0615260c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:45.532849 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 347/686] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:45.535267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc62a2-817e-4583-adb9-a9da6e0f1b2a None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:45.535724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc62a2-817e-4583-adb9-a9da6e0f1b2a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:45.536185 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc62a2-817e-4583-adb9-a9da6e0f1b2a None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:45.542667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 348/687] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:45.542667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc62a2-817e-4583-adb9-a9da6e0f1b2a None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:45.619273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:45.638761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e753d-20d6-4070-95dd-51eb0615260c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:45.655931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:45.660374 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc62a2-817e-4583-adb9-a9da6e0f1b2a None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:45.679546 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4d32f-8e48-4c6a-901a-0ee1ce140ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:45.680197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4d32f-8e48-4c6a-901a-0ee1ce140ddb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:45.680481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4d32f-8e48-4c6a-901a-0ee1ce140ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:45.680754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4d32f-8e48-4c6a-901a-0ee1ce140ddb None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:45.681545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4d32f-8e48-4c6a-901a-0ee1ce140ddb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:45.681851 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4d32f-8e48-4c6a-901a-0ee1ce140ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:45.683370 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4d32f-8e48-4c6a-901a-0ee1ce140ddb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:45.696773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 340/688] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:45.697796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4d32f-8e48-4c6a-901a-0ee1ce140ddb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:45.708069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a48ef-4b78-4873-a6d9-fd2c20cd80f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:45.708706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a48ef-4b78-4873-a6d9-fd2c20cd80f0 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:45.708978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a48ef-4b78-4873-a6d9-fd2c20cd80f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:45.709233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a48ef-4b78-4873-a6d9-fd2c20cd80f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:45.709978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a48ef-4b78-4873-a6d9-fd2c20cd80f0 None admin] RBAC: Adding query filter params (role.id=2160bd7482684f0295250953180cc1b9, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=80b255bd61e3445ab154f01fea9a95b9) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:45.710276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a48ef-4b78-4873-a6d9-fd2c20cd80f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:45.711831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a48ef-4b78-4873-a6d9-fd2c20cd80f0 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:45.717950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 349/689] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:49:45 2022] GET /identity/v3/role_assignments?user.id=80b255bd61e3445ab154f01fea9a95b9&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=2160bd7482684f0295250953180cc1b9 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:45.718789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a48ef-4b78-4873-a6d9-fd2c20cd80f0 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:45.850675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4d32f-8e48-4c6a-901a-0ee1ce140ddb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:45.861878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a48ef-4b78-4873-a6d9-fd2c20cd80f0 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:45.912455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:45.919114 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205736e8-afbc-43f0-a5a1-2a48638bffa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:45.919898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205736e8-afbc-43f0-a5a1-2a48638bffa8 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:45.920239 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205736e8-afbc-43f0-a5a1-2a48638bffa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:45.920605 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205736e8-afbc-43f0-a5a1-2a48638bffa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:45.924874 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f7533-a6e0-473a-b4d3-546518975333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:45.925826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f7533-a6e0-473a-b4d3-546518975333 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:45.927281 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f7533-a6e0-473a-b4d3-546518975333 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:45.927281 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f7533-a6e0-473a-b4d3-546518975333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:45.927867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f7533-a6e0-473a-b4d3-546518975333 None admin] RBAC: Adding query filter params (role.id=2160bd7482684f0295250953180cc1b9, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=104abc0b38524a2f95ffe96c5872362c) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:45.928987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f7533-a6e0-473a-b4d3-546518975333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:45.931706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f7533-a6e0-473a-b4d3-546518975333 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:45.941094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205736e8-afbc-43f0-a5a1-2a48638bffa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:45.941763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 341/690] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:49:45 2022] GET /identity/v3/role_assignments?user.id=104abc0b38524a2f95ffe96c5872362c&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=2160bd7482684f0295250953180cc1b9 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:45.942745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205736e8-afbc-43f0-a5a1-2a48638bffa8 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:45.944468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bbd15-5c76-49cf-a480-eb7fe2a01beb None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:45.944897 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bbd15-5c76-49cf-a480-eb7fe2a01beb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:45.945308 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bbd15-5c76-49cf-a480-eb7fe2a01beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-205736e8-afbc-43f0-a5a1-2a48638bffa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:45.962299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:45.963494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:45.964388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:45.964388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:45.964388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:45.964388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 350/691] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:45.964625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205736e8-afbc-43f0-a5a1-2a48638bffa8 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:45.977008 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5a0bbd15-5c76-49cf-a480-eb7fe2a01beb None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:45.979291 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5a0bbd15-5c76-49cf-a480-eb7fe2a01beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:46.034045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:46.085562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 342/692] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:46.087798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bbd15-5c76-49cf-a480-eb7fe2a01beb None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:46.138517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205736e8-afbc-43f0-a5a1-2a48638bffa8 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:46.179889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e28ce1-15d9-4d2f-98a4-e03a7a9d82a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:46.180885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e28ce1-15d9-4d2f-98a4-e03a7a9d82a9 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:46.181296 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e28ce1-15d9-4d2f-98a4-e03a7a9d82a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:46.181733 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e28ce1-15d9-4d2f-98a4-e03a7a9d82a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:46.197818 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e28ce1-15d9-4d2f-98a4-e03a7a9d82a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:46.200514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e28ce1-15d9-4d2f-98a4-e03a7a9d82a9 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-72e28ce1-15d9-4d2f-98a4-e03a7a9d82a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:46.218545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:46.219706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:46.221070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:46.221070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:46.221070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:46.223701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 351/693] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:46.231280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e28ce1-15d9-4d2f-98a4-e03a7a9d82a9 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:46.235067 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bbd15-5c76-49cf-a480-eb7fe2a01beb None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:46.277202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:46.292202 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771fabd-8cc6-49ff-9a8d-fdd5c68e8b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:46.292897 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771fabd-8cc6-49ff-9a8d-fdd5c68e8b50 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:46.293218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771fabd-8cc6-49ff-9a8d-fdd5c68e8b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:46.293499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771fabd-8cc6-49ff-9a8d-fdd5c68e8b50 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:46.294162 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771fabd-8cc6-49ff-9a8d-fdd5c68e8b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:46.294463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771fabd-8cc6-49ff-9a8d-fdd5c68e8b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:46.295945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771fabd-8cc6-49ff-9a8d-fdd5c68e8b50 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:46.310763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 343/694] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:46.319077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771fabd-8cc6-49ff-9a8d-fdd5c68e8b50 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:46.366874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e28ce1-15d9-4d2f-98a4-e03a7a9d82a9 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:46.373285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:46.406490 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d11a01-83ba-4431-87d0-600366df8fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:46.407529 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d11a01-83ba-4431-87d0-600366df8fbf None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:46.408004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d11a01-83ba-4431-87d0-600366df8fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:46.408496 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d11a01-83ba-4431-87d0-600366df8fbf None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:46.409359 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d11a01-83ba-4431-87d0-600366df8fbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:46.409854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d11a01-83ba-4431-87d0-600366df8fbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:46.411490 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d11a01-83ba-4431-87d0-600366df8fbf None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:46.425288 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 352/695] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:46.426489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d11a01-83ba-4431-87d0-600366df8fbf None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:46.459626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771fabd-8cc6-49ff-9a8d-fdd5c68e8b50 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:46.502244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be7298-fb91-427b-98b1-0730f097690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:46.502932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be7298-fb91-427b-98b1-0730f097690e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:46.503205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be7298-fb91-427b-98b1-0730f097690e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:46.503472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be7298-fb91-427b-98b1-0730f097690e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:46.511309 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be7298-fb91-427b-98b1-0730f097690e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:46.513173 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be7298-fb91-427b-98b1-0730f097690e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-01be7298-fb91-427b-98b1-0730f097690e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:46.525616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:46.526630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:46.527535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:46.527535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:46.527535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:46.527535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:46.527535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:46.527535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:46.527535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:46.527535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:46.527535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 344/696] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:46.528495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be7298-fb91-427b-98b1-0730f097690e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:46.571140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:46.576744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d11a01-83ba-4431-87d0-600366df8fbf None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:46.621724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014c771-fa5a-4a41-b144-d7998c19f92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:46.622933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c771-fa5a-4a41-b144-d7998c19f92e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:46.623220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c771-fa5a-4a41-b144-d7998c19f92e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:46.623771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014c771-fa5a-4a41-b144-d7998c19f92e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:46.637018 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014c771-fa5a-4a41-b144-d7998c19f92e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:46.638798 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014c771-fa5a-4a41-b144-d7998c19f92e None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-5014c771-fa5a-4a41-b144-d7998c19f92e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:46.657685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:46.659640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:46.660905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:46.660905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:46.660905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:46.660905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 353/697] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:46.660905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014c771-fa5a-4a41-b144-d7998c19f92e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:46.685746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:46.698462 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be7298-fb91-427b-98b1-0730f097690e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:46.746087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f59ef6-0302-4174-a548-7c9b04bff1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:46.747369 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f59ef6-0302-4174-a548-7c9b04bff1dd None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:46.747648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f59ef6-0302-4174-a548-7c9b04bff1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:46.747918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f59ef6-0302-4174-a548-7c9b04bff1dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:46.760921 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f59ef6-0302-4174-a548-7c9b04bff1dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:46.763133 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f59ef6-0302-4174-a548-7c9b04bff1dd None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:46.779179 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014c771-fa5a-4a41-b144-d7998c19f92e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-28f59ef6-0302-4174-a548-7c9b04bff1dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:46.779409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:46.780533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:46.781706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:46.781706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:46.781706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:46.781706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:46.781706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:46.781706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:46.781706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:46.781706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:46.781706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:49:46.781706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:46.785164 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 345/698] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 22 15:49:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:46.786153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f59ef6-0302-4174-a548-7c9b04bff1dd None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:46.817822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86fada-8585-446a-abe9-0feb542657aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:46.818628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86fada-8585-446a-abe9-0feb542657aa None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:46.819046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86fada-8585-446a-abe9-0feb542657aa None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:46.819413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86fada-8585-446a-abe9-0feb542657aa None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:46.820269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86fada-8585-446a-abe9-0feb542657aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:46.820671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86fada-8585-446a-abe9-0feb542657aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:46.822345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86fada-8585-446a-abe9-0feb542657aa None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:46.835650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 354/699] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:46.836597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86fada-8585-446a-abe9-0feb542657aa None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:46.846373 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:46.919515 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f59ef6-0302-4174-a548-7c9b04bff1dd None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:46.956711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602e076-754a-4b13-8e15-f1f251b9a17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:46.957470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602e076-754a-4b13-8e15-f1f251b9a17e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:46.957889 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602e076-754a-4b13-8e15-f1f251b9a17e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:46.958258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602e076-754a-4b13-8e15-f1f251b9a17e None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:46.959106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602e076-754a-4b13-8e15-f1f251b9a17e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:46.959507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602e076-754a-4b13-8e15-f1f251b9a17e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:46.961102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602e076-754a-4b13-8e15-f1f251b9a17e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:46.967879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86fada-8585-446a-abe9-0feb542657aa None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:46.980664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 346/700] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:46.981712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602e076-754a-4b13-8e15-f1f251b9a17e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:46.998811 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:47.017888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7679f40-6a7d-4cb8-b2d6-59d44230e61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:47.018977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679f40-6a7d-4cb8-b2d6-59d44230e61b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:47.019725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679f40-6a7d-4cb8-b2d6-59d44230e61b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:47.020262 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7679f40-6a7d-4cb8-b2d6-59d44230e61b None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:47.021323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7679f40-6a7d-4cb8-b2d6-59d44230e61b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:47.021810 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7679f40-6a7d-4cb8-b2d6-59d44230e61b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:47.023677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7679f40-6a7d-4cb8-b2d6-59d44230e61b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:47.049356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 355/701] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 22 15:49:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:47.050690 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7679f40-6a7d-4cb8-b2d6-59d44230e61b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:47.107671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602e076-754a-4b13-8e15-f1f251b9a17e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:47.138467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:47.150510 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f036be6-b7a2-4261-af0a-9d6e93c9546f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:47.151476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f036be6-b7a2-4261-af0a-9d6e93c9546f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:47.151940 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f036be6-b7a2-4261-af0a-9d6e93c9546f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:47.152484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f036be6-b7a2-4261-af0a-9d6e93c9546f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:47.153395 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f036be6-b7a2-4261-af0a-9d6e93c9546f None admin] RBAC: Adding query filter params (role.id=2160bd7482684f0295250953180cc1b9, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=7d8a49035be2479b87c797bf53c9919b) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:47.154360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f036be6-b7a2-4261-af0a-9d6e93c9546f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:47.156489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f036be6-b7a2-4261-af0a-9d6e93c9546f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:47.165448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 347/702] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:49:46 2022] GET /identity/v3/role_assignments?user.id=7d8a49035be2479b87c797bf53c9919b&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=2160bd7482684f0295250953180cc1b9 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:47.166662 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f036be6-b7a2-4261-af0a-9d6e93c9546f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:47.207528 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7679f40-6a7d-4cb8-b2d6-59d44230e61b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:47.259120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:47.287038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f036be6-b7a2-4261-af0a-9d6e93c9546f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:47.309364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570d956-4891-40ae-895a-109e9f91034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:47.309998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570d956-4891-40ae-895a-109e9f91034d None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:47.310273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570d956-4891-40ae-895a-109e9f91034d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:47.310541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570d956-4891-40ae-895a-109e9f91034d None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:47.311238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570d956-4891-40ae-895a-109e9f91034d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:47.312751 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570d956-4891-40ae-895a-109e9f91034d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:47.332087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99c143-70b4-4f42-a14f-b75fd245207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:47.333148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99c143-70b4-4f42-a14f-b75fd245207f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:47.336922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99c143-70b4-4f42-a14f-b75fd245207f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:47.337432 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99c143-70b4-4f42-a14f-b75fd245207f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:47.364999 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 356/703] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:49:47 2022] POST /identity/v3/users => generated 254 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:49:47.422509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99c143-70b4-4f42-a14f-b75fd245207f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:47.424064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99c143-70b4-4f42-a14f-b75fd245207f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:47.520654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:47.540920 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 348/704] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:47.547154 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570d956-4891-40ae-895a-109e9f91034d None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:47.656524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570d956-4891-40ae-895a-109e9f91034d None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:47.677499 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:47.696087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e78caf-0fcc-441e-84da-3b294b5a9679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:47.696734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e78caf-0fcc-441e-84da-3b294b5a9679 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:47.697123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e78caf-0fcc-441e-84da-3b294b5a9679 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:47.697397 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e78caf-0fcc-441e-84da-3b294b5a9679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:47.708702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e78caf-0fcc-441e-84da-3b294b5a9679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:47.710180 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e78caf-0fcc-441e-84da-3b294b5a9679 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-d9e78caf-0fcc-441e-84da-3b294b5a9679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:47.727616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:47.728674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:47.729569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:47.729569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:47.729569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:47.729569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 357/705] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:47.734813 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99c143-70b4-4f42-a14f-b75fd245207f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:47.858020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99c143-70b4-4f42-a14f-b75fd245207f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:47.906465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591614c1-298a-4aa3-b045-ac997e1702c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:47.907112 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591614c1-298a-4aa3-b045-ac997e1702c3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:47.907388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591614c1-298a-4aa3-b045-ac997e1702c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:47.907716 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591614c1-298a-4aa3-b045-ac997e1702c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:47.908422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591614c1-298a-4aa3-b045-ac997e1702c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:47.908723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591614c1-298a-4aa3-b045-ac997e1702c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:47.910104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591614c1-298a-4aa3-b045-ac997e1702c3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:47.928233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 349/706] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:47.933922 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e78caf-0fcc-441e-84da-3b294b5a9679 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:48.008187 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f8709-4ddc-4725-ae2b-7375d5ac9006 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:48.008514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f8709-4ddc-4725-ae2b-7375d5ac9006 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:48.008730 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f8709-4ddc-4725-ae2b-7375d5ac9006 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:48.011398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 350/707] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:48.015585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c27e17-07a1-4839-807a-6a520a08a20f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:48.015862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c27e17-07a1-4839-807a-6a520a08a20f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:48.016136 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c27e17-07a1-4839-807a-6a520a08a20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:48.035038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-00c27e17-07a1-4839-807a-6a520a08a20f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:48.036212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-00c27e17-07a1-4839-807a-6a520a08a20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:48.086541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:48.089432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e78caf-0fcc-441e-84da-3b294b5a9679 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:48.141234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe99b6d-3d02-4a00-9935-b39a7a4ad2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:48.141791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe99b6d-3d02-4a00-9935-b39a7a4ad2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:48.142063 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe99b6d-3d02-4a00-9935-b39a7a4ad2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:48.142328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe99b6d-3d02-4a00-9935-b39a7a4ad2c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:48.151687 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe99b6d-3d02-4a00-9935-b39a7a4ad2c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:48.153763 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe99b6d-3d02-4a00-9935-b39a7a4ad2c3 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-ffe99b6d-3d02-4a00-9935-b39a7a4ad2c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:48.168187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:48.169132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:48.170015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:48.170015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:48.170015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:48.170015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:48.170015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:48.170015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:48.170015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:48.170015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:48.170015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 358/708] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:48.175665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe99b6d-3d02-4a00-9935-b39a7a4ad2c3 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:48.177157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 351/709] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:49:48.227886 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:48.336700 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe99b6d-3d02-4a00-9935-b39a7a4ad2c3 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:48.382319 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1af62d-3eff-4b98-97a3-8094567ab336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:48.382992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1af62d-3eff-4b98-97a3-8094567ab336 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:48.383274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1af62d-3eff-4b98-97a3-8094567ab336 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:48.383548 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1af62d-3eff-4b98-97a3-8094567ab336 None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:48.384307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1af62d-3eff-4b98-97a3-8094567ab336 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:48.384655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1af62d-3eff-4b98-97a3-8094567ab336 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:48.386189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1af62d-3eff-4b98-97a3-8094567ab336 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:48.404533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 359/710] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:48.410663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c27e17-07a1-4839-807a-6a520a08a20f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:48.420679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9bbbc-36e5-47e6-905d-92f1bc11b332 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:48.421324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9bbbc-36e5-47e6-905d-92f1bc11b332 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:48.421822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9bbbc-36e5-47e6-905d-92f1bc11b332 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:48.423779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 360/711] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:49:48.429720 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47181e-4db0-4ca6-92f8-96f6b733dfda None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:48.430323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47181e-4db0-4ca6-92f8-96f6b733dfda None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:48.430863 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47181e-4db0-4ca6-92f8-96f6b733dfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:48.450996 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-4f47181e-4db0-4ca6-92f8-96f6b733dfda None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:48.452630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4f47181e-4db0-4ca6-92f8-96f6b733dfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:48.582624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 361/712] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 15:49:48.582624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47181e-4db0-4ca6-92f8-96f6b733dfda None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:48.629597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:48.670348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c27e17-07a1-4839-807a-6a520a08a20f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:48.728524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36d820-ed1a-43d7-aefe-44633b385d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:48.729172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36d820-ed1a-43d7-aefe-44633b385d2c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:48.729445 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36d820-ed1a-43d7-aefe-44633b385d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:48.729711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36d820-ed1a-43d7-aefe-44633b385d2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:48.730483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36d820-ed1a-43d7-aefe-44633b385d2c None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=20e4a18ab77642baa9adb9a4b49fbcc2) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:48.730874 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36d820-ed1a-43d7-aefe-44633b385d2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:48.732396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36d820-ed1a-43d7-aefe-44633b385d2c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:48.755120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 352/713] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:49:48 2022] GET /identity/v3/role_assignments?user.id=20e4a18ab77642baa9adb9a4b49fbcc2&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 259 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:48.778494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47181e-4db0-4ca6-92f8-96f6b733dfda None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:48.860322 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d465d0b-b243-4222-bedb-a8868b664e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:48.861049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d465d0b-b243-4222-bedb-a8868b664e3d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:48.861332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d465d0b-b243-4222-bedb-a8868b664e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:48.861604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d465d0b-b243-4222-bedb-a8868b664e3d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:48.862230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d465d0b-b243-4222-bedb-a8868b664e3d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:48.863763 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d465d0b-b243-4222-bedb-a8868b664e3d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-9d465d0b-b243-4222-bedb-a8868b664e3d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:48.881997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:48.883175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:48.884162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 362/714] 10.222.0.77 () {56 vars in 1129 bytes} [Mon Aug 22 15:49:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:48.890791 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36d820-ed1a-43d7-aefe-44633b385d2c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:48.936263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d465d0b-b243-4222-bedb-a8868b664e3d None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:48.952847 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:49.050994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:49.058700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36d820-ed1a-43d7-aefe-44633b385d2c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:49.070174 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d465d0b-b243-4222-bedb-a8868b664e3d None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:49.116878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f2bdc-7692-4306-a85f-eb4f2c4c0b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:49.117798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f2bdc-7692-4306-a85f-eb4f2c4c0b78 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:49.118230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f2bdc-7692-4306-a85f-eb4f2c4c0b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:49.118804 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f2bdc-7692-4306-a85f-eb4f2c4c0b78 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:49.119679 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f2bdc-7692-4306-a85f-eb4f2c4c0b78 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:49.120144 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f2bdc-7692-4306-a85f-eb4f2c4c0b78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:49.121073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eef9d2-b4aa-437a-9036-20975ffd956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:49.121830 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eef9d2-b4aa-437a-9036-20975ffd956d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:49.122054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f2bdc-7692-4306-a85f-eb4f2c4c0b78 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:49.122318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eef9d2-b4aa-437a-9036-20975ffd956d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:49.122734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eef9d2-b4aa-437a-9036-20975ffd956d None admin] PATH_INFO: `/v3/services/network` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:49.123449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eef9d2-b4aa-437a-9036-20975ffd956d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:49.126273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eef9d2-b4aa-437a-9036-20975ffd956d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:49.128408 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 353/715] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Aug 22 15:49:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:49.134318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f2bdc-7692-4306-a85f-eb4f2c4c0b78 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-92eef9d2-b4aa-437a-9036-20975ffd956d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:49.136785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:49.137900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:49.138801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:49.138801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:49.138801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:49.138801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:49.138801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:49.138801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:49.138801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:49.138801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:49.138801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:49.138801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:49.138801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:49:49.138801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:49:49.138801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:49:49.138801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:49.143054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 363/716] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:48 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:49.144986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eef9d2-b4aa-437a-9036-20975ffd956d None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:49.248999 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eef9d2-b4aa-437a-9036-20975ffd956d None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:49.284372 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ac87a-e0ac-4aa1-a610-a8f9ca1f9378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:49.285087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ac87a-e0ac-4aa1-a610-a8f9ca1f9378 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:49.285439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ac87a-e0ac-4aa1-a610-a8f9ca1f9378 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:49.285776 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ac87a-e0ac-4aa1-a610-a8f9ca1f9378 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:49.286493 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ac87a-e0ac-4aa1-a610-a8f9ca1f9378 None admin] RBAC: Adding query filter params (name=network) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:49.286895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ac87a-e0ac-4aa1-a610-a8f9ca1f9378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:49.289116 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ac87a-e0ac-4aa1-a610-a8f9ca1f9378 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:49.293711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 364/717] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 22 15:49:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:49.299423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ac87a-e0ac-4aa1-a610-a8f9ca1f9378 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:49.312428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:49.325932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f2bdc-7692-4306-a85f-eb4f2c4c0b78 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:49.330022 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:49.390491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084e802-d5a0-471e-87eb-5b512eb28bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:49.395216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084e802-d5a0-471e-87eb-5b512eb28bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:49.395504 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084e802-d5a0-471e-87eb-5b512eb28bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:49.395783 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084e802-d5a0-471e-87eb-5b512eb28bd1 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:49.396435 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084e802-d5a0-471e-87eb-5b512eb28bd1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:49.396740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084e802-d5a0-471e-87eb-5b512eb28bd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:49.398132 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084e802-d5a0-471e-87eb-5b512eb28bd1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:49.404057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 354/718] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Aug 22 15:49:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:49.437712 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ac87a-e0ac-4aa1-a610-a8f9ca1f9378 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:49.475253 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12933504-3846-4da3-a417-a7edea79f47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:49.476083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12933504-3846-4da3-a417-a7edea79f47d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:49.476426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12933504-3846-4da3-a417-a7edea79f47d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:49.476767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12933504-3846-4da3-a417-a7edea79f47d None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:49.477494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12933504-3846-4da3-a417-a7edea79f47d None admin] RBAC: Adding query filter params (type=network) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:49.477871 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12933504-3846-4da3-a417-a7edea79f47d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:49.479388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12933504-3846-4da3-a417-a7edea79f47d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:49.485955 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 365/719] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 22 15:49:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:49.948313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981b2d-175f-4544-ae61-21e615484ad7 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:49.949261 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981b2d-175f-4544-ae61-21e615484ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:49.949711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981b2d-175f-4544-ae61-21e615484ad7 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:49.951717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 355/720] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:49.958186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e4a08-def5-466e-b062-d3b2f86a17da None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:49.959168 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e4a08-def5-466e-b062-d3b2f86a17da None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:49.959637 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e4a08-def5-466e-b062-d3b2f86a17da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:49.978491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-117e4a08-def5-466e-b062-d3b2f86a17da None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:49.980034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-117e4a08-def5-466e-b062-d3b2f86a17da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:50.068852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 366/721] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:50.316194 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8ade-e256-4565-9770-5ede59cac819 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:50.316496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8ade-e256-4565-9770-5ede59cac819 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:50.316737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8ade-e256-4565-9770-5ede59cac819 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:50.318357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 356/722] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:50.323983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2a411-d128-45e9-bd66-76a52ff38870 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:50.329585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2a411-d128-45e9-bd66-76a52ff38870 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:50.329868 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2a411-d128-45e9-bd66-76a52ff38870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:50.356506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-bcd2a411-d128-45e9-bd66-76a52ff38870 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:50.357823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bcd2a411-d128-45e9-bd66-76a52ff38870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:50.360105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:50.375715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a8ade-e256-4565-9770-5ede59cac819 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:50.450589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 367/723] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:50.560953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a8ade-e256-4565-9770-5ede59cac819 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:50.596398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0210b-ae93-47ba-8a96-39065eeb3921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:50.596943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0210b-ae93-47ba-8a96-39065eeb3921 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:50.597218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0210b-ae93-47ba-8a96-39065eeb3921 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:50.597490 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0210b-ae93-47ba-8a96-39065eeb3921 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:50.616288 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0210b-ae93-47ba-8a96-39065eeb3921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-0af0210b-ae93-47ba-8a96-39065eeb3921 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:50.622167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:50.623139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:50.623974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:50.623974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:50.623974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:50.623974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:50.623974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:50.623974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:50.623974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:50.623974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:50.623974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:50.623974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:50.623974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:50.623974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:50.623974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 357/724] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:49:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:50.631054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2a411-d128-45e9-bd66-76a52ff38870 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:50.767685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2a411-d128-45e9-bd66-76a52ff38870 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:50.817118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9caae-55ef-4cc3-bcb9-ee1d6ab8e001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:50.817734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9caae-55ef-4cc3-bcb9-ee1d6ab8e001 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:50.818008 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9caae-55ef-4cc3-bcb9-ee1d6ab8e001 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:50.818276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9caae-55ef-4cc3-bcb9-ee1d6ab8e001 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:50.819031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9caae-55ef-4cc3-bcb9-ee1d6ab8e001 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:50.819334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9caae-55ef-4cc3-bcb9-ee1d6ab8e001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:50.820706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9caae-55ef-4cc3-bcb9-ee1d6ab8e001 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:50.827139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:50.831699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 368/725] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:50.837553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0210b-ae93-47ba-8a96-39065eeb3921 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:50.845227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9caae-55ef-4cc3-bcb9-ee1d6ab8e001 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:50.888617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:50.978061 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9caae-55ef-4cc3-bcb9-ee1d6ab8e001 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:51.002470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0210b-ae93-47ba-8a96-39065eeb3921 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:51.022166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1204c-9db7-4470-840e-4a6d3db9a7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:51.023383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1204c-9db7-4470-840e-4a6d3db9a7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:51.023869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1204c-9db7-4470-840e-4a6d3db9a7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:51.024365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1204c-9db7-4470-840e-4a6d3db9a7a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:51.039055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1204c-9db7-4470-840e-4a6d3db9a7a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-e6d1204c-9db7-4470-840e-4a6d3db9a7a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:51.044377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:51.045377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:51.046389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:51.046389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:51.046389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:51.046389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:51.046389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:51.046389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:51.046389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:51.046389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:51.046389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:51.046389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:51.046389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:51.046389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:51.046389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 369/726] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:51.047139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66608706-b9b6-446f-8a5b-0806272b653e None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:51.047383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66608706-b9b6-446f-8a5b-0806272b653e None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:51.047796 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66608706-b9b6-446f-8a5b-0806272b653e None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:51.049471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 370/727] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:51.051263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66608706-b9b6-446f-8a5b-0806272b653e None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:51.059880 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad16600-425c-4035-9691-36fa09d2f12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:51.060895 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad16600-425c-4035-9691-36fa09d2f12e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:51.061373 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad16600-425c-4035-9691-36fa09d2f12e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:51.061847 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad16600-425c-4035-9691-36fa09d2f12e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:51.074564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad16600-425c-4035-9691-36fa09d2f12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:51.076421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad16600-425c-4035-9691-36fa09d2f12e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-5ad16600-425c-4035-9691-36fa09d2f12e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:51.093694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:51.094787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:51.095695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:51.095695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:51.095695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:51.098005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 358/728] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:51.099688 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52bb68-1642-45e2-a30c-6dff65fd4ff9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:51.100209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52bb68-1642-45e2-a30c-6dff65fd4ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:51.100674 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52bb68-1642-45e2-a30c-6dff65fd4ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:51.122140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:51.123368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0b52bb68-1642-45e2-a30c-6dff65fd4ff9 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:51.125058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0b52bb68-1642-45e2-a30c-6dff65fd4ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:51.170148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66608706-b9b6-446f-8a5b-0806272b653e None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:51.210856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:51.211067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7f70d-a9d0-4981-b8de-2b302e35f4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:51.211067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f70d-a9d0-4981-b8de-2b302e35f4de None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:51.211067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f70d-a9d0-4981-b8de-2b302e35f4de None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:51.211067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7f70d-a9d0-4981-b8de-2b302e35f4de None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:51.211461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7f70d-a9d0-4981-b8de-2b302e35f4de None admin] RBAC: Adding query filter params (name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:51.211461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7f70d-a9d0-4981-b8de-2b302e35f4de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:51.212236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7f70d-a9d0-4981-b8de-2b302e35f4de None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:51.212584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 359/729] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:51.214236 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52bb68-1642-45e2-a30c-6dff65fd4ff9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:51.229714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 371/730] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:51.229714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7f70d-a9d0-4981-b8de-2b302e35f4de None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:51.336232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7f70d-a9d0-4981-b8de-2b302e35f4de None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:51.364746 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:51.374718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9c436-820f-4d4e-9ebf-d2f0eb047ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:51.375369 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9c436-820f-4d4e-9ebf-d2f0eb047ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:51.375650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9c436-820f-4d4e-9ebf-d2f0eb047ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:51.375923 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9c436-820f-4d4e-9ebf-d2f0eb047ba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:51.387467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9c436-820f-4d4e-9ebf-d2f0eb047ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:51.388971 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9c436-820f-4d4e-9ebf-d2f0eb047ba0 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-e0d9c436-820f-4d4e-9ebf-d2f0eb047ba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:51.406377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:51.407408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:51.408719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:51.408719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:51.408719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:51.408719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 372/731] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:49:51.409172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52bb68-1642-45e2-a30c-6dff65fd4ff9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:51.421977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9c436-820f-4d4e-9ebf-d2f0eb047ba0 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:51.488488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96464e-382d-45b0-bf63-625072467279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:51.489141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96464e-382d-45b0-bf63-625072467279 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:51.489462 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96464e-382d-45b0-bf63-625072467279 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:51.489760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96464e-382d-45b0-bf63-625072467279 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:51.490415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96464e-382d-45b0-bf63-625072467279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:51.490757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96464e-382d-45b0-bf63-625072467279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:51.499186 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96464e-382d-45b0-bf63-625072467279 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:51.528081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 360/732] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:51.529468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96464e-382d-45b0-bf63-625072467279 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:51.599909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9c436-820f-4d4e-9ebf-d2f0eb047ba0 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:51.639403 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e0dc4-0632-4c12-80c5-d5930bb288ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:51.640036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e0dc4-0632-4c12-80c5-d5930bb288ca None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:51.640316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e0dc4-0632-4c12-80c5-d5930bb288ca None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:51.640590 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e0dc4-0632-4c12-80c5-d5930bb288ca None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:51.641355 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e0dc4-0632-4c12-80c5-d5930bb288ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:51.641663 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e0dc4-0632-4c12-80c5-d5930bb288ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:51.643120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e0dc4-0632-4c12-80c5-d5930bb288ca None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:51.646636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:51.660034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 373/733] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:51.660934 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e0dc4-0632-4c12-80c5-d5930bb288ca None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:51.711422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96464e-382d-45b0-bf63-625072467279 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:51.715006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:51.748804 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23be7a-3e0c-427d-b379-21daf52a6527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:51.749546 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23be7a-3e0c-427d-b379-21daf52a6527 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:51.750092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23be7a-3e0c-427d-b379-21daf52a6527 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:51.750240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23be7a-3e0c-427d-b379-21daf52a6527 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:51.758700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23be7a-3e0c-427d-b379-21daf52a6527 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:51.760247 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23be7a-3e0c-427d-b379-21daf52a6527 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ea23be7a-3e0c-427d-b379-21daf52a6527 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:51.772397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:51.773391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:51.776446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:51.776446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:51.776446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:51.776446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:51.776446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:51.776446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:51.776446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:51.776446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:51.776446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:49:51.776446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:51.776446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 361/734] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:49:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:51.776446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23be7a-3e0c-427d-b379-21daf52a6527 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:51.843909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e0dc4-0632-4c12-80c5-d5930bb288ca None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:51.897655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60d191-3de6-4cae-8e4e-0db8daaedb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:51.898302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60d191-3de6-4cae-8e4e-0db8daaedb67 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:51.898582 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60d191-3de6-4cae-8e4e-0db8daaedb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:51.898877 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60d191-3de6-4cae-8e4e-0db8daaedb67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:51.911684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60d191-3de6-4cae-8e4e-0db8daaedb67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-1e60d191-3de6-4cae-8e4e-0db8daaedb67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:51.916549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:51.917858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:51.919879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:51.919879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:51.919879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:51.919879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:51.919879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:51.919879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:51.919879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:51.919879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:51.919879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:51.919879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:51.919879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:51.919879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:51.919879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 374/735] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:49:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:51.919879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae5544-7314-4c60-9ab1-7cdc08756ec9 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:51.921290 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae5544-7314-4c60-9ab1-7cdc08756ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:51.921290 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae5544-7314-4c60-9ab1-7cdc08756ec9 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:51.925300 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 375/736] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:51.926189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae5544-7314-4c60-9ab1-7cdc08756ec9 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:51.929468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23be7a-3e0c-427d-b379-21daf52a6527 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:51.966834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:51.990423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996b69f-748a-4849-9ff2-74f6ebc57634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:51.991105 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996b69f-748a-4849-9ff2-74f6ebc57634 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:51.991403 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996b69f-748a-4849-9ff2-74f6ebc57634 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:51.991652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996b69f-748a-4849-9ff2-74f6ebc57634 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:52.001916 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996b69f-748a-4849-9ff2-74f6ebc57634 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:52.003432 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996b69f-748a-4849-9ff2-74f6ebc57634 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-e996b69f-748a-4849-9ff2-74f6ebc57634 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:52.017761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:52.019375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:52.020650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:52.020650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:52.020650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:52.020650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:52.020650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:52.020650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:52.020650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:52.020650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:52.020650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:49:52.020650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:52.023053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 362/737] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 22 15:49:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:52.023777 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996b69f-748a-4849-9ff2-74f6ebc57634 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:52.042992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:52.051303 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae5544-7314-4c60-9ab1-7cdc08756ec9 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:52.088460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5dc94-7b95-4d10-9a29-eaccb4e73c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:52.089080 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5dc94-7b95-4d10-9a29-eaccb4e73c17 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:52.089356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5dc94-7b95-4d10-9a29-eaccb4e73c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:52.089624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5dc94-7b95-4d10-9a29-eaccb4e73c17 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:52.090368 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5dc94-7b95-4d10-9a29-eaccb4e73c17 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:52.090705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5dc94-7b95-4d10-9a29-eaccb4e73c17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:52.092169 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5dc94-7b95-4d10-9a29-eaccb4e73c17 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:52.111672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 376/738] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Aug 22 15:49:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:52.112783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fad0eb-4ae5-4af3-a991-4767ce714611 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:52.113068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fad0eb-4ae5-4af3-a991-4767ce714611 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:52.113338 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fad0eb-4ae5-4af3-a991-4767ce714611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:52.131707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-f3fad0eb-4ae5-4af3-a991-4767ce714611 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:52.132924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f3fad0eb-4ae5-4af3-a991-4767ce714611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:52.135377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996b69f-748a-4849-9ff2-74f6ebc57634 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:52.172564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa67009-fad9-4855-85e6-43f7dfd546aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:52.173182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67009-fad9-4855-85e6-43f7dfd546aa None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:52.173460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67009-fad9-4855-85e6-43f7dfd546aa None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:52.173741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67009-fad9-4855-85e6-43f7dfd546aa None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:52.174408 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa67009-fad9-4855-85e6-43f7dfd546aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:52.174737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa67009-fad9-4855-85e6-43f7dfd546aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:52.176137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa67009-fad9-4855-85e6-43f7dfd546aa None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:52.185154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 363/739] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:52.186413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c56427-3785-4632-9e66-33d76f104aa5 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:52.186714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c56427-3785-4632-9e66-33d76f104aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:52.186988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c56427-3785-4632-9e66-33d76f104aa5 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:52.188216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 364/740] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:52.188905 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c56427-3785-4632-9e66-33d76f104aa5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:52.210557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 377/741] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:52.211455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fad0eb-4ae5-4af3-a991-4767ce714611 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:52.253101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:52.316336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:52.341932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c56427-3785-4632-9e66-33d76f104aa5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:52.353653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fad0eb-4ae5-4af3-a991-4767ce714611 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:52.392716 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfdb59-3daf-49df-8754-abb3c1bc9d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:52.393374 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfdb59-3daf-49df-8754-abb3c1bc9d11 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:52.393652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfdb59-3daf-49df-8754-abb3c1bc9d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:52.393926 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfdb59-3daf-49df-8754-abb3c1bc9d11 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:52.394786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfdb59-3daf-49df-8754-abb3c1bc9d11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:52.395091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfdb59-3daf-49df-8754-abb3c1bc9d11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:52.396589 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfdb59-3daf-49df-8754-abb3c1bc9d11 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:52.402226 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1e2e7-022b-413f-bf0f-16907d0a7529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:52.403320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1e2e7-022b-413f-bf0f-16907d0a7529 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:52.403705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1e2e7-022b-413f-bf0f-16907d0a7529 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:52.404185 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1e2e7-022b-413f-bf0f-16907d0a7529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:52.421871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 365/742] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Aug 22 15:49:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:52.421871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ef402-0a9b-4a4f-ae7f-82d08af9fffd None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:52.421871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ef402-0a9b-4a4f-ae7f-82d08af9fffd None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:52.421871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ef402-0a9b-4a4f-ae7f-82d08af9fffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:52.438667 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-de5ef402-0a9b-4a4f-ae7f-82d08af9fffd None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:52.440239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-de5ef402-0a9b-4a4f-ae7f-82d08af9fffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:52.498619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1e2e7-022b-413f-bf0f-16907d0a7529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:52.500163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1e2e7-022b-413f-bf0f-16907d0a7529 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:52.522467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 366/743] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 15:49:52.523292 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ef402-0a9b-4a4f-ae7f-82d08af9fffd None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:52.559194 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:52.596191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:52.635204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 378/744] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:52.635204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1e2e7-022b-413f-bf0f-16907d0a7529 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:52.649287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ef402-0a9b-4a4f-ae7f-82d08af9fffd None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:52.685905 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713420dc-910f-4202-86bb-d9f38bc78870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:52.686503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713420dc-910f-4202-86bb-d9f38bc78870 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:52.686805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713420dc-910f-4202-86bb-d9f38bc78870 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:52.687072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713420dc-910f-4202-86bb-d9f38bc78870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:52.699251 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713420dc-910f-4202-86bb-d9f38bc78870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:52.700719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713420dc-910f-4202-86bb-d9f38bc78870 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-713420dc-910f-4202-86bb-d9f38bc78870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:52.715862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:52.716910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:52.717802 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:52.717802 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:52.717802 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:52.721949 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 367/745] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:52.722629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713420dc-910f-4202-86bb-d9f38bc78870 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:52.767712 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1e2e7-022b-413f-bf0f-16907d0a7529 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:52.806022 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0efd3-b7a2-4f69-8d77-497a77e91f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:52.806591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0efd3-b7a2-4f69-8d77-497a77e91f9e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:52.806891 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0efd3-b7a2-4f69-8d77-497a77e91f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:52.807162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0efd3-b7a2-4f69-8d77-497a77e91f9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:52.812627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:52.832701 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713420dc-910f-4202-86bb-d9f38bc78870 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:52.863256 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:52.869360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb701f3-566d-4557-ae40-fe3ebc870310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:52.870111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb701f3-566d-4557-ae40-fe3ebc870310 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:52.870501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb701f3-566d-4557-ae40-fe3ebc870310 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:52.870963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb701f3-566d-4557-ae40-fe3ebc870310 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:52.871728 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb701f3-566d-4557-ae40-fe3ebc870310 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:52.873444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb701f3-566d-4557-ae40-fe3ebc870310 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:52.885961 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0efd3-b7a2-4f69-8d77-497a77e91f9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:52.887660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0efd3-b7a2-4f69-8d77-497a77e91f9e None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:52.894664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 368/746] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 22 15:49:52 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:49:52.895566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb701f3-566d-4557-ae40-fe3ebc870310 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:53.010143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 379/747] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:49:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 15:49:53.011090 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0efd3-b7a2-4f69-8d77-497a77e91f9e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:53.063655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb701f3-566d-4557-ae40-fe3ebc870310 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:53.111099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886e560-35d5-418e-bf2e-a166d377f76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:53.111760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886e560-35d5-418e-bf2e-a166d377f76e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:53.112349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886e560-35d5-418e-bf2e-a166d377f76e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:53.112349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886e560-35d5-418e-bf2e-a166d377f76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:53.115130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:53.130100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:53.135380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886e560-35d5-418e-bf2e-a166d377f76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:53.137066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886e560-35d5-418e-bf2e-a166d377f76e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:53.144978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0efd3-b7a2-4f69-8d77-497a77e91f9e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7886e560-35d5-418e-bf2e-a166d377f76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:53.161218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:53.163123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:53.164918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:53.164918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:53.164918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:53.164918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 369/748] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:53.164918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886e560-35d5-418e-bf2e-a166d377f76e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:53.192246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f3a2a-55cc-4b8e-bfbe-075de4434530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:53.192872 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f3a2a-55cc-4b8e-bfbe-075de4434530 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:53.193154 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f3a2a-55cc-4b8e-bfbe-075de4434530 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:53.193423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f3a2a-55cc-4b8e-bfbe-075de4434530 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:53.194152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f3a2a-55cc-4b8e-bfbe-075de4434530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:53.194453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f3a2a-55cc-4b8e-bfbe-075de4434530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:53.195921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f3a2a-55cc-4b8e-bfbe-075de4434530 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:53.216195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 380/749] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:53.217402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f3a2a-55cc-4b8e-bfbe-075de4434530 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:53.304585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886e560-35d5-418e-bf2e-a166d377f76e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:53.344916 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f3a2a-55cc-4b8e-bfbe-075de4434530 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:53.347704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2558ed7-979e-4637-8bcb-95fae737385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:53.348403 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2558ed7-979e-4637-8bcb-95fae737385e None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:53.348691 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2558ed7-979e-4637-8bcb-95fae737385e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:53.348973 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2558ed7-979e-4637-8bcb-95fae737385e None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:53.349633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2558ed7-979e-4637-8bcb-95fae737385e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:53.351065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2558ed7-979e-4637-8bcb-95fae737385e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:53.369682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 370/750] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 22 15:49:53 2022] POST /identity/v3/services => generated 240 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:49:53.370539 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2558ed7-979e-4637-8bcb-95fae737385e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:53.394197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73515-b775-4e97-974d-6fc0d69f701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:53.395008 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73515-b775-4e97-974d-6fc0d69f701d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:53.395358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73515-b775-4e97-974d-6fc0d69f701d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:53.395751 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f73515-b775-4e97-974d-6fc0d69f701d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:53.404976 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:53.410560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73515-b775-4e97-974d-6fc0d69f701d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:53.413173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f73515-b775-4e97-974d-6fc0d69f701d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-02f73515-b775-4e97-974d-6fc0d69f701d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:53.436455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:53.437925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:53.439895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:53.439895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:53.439895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:53.439895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 381/751] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:53.439895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73515-b775-4e97-974d-6fc0d69f701d None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:53.457037 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:53.541304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2558ed7-979e-4637-8bcb-95fae737385e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:53.595825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f73515-b775-4e97-974d-6fc0d69f701d None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:53.597806 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ec0b7-164c-4413-8a4f-66d1dafa4675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:53.599096 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ec0b7-164c-4413-8a4f-66d1dafa4675 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:53.600845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ec0b7-164c-4413-8a4f-66d1dafa4675 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:53.600845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ec0b7-164c-4413-8a4f-66d1dafa4675 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:53.600845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ec0b7-164c-4413-8a4f-66d1dafa4675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:53.600845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ec0b7-164c-4413-8a4f-66d1dafa4675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:53.602176 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ec0b7-164c-4413-8a4f-66d1dafa4675 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:53.615936 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 371/752] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:53.616688 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ec0b7-164c-4413-8a4f-66d1dafa4675 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:53.665061 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc83409-e425-446c-8241-dec8260e957b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:53.666386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc83409-e425-446c-8241-dec8260e957b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:53.667399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc83409-e425-446c-8241-dec8260e957b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:53.669264 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc83409-e425-446c-8241-dec8260e957b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:53.684559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc83409-e425-446c-8241-dec8260e957b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:53.685794 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc83409-e425-446c-8241-dec8260e957b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-0fc83409-e425-446c-8241-dec8260e957b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:53.698977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:53.701292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:53.703562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:53.703562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:53.703562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:53.703562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:53.703562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:53.703562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:53.703562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:53.703562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:53.703562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:49:53.703562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:53.703562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 382/753] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 22 15:49:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:53.703562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc83409-e425-446c-8241-dec8260e957b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:53.771133 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ec0b7-164c-4413-8a4f-66d1dafa4675 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:53.786696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:53.807388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:53.815737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f351837-4feb-4698-afde-2500a472421c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:53.816425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f351837-4feb-4698-afde-2500a472421c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:53.816705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f351837-4feb-4698-afde-2500a472421c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:53.817195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f351837-4feb-4698-afde-2500a472421c None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:53.817959 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f351837-4feb-4698-afde-2500a472421c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:53.818303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f351837-4feb-4698-afde-2500a472421c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:53.819806 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f351837-4feb-4698-afde-2500a472421c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:53.838167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 372/754] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:53.839970 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f351837-4feb-4698-afde-2500a472421c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:53.885080 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc83409-e425-446c-8241-dec8260e957b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:53.922526 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc879fe-5aef-4368-9ed2-8115b32471e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:53.923943 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc879fe-5aef-4368-9ed2-8115b32471e2 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:53.924415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc879fe-5aef-4368-9ed2-8115b32471e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:53.924890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc879fe-5aef-4368-9ed2-8115b32471e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:53.932950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc879fe-5aef-4368-9ed2-8115b32471e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:53.934783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc879fe-5aef-4368-9ed2-8115b32471e2 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-afc879fe-5aef-4368-9ed2-8115b32471e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:53.951086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:53.952589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:53.954054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:53.954054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:53.954054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:53.954054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:53.954054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:53.954054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:53.954054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:53.954054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:53.957732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 383/755] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:53.959478 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc879fe-5aef-4368-9ed2-8115b32471e2 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:53.964660 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f351837-4feb-4698-afde-2500a472421c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:54.001615 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4386d-4e29-46e5-85d5-1222f71062b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:54.002239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4386d-4e29-46e5-85d5-1222f71062b0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:54.002557 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4386d-4e29-46e5-85d5-1222f71062b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:54.002856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4386d-4e29-46e5-85d5-1222f71062b0 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:54.003655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4386d-4e29-46e5-85d5-1222f71062b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:54.003955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4386d-4e29-46e5-85d5-1222f71062b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:54.005553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4386d-4e29-46e5-85d5-1222f71062b0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:54.030880 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 373/756] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 22 15:49:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:54.031937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4386d-4e29-46e5-85d5-1222f71062b0 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:54.062467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:54.096353 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc879fe-5aef-4368-9ed2-8115b32471e2 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:54.108655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:54.136941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970b0fb-b4fb-44d7-a35d-2916f17ed991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:54.138490 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970b0fb-b4fb-44d7-a35d-2916f17ed991 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:54.138988 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970b0fb-b4fb-44d7-a35d-2916f17ed991 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:54.139467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970b0fb-b4fb-44d7-a35d-2916f17ed991 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:54.144695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4386d-4e29-46e5-85d5-1222f71062b0 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:54.158026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970b0fb-b4fb-44d7-a35d-2916f17ed991 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:54.160024 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970b0fb-b4fb-44d7-a35d-2916f17ed991 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-c970b0fb-b4fb-44d7-a35d-2916f17ed991 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:54.173265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:54.174202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:54.175146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:54.175146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:54.175146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:54.175146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:54.175146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:54.175146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:54.175146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:54.175146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:54.178102 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 384/757] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:54.179248 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970b0fb-b4fb-44d7-a35d-2916f17ed991 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:54.186864 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920c145-1cf8-48ba-8157-cdfd67a04b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:54.187598 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920c145-1cf8-48ba-8157-cdfd67a04b8d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:54.187873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920c145-1cf8-48ba-8157-cdfd67a04b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:54.188219 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920c145-1cf8-48ba-8157-cdfd67a04b8d None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:54.188929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920c145-1cf8-48ba-8157-cdfd67a04b8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:54.189698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920c145-1cf8-48ba-8157-cdfd67a04b8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:54.191377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920c145-1cf8-48ba-8157-cdfd67a04b8d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:54.204431 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 374/758] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:54.205439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920c145-1cf8-48ba-8157-cdfd67a04b8d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:54.290986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970b0fb-b4fb-44d7-a35d-2916f17ed991 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:54.297418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:54.311671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920c145-1cf8-48ba-8157-cdfd67a04b8d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:54.349176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19bcc9-a10a-4448-84a4-fb70ac685943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:54.350212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19bcc9-a10a-4448-84a4-fb70ac685943 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:54.350748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19bcc9-a10a-4448-84a4-fb70ac685943 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:54.351209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19bcc9-a10a-4448-84a4-fb70ac685943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:54.354340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56992950-8c5e-46da-83c7-44d3ef4ec02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:54.355092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56992950-8c5e-46da-83c7-44d3ef4ec02d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:54.355291 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56992950-8c5e-46da-83c7-44d3ef4ec02d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:54.355519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56992950-8c5e-46da-83c7-44d3ef4ec02d None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:54.356217 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56992950-8c5e-46da-83c7-44d3ef4ec02d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:54.356513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56992950-8c5e-46da-83c7-44d3ef4ec02d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:54.357956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56992950-8c5e-46da-83c7-44d3ef4ec02d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:54.365855 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19bcc9-a10a-4448-84a4-fb70ac685943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:54.367976 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19bcc9-a10a-4448-84a4-fb70ac685943 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:54.375948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 375/759] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:54.378106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56992950-8c5e-46da-83c7-44d3ef4ec02d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-dc19bcc9-a10a-4448-84a4-fb70ac685943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:54.386697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:54.387777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:54.389096 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:54.389096 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:54.389096 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:54.389096 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 385/760] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:54.389096 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19bcc9-a10a-4448-84a4-fb70ac685943 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:54.423359 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:54.516317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19bcc9-a10a-4448-84a4-fb70ac685943 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:54.521766 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56992950-8c5e-46da-83c7-44d3ef4ec02d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:54.558746 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468aca73-76df-493a-b60d-5644c0e44a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:54.560263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468aca73-76df-493a-b60d-5644c0e44a9a None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:54.560824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468aca73-76df-493a-b60d-5644c0e44a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:54.561308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468aca73-76df-493a-b60d-5644c0e44a9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:54.562265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468aca73-76df-493a-b60d-5644c0e44a9a None admin] RBAC: Adding query filter params (role.id=2160bd7482684f0295250953180cc1b9, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=68876ef8dc62494996c1497819e980d1) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:54.562954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468aca73-76df-493a-b60d-5644c0e44a9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:54.564647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0dca1-ee1f-4f6a-8e79-59df6a2a386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:54.565171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468aca73-76df-493a-b60d-5644c0e44a9a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:54.565658 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0dca1-ee1f-4f6a-8e79-59df6a2a386e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:54.566109 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0dca1-ee1f-4f6a-8e79-59df6a2a386e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:54.566554 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0dca1-ee1f-4f6a-8e79-59df6a2a386e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:54.567408 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0dca1-ee1f-4f6a-8e79-59df6a2a386e None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=7d8a49035be2479b87c797bf53c9919b) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:54.567778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0dca1-ee1f-4f6a-8e79-59df6a2a386e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:54.569576 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0dca1-ee1f-4f6a-8e79-59df6a2a386e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:54.574898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 386/761] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:49:54 2022] GET /identity/v3/role_assignments?user.id=68876ef8dc62494996c1497819e980d1&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=2160bd7482684f0295250953180cc1b9 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:54.576539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468aca73-76df-493a-b60d-5644c0e44a9a None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:54.582733 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 376/762] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:49:54 2022] GET /identity/v3/role_assignments?user.id=7d8a49035be2479b87c797bf53c9919b&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:54.714770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:54.741993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468aca73-76df-493a-b60d-5644c0e44a9a None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:54.780447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd297e7f-7b60-4b7c-b965-e6a8e25f92a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:54.781073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd297e7f-7b60-4b7c-b965-e6a8e25f92a8 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:54.781352 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd297e7f-7b60-4b7c-b965-e6a8e25f92a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:54.781623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd297e7f-7b60-4b7c-b965-e6a8e25f92a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:54.782281 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd297e7f-7b60-4b7c-b965-e6a8e25f92a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:54.782589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd297e7f-7b60-4b7c-b965-e6a8e25f92a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:54.783993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd297e7f-7b60-4b7c-b965-e6a8e25f92a8 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:54.797070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 387/763] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:54.802685 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0dca1-ee1f-4f6a-8e79-59df6a2a386e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:54.821991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:54.939436 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0dca1-ee1f-4f6a-8e79-59df6a2a386e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:54.995419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d9a43-1aaa-4152-bd00-93e8ff2be5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:54.996438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d9a43-1aaa-4152-bd00-93e8ff2be5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:54.996911 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d9a43-1aaa-4152-bd00-93e8ff2be5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:54.997377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d9a43-1aaa-4152-bd00-93e8ff2be5f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:55.005375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d9a43-1aaa-4152-bd00-93e8ff2be5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:55.007119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d9a43-1aaa-4152-bd00-93e8ff2be5f0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-864d9a43-1aaa-4152-bd00-93e8ff2be5f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:49:55.024696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:55.025753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:55.026649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:49:55.026649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:49:55.026649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:49:55.026649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:49:55.026649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:49:55.026649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:49:55.026649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:49:55.026649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:55.029305 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 377/764] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:55.034760 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd297e7f-7b60-4b7c-b965-e6a8e25f92a8 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:55.108463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462814e9-47af-4119-80d7-d6dc98e55fc4 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:55.109696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462814e9-47af-4119-80d7-d6dc98e55fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:55.110229 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462814e9-47af-4119-80d7-d6dc98e55fc4 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:55.112773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 378/765] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:55.122213 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bc154-b111-4273-aa35-7853c3d9123f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:55.122835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bc154-b111-4273-aa35-7853c3d9123f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:55.123329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bc154-b111-4273-aa35-7853c3d9123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:55.155825 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-400bc154-b111-4273-aa35-7853c3d9123f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:55.157968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-400bc154-b111-4273-aa35-7853c3d9123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:55.174895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd297e7f-7b60-4b7c-b965-e6a8e25f92a8 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:55.214429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbef5a2-c95f-4513-8f64-e97e9492d578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:55.216809 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbef5a2-c95f-4513-8f64-e97e9492d578 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:55.217913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbef5a2-c95f-4513-8f64-e97e9492d578 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:55.218501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbef5a2-c95f-4513-8f64-e97e9492d578 None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:55.219563 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbef5a2-c95f-4513-8f64-e97e9492d578 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:55.221086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbef5a2-c95f-4513-8f64-e97e9492d578 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:55.224496 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbef5a2-c95f-4513-8f64-e97e9492d578 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:55.246555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 388/766] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:49:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:55.252234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbef5a2-c95f-4513-8f64-e97e9492d578 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:55.263274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:55.280814 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 379/767] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:49:55.401539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbef5a2-c95f-4513-8f64-e97e9492d578 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:55.448826 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31314161-699b-4f9d-8bdc-dd8da945360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:55.449489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31314161-699b-4f9d-8bdc-dd8da945360e None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:55.449811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31314161-699b-4f9d-8bdc-dd8da945360e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:55.450086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31314161-699b-4f9d-8bdc-dd8da945360e None admin] PATH_INFO: `/v3/projects/318c7f21f9d14e149f668863f748e89f/users/20e4a18ab77642baa9adb9a4b49fbcc2/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:55.452028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31314161-699b-4f9d-8bdc-dd8da945360e None admin] RBAC: Authorizing `identity:create_grant(project_id=318c7f21f9d14e149f668863f748e89f, user_id=20e4a18ab77642baa9adb9a4b49fbcc2, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:55.457480 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31314161-699b-4f9d-8bdc-dd8da945360e None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:55.461567 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e0110-82f3-4c2d-b64e-5f5a8f5c8f70 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:55.461854 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e0110-82f3-4c2d-b64e-5f5a8f5c8f70 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:55.462153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e0110-82f3-4c2d-b64e-5f5a8f5c8f70 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:55.463828 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 380/768] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:49:55.469243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f192cb-20e7-4133-868c-50c17a1d469e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:55.469528 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f192cb-20e7-4133-868c-50c17a1d469e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:55.469805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f192cb-20e7-4133-868c-50c17a1d469e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:55.473095 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 389/769] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:49:55 2022] PUT /identity/v3/projects/318c7f21f9d14e149f668863f748e89f/users/20e4a18ab77642baa9adb9a4b49fbcc2/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:49:55.476772 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:55.501807 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d2f192cb-20e7-4133-868c-50c17a1d469e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:55.502959 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d2f192cb-20e7-4133-868c-50c17a1d469e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:55.608691 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 381/770] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:49:55.654770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31314161-699b-4f9d-8bdc-dd8da945360e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:55.753441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:55.797926 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31314161-699b-4f9d-8bdc-dd8da945360e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:55.838209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c206d39-34d9-46f2-8fe9-bb1643a81098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:55.839404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c206d39-34d9-46f2-8fe9-bb1643a81098 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:55.839919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c206d39-34d9-46f2-8fe9-bb1643a81098 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:55.840531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c206d39-34d9-46f2-8fe9-bb1643a81098 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:55.841365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c206d39-34d9-46f2-8fe9-bb1643a81098 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:55.843392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c206d39-34d9-46f2-8fe9-bb1643a81098 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-2c206d39-34d9-46f2-8fe9-bb1643a81098 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:55.853822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:55.854898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:55.855717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:55.855717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:55.855717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:55.855717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:55.855717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:55.855717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:55.855717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:55.855717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:55.855717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:55.855717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:55.855717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:49:55.855717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:49:55.855717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:49:55.855717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:55.858618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 390/771] 10.222.0.77 () {56 vars in 1129 bytes} [Mon Aug 22 15:49:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:55.864291 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f192cb-20e7-4133-868c-50c17a1d469e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:55.924220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c206d39-34d9-46f2-8fe9-bb1643a81098 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:56.049005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f192cb-20e7-4133-868c-50c17a1d469e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:56.067403 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c206d39-34d9-46f2-8fe9-bb1643a81098 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:56.100449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:56.112670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6c93f-e09a-4fe8-a742-7b0b71117340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:56.113332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6c93f-e09a-4fe8-a742-7b0b71117340 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:56.113612 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6c93f-e09a-4fe8-a742-7b0b71117340 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:56.113885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6c93f-e09a-4fe8-a742-7b0b71117340 None admin] PATH_INFO: `/v3/services/network` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:56.115516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6c93f-e09a-4fe8-a742-7b0b71117340 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:56.116948 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6c93f-e09a-4fe8-a742-7b0b71117340 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:56.121978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-efa6c93f-e09a-4fe8-a742-7b0b71117340 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:56.132854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:56.134141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:56.135195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:56.135195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:56.135195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:56.135195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:56.135195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:56.135195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:56.135195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:56.135195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:56.135195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:56.135195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:56.135195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:49:56.135195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:49:56.135195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:49:56.135195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:56.136780 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c1ce5-9abc-4533-9aa6-915b6a2b315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:56.137400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c1ce5-9abc-4533-9aa6-915b6a2b315d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:56.137683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c1ce5-9abc-4533-9aa6-915b6a2b315d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:56.137958 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c1ce5-9abc-4533-9aa6-915b6a2b315d None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:56.138623 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c1ce5-9abc-4533-9aa6-915b6a2b315d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:56.138940 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c1ce5-9abc-4533-9aa6-915b6a2b315d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:56.140316 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c1ce5-9abc-4533-9aa6-915b6a2b315d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:56.141704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 391/772] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:55 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:56.149918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 382/773] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Aug 22 15:49:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:56.150651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6c93f-e09a-4fe8-a742-7b0b71117340 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:56.156292 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c1ce5-9abc-4533-9aa6-915b6a2b315d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:56.315674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6c93f-e09a-4fe8-a742-7b0b71117340 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:56.332989 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c1ce5-9abc-4533-9aa6-915b6a2b315d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:56.364420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1c18d-61d1-4bb8-93f3-3a8c9dc6ebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:56.365059 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c18d-61d1-4bb8-93f3-3a8c9dc6ebfd None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:56.365340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c18d-61d1-4bb8-93f3-3a8c9dc6ebfd None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:56.365719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c18d-61d1-4bb8-93f3-3a8c9dc6ebfd None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:56.366272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1c18d-61d1-4bb8-93f3-3a8c9dc6ebfd None admin] RBAC: Adding query filter params (name=network) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:56.366577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1c18d-61d1-4bb8-93f3-3a8c9dc6ebfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:56.368021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1c18d-61d1-4bb8-93f3-3a8c9dc6ebfd None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:56.373731 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 392/774] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 22 15:49:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:56.379736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1c18d-61d1-4bb8-93f3-3a8c9dc6ebfd None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:56.384256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190436-4df7-4442-a68f-188ddde27c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:56.384893 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190436-4df7-4442-a68f-188ddde27c69 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:56.385168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190436-4df7-4442-a68f-188ddde27c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:56.385440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190436-4df7-4442-a68f-188ddde27c69 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:56.386101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a190436-4df7-4442-a68f-188ddde27c69 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:56.386405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a190436-4df7-4442-a68f-188ddde27c69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:56.387835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a190436-4df7-4442-a68f-188ddde27c69 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:56.403548 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 383/775] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Aug 22 15:49:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:56.411415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190436-4df7-4442-a68f-188ddde27c69 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:56.483546 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:56.496142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:56.543004 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190436-4df7-4442-a68f-188ddde27c69 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:56.554522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1c18d-61d1-4bb8-93f3-3a8c9dc6ebfd None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:56.589263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1cab1-3029-46ae-b7ad-f949479d10b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:56.590234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1cab1-3029-46ae-b7ad-f949479d10b4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:56.590822 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1cab1-3029-46ae-b7ad-f949479d10b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:56.591420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1cab1-3029-46ae-b7ad-f949479d10b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:56.593498 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1cab1-3029-46ae-b7ad-f949479d10b4 None admin] RBAC: Adding query filter params (interface=public, service_id=d865e3d386c34028af107066aed0f821, region_id=RegionOne) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:56.594048 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1cab1-3029-46ae-b7ad-f949479d10b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:56.595942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1cab1-3029-46ae-b7ad-f949479d10b4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:56.614111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 384/776] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 22 15:49:56 2022] GET /identity/v3/endpoints?service_id=d865e3d386c34028af107066aed0f821&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:56.623369 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1cab1-3029-46ae-b7ad-f949479d10b4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:56.626573 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f67da-d927-47ea-a0d8-f9e33c9aff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:56.628667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f67da-d927-47ea-a0d8-f9e33c9aff58 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:56.629352 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f67da-d927-47ea-a0d8-f9e33c9aff58 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:56.631063 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f67da-d927-47ea-a0d8-f9e33c9aff58 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:56.632122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f67da-d927-47ea-a0d8-f9e33c9aff58 None admin] RBAC: Adding query filter params (type=network) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:56.635057 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f67da-d927-47ea-a0d8-f9e33c9aff58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:56.638713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f67da-d927-47ea-a0d8-f9e33c9aff58 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:56.650109 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 393/777] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 22 15:49:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:56.656528 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f67da-d927-47ea-a0d8-f9e33c9aff58 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:56.773937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1cab1-3029-46ae-b7ad-f949479d10b4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:56.801100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:56.818624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f67da-d927-47ea-a0d8-f9e33c9aff58 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:56.822868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70adfbd-33a5-4e7e-ae3a-2faee7af6051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:56.823769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70adfbd-33a5-4e7e-ae3a-2faee7af6051 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:56.824256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70adfbd-33a5-4e7e-ae3a-2faee7af6051 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:56.824746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70adfbd-33a5-4e7e-ae3a-2faee7af6051 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:56.825564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70adfbd-33a5-4e7e-ae3a-2faee7af6051 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:56.827789 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70adfbd-33a5-4e7e-ae3a-2faee7af6051 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:56.835464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 385/778] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 22 15:49:56 2022] GET /identity/v3/services => generated 772 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:56.854825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:56.877667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b05da-863b-4aef-86ef-94fa3d12ae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:56.878318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b05da-863b-4aef-86ef-94fa3d12ae75 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:56.878695 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b05da-863b-4aef-86ef-94fa3d12ae75 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:56.878977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b05da-863b-4aef-86ef-94fa3d12ae75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:56.879715 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b05da-863b-4aef-86ef-94fa3d12ae75 None admin] RBAC: Adding query filter params (interface=public, service_id=10daba6294344e2c8e8550bb36415d9d, region_id=RegionOne) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:56.880029 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b05da-863b-4aef-86ef-94fa3d12ae75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:56.881449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b05da-863b-4aef-86ef-94fa3d12ae75 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:56.897623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 394/779] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 22 15:49:56 2022] GET /identity/v3/endpoints?service_id=10daba6294344e2c8e8550bb36415d9d&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:56.903445 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70adfbd-33a5-4e7e-ae3a-2faee7af6051 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:57.024929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70adfbd-33a5-4e7e-ae3a-2faee7af6051 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:57.062710 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3aff9f-584a-432c-acab-0e2a9153d1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:57.063744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aff9f-584a-432c-acab-0e2a9153d1fa None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:57.064613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aff9f-584a-432c-acab-0e2a9153d1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:57.065082 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aff9f-584a-432c-acab-0e2a9153d1fa None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:57.065893 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3aff9f-584a-432c-acab-0e2a9153d1fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:57.067543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3aff9f-584a-432c-acab-0e2a9153d1fa None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:57.073904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 386/780] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 22 15:49:56 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:57.096185 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93e776-e4d0-4f77-a91e-253fcb3fdef0 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:57.096533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93e776-e4d0-4f77-a91e-253fcb3fdef0 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:57.096742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93e776-e4d0-4f77-a91e-253fcb3fdef0 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:57.098108 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 395/781] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:57.104006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f011a2e-320e-4961-81d1-30ae15cdcafe None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:57.104633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f011a2e-320e-4961-81d1-30ae15cdcafe None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:57.105195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f011a2e-320e-4961-81d1-30ae15cdcafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:57.126337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9f011a2e-320e-4961-81d1-30ae15cdcafe None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:57.127982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9f011a2e-320e-4961-81d1-30ae15cdcafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:57.153880 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dfa6c-4dd4-4698-9532-31dd721a02ef None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:57.154229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dfa6c-4dd4-4698-9532-31dd721a02ef None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:57.154433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dfa6c-4dd4-4698-9532-31dd721a02ef None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:57.155837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 396/782] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:49:57.162229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117f43e-83f9-4d76-a519-396fe6375ba3 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:57.162546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117f43e-83f9-4d76-a519-396fe6375ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:57.162907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117f43e-83f9-4d76-a519-396fe6375ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:57.188202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-7117f43e-83f9-4d76-a519-396fe6375ba3 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:57.189862 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7117f43e-83f9-4d76-a519-396fe6375ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:57.190676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:57.217010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 387/783] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:49:57.287936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 397/784] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:49:57.510905 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f011a2e-320e-4961-81d1-30ae15cdcafe None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:57.562278 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117f43e-83f9-4d76-a519-396fe6375ba3 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:57.626634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f011a2e-320e-4961-81d1-30ae15cdcafe None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:57.669871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798705bf-09c5-4b2c-9404-2aff43bd1d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:57.670513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798705bf-09c5-4b2c-9404-2aff43bd1d8f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:57.670815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798705bf-09c5-4b2c-9404-2aff43bd1d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:57.671077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798705bf-09c5-4b2c-9404-2aff43bd1d8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:57.684722 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798705bf-09c5-4b2c-9404-2aff43bd1d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-798705bf-09c5-4b2c-9404-2aff43bd1d8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:57.690107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:57.691232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:57.692085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:57.692085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:57.692085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:57.692085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:57.692085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:57.692085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:57.692085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:57.692085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:57.692085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:57.692085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:57.692085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:57.692085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:57.692085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 388/785] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:49:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:57.704579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798705bf-09c5-4b2c-9404-2aff43bd1d8f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:57.744432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117f43e-83f9-4d76-a519-396fe6375ba3 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:57.771275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:57.790063 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:57.792699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98272f5-5de1-4fb0-8a62-ea27c9c81d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:57.793356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98272f5-5de1-4fb0-8a62-ea27c9c81d02 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:57.793958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98272f5-5de1-4fb0-8a62-ea27c9c81d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:57.794248 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98272f5-5de1-4fb0-8a62-ea27c9c81d02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:57.818791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98272f5-5de1-4fb0-8a62-ea27c9c81d02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-f98272f5-5de1-4fb0-8a62-ea27c9c81d02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:57.823624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:57.824531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:57.825366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:57.825366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:57.825366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:57.825366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:57.825366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:57.825366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:57.825366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:57.825366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:57.825366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:57.825366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:57.825366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:49:57.825366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:57.826724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 398/786] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:49:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:57.832243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98272f5-5de1-4fb0-8a62-ea27c9c81d02 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:57.911684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798705bf-09c5-4b2c-9404-2aff43bd1d8f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:57.982014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662fe8b-790e-4680-8a60-758093444d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:57.983095 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662fe8b-790e-4680-8a60-758093444d64 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:57.983614 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662fe8b-790e-4680-8a60-758093444d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:57.984103 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662fe8b-790e-4680-8a60-758093444d64 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:57.984976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662fe8b-790e-4680-8a60-758093444d64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:57.985500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662fe8b-790e-4680-8a60-758093444d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:57.987158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662fe8b-790e-4680-8a60-758093444d64 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:57.997686 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 389/787] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:57.999457 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f8d5a-c5db-43b2-bb1e-2d93a18463c8 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:58.000078 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f8d5a-c5db-43b2-bb1e-2d93a18463c8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:58.000553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f8d5a-c5db-43b2-bb1e-2d93a18463c8 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:58.006260 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 390/788] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:58.007436 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f8d5a-c5db-43b2-bb1e-2d93a18463c8 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:58.022566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98272f5-5de1-4fb0-8a62-ea27c9c81d02 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:58.059263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965ff2e-e2cb-4390-928b-8fc9bad59e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:58.059944 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965ff2e-e2cb-4390-928b-8fc9bad59e3c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:58.060224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965ff2e-e2cb-4390-928b-8fc9bad59e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:58.060544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965ff2e-e2cb-4390-928b-8fc9bad59e3c None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:58.061704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965ff2e-e2cb-4390-928b-8fc9bad59e3c None admin] RBAC: Adding query filter params (name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:58.062196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965ff2e-e2cb-4390-928b-8fc9bad59e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:58.064275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965ff2e-e2cb-4390-928b-8fc9bad59e3c None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:58.075006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 399/789] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:49:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:58.076471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ac64d-afa3-4eb2-843d-d9dd6390422d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:58.076760 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ac64d-afa3-4eb2-843d-d9dd6390422d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:58.077037 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ac64d-afa3-4eb2-843d-d9dd6390422d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:58.095965 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1e2ac64d-afa3-4eb2-843d-d9dd6390422d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:58.097558 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1e2ac64d-afa3-4eb2-843d-d9dd6390422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:58.126696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f8d5a-c5db-43b2-bb1e-2d93a18463c8 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:58.129835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:58.131015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:58.168811 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a410288-423d-439d-894d-ebb2644e13d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:58.170009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a410288-423d-439d-894d-ebb2644e13d0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:58.170475 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a410288-423d-439d-894d-ebb2644e13d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:58.170976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a410288-423d-439d-894d-ebb2644e13d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:58.172939 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 400/790] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:49:58.172939 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ac64d-afa3-4eb2-843d-d9dd6390422d None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:58.196871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a410288-423d-439d-894d-ebb2644e13d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:58.199208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a410288-423d-439d-894d-ebb2644e13d0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-8a410288-423d-439d-894d-ebb2644e13d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:58.223687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:58.224704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:58.225592 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:58.225592 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:58.225592 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:58.232272 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 391/791] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:58.239235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a410288-423d-439d-894d-ebb2644e13d0 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:58.283954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ac64d-afa3-4eb2-843d-d9dd6390422d None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:58.334743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e7b52-6661-45d5-b74e-5a4d77f98729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:58.335586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e7b52-6661-45d5-b74e-5a4d77f98729 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:58.336011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e7b52-6661-45d5-b74e-5a4d77f98729 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:58.336511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e7b52-6661-45d5-b74e-5a4d77f98729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:58.347547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e7b52-6661-45d5-b74e-5a4d77f98729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:58.349341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e7b52-6661-45d5-b74e-5a4d77f98729 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-a15e7b52-6661-45d5-b74e-5a4d77f98729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:58.366460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:58.367507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:58.368461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:58.368461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:58.368461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:58.370580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 401/792] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:58.379542 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e7b52-6661-45d5-b74e-5a4d77f98729 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:58.427006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:58.433954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a410288-423d-439d-894d-ebb2644e13d0 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:58.524258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e7b52-6661-45d5-b74e-5a4d77f98729 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:58.531903 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9cfdc-3576-4dda-9efc-d4998bbeb367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:58.532914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9cfdc-3576-4dda-9efc-d4998bbeb367 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:58.533397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9cfdc-3576-4dda-9efc-d4998bbeb367 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:58.533870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9cfdc-3576-4dda-9efc-d4998bbeb367 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:58.534813 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9cfdc-3576-4dda-9efc-d4998bbeb367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:58.535334 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9cfdc-3576-4dda-9efc-d4998bbeb367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:58.536934 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9cfdc-3576-4dda-9efc-d4998bbeb367 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:58.559825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03742aaf-c545-4e0d-b646-a098ca5c97ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:58.560442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03742aaf-c545-4e0d-b646-a098ca5c97ad None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:58.560781 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03742aaf-c545-4e0d-b646-a098ca5c97ad None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:58.561060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03742aaf-c545-4e0d-b646-a098ca5c97ad None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:58.564433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03742aaf-c545-4e0d-b646-a098ca5c97ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:58.564433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03742aaf-c545-4e0d-b646-a098ca5c97ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:58.564433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03742aaf-c545-4e0d-b646-a098ca5c97ad None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:58.568555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 392/793] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:49:58.569499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9cfdc-3576-4dda-9efc-d4998bbeb367 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:58.578448 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 402/794] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:58.579453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03742aaf-c545-4e0d-b646-a098ca5c97ad None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:58.588594 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:58.670322 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:58.679859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9cfdc-3576-4dda-9efc-d4998bbeb367 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:58.692449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03742aaf-c545-4e0d-b646-a098ca5c97ad None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:58.716788 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25807f-0c84-48e4-aea7-21b50d1fcef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:58.717638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25807f-0c84-48e4-aea7-21b50d1fcef3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:58.717972 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25807f-0c84-48e4-aea7-21b50d1fcef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:58.718307 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25807f-0c84-48e4-aea7-21b50d1fcef3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:58.730377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25807f-0c84-48e4-aea7-21b50d1fcef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:49:58.731849 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bf3e8-0ff0-43b8-a8e7-4f8b2c34ed5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:58.732593 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf3e8-0ff0-43b8-a8e7-4f8b2c34ed5c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:58.732937 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf3e8-0ff0-43b8-a8e7-4f8b2c34ed5c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:58.733278 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf3e8-0ff0-43b8-a8e7-4f8b2c34ed5c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-5c25807f-0c84-48e4-aea7-21b50d1fcef3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:49:58.735769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:58.736904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:58.738516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:58.738516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:58.738516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:58.738516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:58.738516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:49:58.738516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:49:58.738516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:49:58.738516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:49:58.738516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:49:58.738516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:49:58.738516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:49:58.738516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:58.744855 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bf3e8-0ff0-43b8-a8e7-4f8b2c34ed5c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:58.745032 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 393/795] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:49:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:58.745127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bf3e8-0ff0-43b8-a8e7-4f8b2c34ed5c None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:58.745213 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25807f-0c84-48e4-aea7-21b50d1fcef3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-225bf3e8-0ff0-43b8-a8e7-4f8b2c34ed5c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:58.763507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:58.765685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:58.768012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:58.768012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:58.768012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:58.768012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:58.768012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:58.768012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:58.768012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:58.768012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:58.768012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:49:58.768012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:49:58.768012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 403/796] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:49:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:58.768012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bf3e8-0ff0-43b8-a8e7-4f8b2c34ed5c None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:58.858760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:58.891789 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25807f-0c84-48e4-aea7-21b50d1fcef3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:58.892050 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bf3e8-0ff0-43b8-a8e7-4f8b2c34ed5c None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:58.928865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c7bbd-3c24-4eca-97e3-863c1a55430c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:58.929787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c7bbd-3c24-4eca-97e3-863c1a55430c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:58.930301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c7bbd-3c24-4eca-97e3-863c1a55430c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:58.930827 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c7bbd-3c24-4eca-97e3-863c1a55430c None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:58.931978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c7bbd-3c24-4eca-97e3-863c1a55430c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:58.932513 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c7bbd-3c24-4eca-97e3-863c1a55430c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:58.934506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c7bbd-3c24-4eca-97e3-863c1a55430c None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:58.938712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dc6a7-7244-46a4-9b92-7d8da56d704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:58.939901 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc6a7-7244-46a4-9b92-7d8da56d704b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:58.940905 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc6a7-7244-46a4-9b92-7d8da56d704b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:58.941326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dc6a7-7244-46a4-9b92-7d8da56d704b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:58.943796 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 404/797] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:49:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:58.944612 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c7bbd-3c24-4eca-97e3-863c1a55430c None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:58.947490 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:58.959749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dc6a7-7244-46a4-9b92-7d8da56d704b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:58.961882 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dc6a7-7244-46a4-9b92-7d8da56d704b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-145dc6a7-7244-46a4-9b92-7d8da56d704b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:58.978506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:58.979736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:58.980888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:58.980888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:58.980888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:58.980888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:58.980888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:58.980888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:58.980888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:58.980888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:58.980888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:49:58.980888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:58.983736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 394/798] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 22 15:49:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:58.985523 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dc6a7-7244-46a4-9b92-7d8da56d704b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:59.077365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c7bbd-3c24-4eca-97e3-863c1a55430c None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:59.108637 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dc6a7-7244-46a4-9b92-7d8da56d704b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:59.116274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084ac8a-a585-4379-bf59-57c754420250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:59.116950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084ac8a-a585-4379-bf59-57c754420250 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.117331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084ac8a-a585-4379-bf59-57c754420250 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.117702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084ac8a-a585-4379-bf59-57c754420250 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.118635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084ac8a-a585-4379-bf59-57c754420250 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:59.119395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084ac8a-a585-4379-bf59-57c754420250 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:59.120823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084ac8a-a585-4379-bf59-57c754420250 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:59.145460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 405/799] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Aug 22 15:49:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:59.145460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084ac8a-a585-4379-bf59-57c754420250 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:59.153582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d1673-4eff-4731-bc66-4459f1c15c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:59.154290 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1673-4eff-4731-bc66-4459f1c15c0e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.154572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1673-4eff-4731-bc66-4459f1c15c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.154872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d1673-4eff-4731-bc66-4459f1c15c0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.157890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:59.167757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d1673-4eff-4731-bc66-4459f1c15c0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:59.169265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d1673-4eff-4731-bc66-4459f1c15c0e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c93d1673-4eff-4731-bc66-4459f1c15c0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:59.184394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:59.185571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:59.186742 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:59.186742 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:59.186742 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:59.190791 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 395/800] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:59.192025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9a976-081b-437d-99bf-603f995d2060 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.192304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9a976-081b-437d-99bf-603f995d2060 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.192581 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9a976-081b-437d-99bf-603f995d2060 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.198393 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 396/801] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:59.198393 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9a976-081b-437d-99bf-603f995d2060 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:59.221320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:59.269511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084ac8a-a585-4379-bf59-57c754420250 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:59.313365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951b8c8-9723-4baf-9793-0012fe14b59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:59.314374 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951b8c8-9723-4baf-9793-0012fe14b59a None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.314767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951b8c8-9723-4baf-9793-0012fe14b59a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.315107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951b8c8-9723-4baf-9793-0012fe14b59a None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.315939 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951b8c8-9723-4baf-9793-0012fe14b59a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:59.316246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951b8c8-9723-4baf-9793-0012fe14b59a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:59.317155 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9a976-081b-437d-99bf-603f995d2060 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:59.317970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951b8c8-9723-4baf-9793-0012fe14b59a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:59.353771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 406/802] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Aug 22 15:49:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:59.353771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951b8c8-9723-4baf-9793-0012fe14b59a None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:59.363436 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25911c37-ae80-4a6b-ac67-df9100b526cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:59.364075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25911c37-ae80-4a6b-ac67-df9100b526cd None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.364340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25911c37-ae80-4a6b-ac67-df9100b526cd None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.364625 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25911c37-ae80-4a6b-ac67-df9100b526cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.376420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25911c37-ae80-4a6b-ac67-df9100b526cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:59.377846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25911c37-ae80-4a6b-ac67-df9100b526cd None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-25911c37-ae80-4a6b-ac67-df9100b526cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:59.392444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:59.393417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:59.394387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:59.394387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:59.394387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:59.394387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 397/803] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:59.394918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f32cd2-1eb6-45bf-9a47-b74eb40e9068 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.395011 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f32cd2-1eb6-45bf-9a47-b74eb40e9068 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.395235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f32cd2-1eb6-45bf-9a47-b74eb40e9068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.413806 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-10f32cd2-1eb6-45bf-9a47-b74eb40e9068 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:59.415045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-10f32cd2-1eb6-45bf-9a47-b74eb40e9068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:59.448615 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:59.452932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951b8c8-9723-4baf-9793-0012fe14b59a None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:59.470908 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:59.481860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 398/804] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:49:59.482866 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f32cd2-1eb6-45bf-9a47-b74eb40e9068 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:59.494626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad3ec9-a2d3-47c9-91d2-e80ac37cfc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:59.495545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad3ec9-a2d3-47c9-91d2-e80ac37cfc50 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.495822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad3ec9-a2d3-47c9-91d2-e80ac37cfc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.496105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad3ec9-a2d3-47c9-91d2-e80ac37cfc50 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.497280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad3ec9-a2d3-47c9-91d2-e80ac37cfc50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:59.497280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad3ec9-a2d3-47c9-91d2-e80ac37cfc50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:59.499975 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad3ec9-a2d3-47c9-91d2-e80ac37cfc50 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:59.514541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 407/805] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:59.515921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f3207-ba38-4bd7-a2ce-774def1dfc87 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.516292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f3207-ba38-4bd7-a2ce-774def1dfc87 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.516634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f3207-ba38-4bd7-a2ce-774def1dfc87 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.522060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 408/806] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:49:59.522060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f3207-ba38-4bd7-a2ce-774def1dfc87 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:59.595707 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f32cd2-1eb6-45bf-9a47-b74eb40e9068 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:59.633329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7eb60-7005-4baa-a839-a63ce1c3af12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:59.633878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7eb60-7005-4baa-a839-a63ce1c3af12 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.634240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7eb60-7005-4baa-a839-a63ce1c3af12 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.634491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7eb60-7005-4baa-a839-a63ce1c3af12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.635970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f3207-ba38-4bd7-a2ce-774def1dfc87 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:59.645104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7eb60-7005-4baa-a839-a63ce1c3af12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:59.646718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7eb60-7005-4baa-a839-a63ce1c3af12 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-95c7eb60-7005-4baa-a839-a63ce1c3af12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:49:59.662411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:59.663537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:49:59.664453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:49:59.664453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:49:59.664453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:59.664453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 399/807] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:59.664453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7eb60-7005-4baa-a839-a63ce1c3af12 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:59.679560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597850fe-8738-46ea-bad4-112dc986ef36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:59.680332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597850fe-8738-46ea-bad4-112dc986ef36 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.680610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597850fe-8738-46ea-bad4-112dc986ef36 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.680951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597850fe-8738-46ea-bad4-112dc986ef36 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.681635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597850fe-8738-46ea-bad4-112dc986ef36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:59.681948 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597850fe-8738-46ea-bad4-112dc986ef36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:59.683347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597850fe-8738-46ea-bad4-112dc986ef36 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:59.700916 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 409/808] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:59.701118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:59.701238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3dd0f-fcf6-4e0d-b2b3-06eb4e70a305 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.701238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3dd0f-fcf6-4e0d-b2b3-06eb4e70a305 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.701238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3dd0f-fcf6-4e0d-b2b3-06eb4e70a305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.716139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-b1e3dd0f-fcf6-4e0d-b2b3-06eb4e70a305 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:49:59.717354 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-b1e3dd0f-fcf6-4e0d-b2b3-06eb4e70a305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:49:59.749965 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:59.781792 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7eb60-7005-4baa-a839-a63ce1c3af12 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:59.789400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 410/809] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:49:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:49:59.790291 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3dd0f-fcf6-4e0d-b2b3-06eb4e70a305 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:59.815506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fdfa2-85df-4853-8623-964d0a8ae7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:59.816140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fdfa2-85df-4853-8623-964d0a8ae7de None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.816410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fdfa2-85df-4853-8623-964d0a8ae7de None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.816677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fdfa2-85df-4853-8623-964d0a8ae7de None admin] PATH_INFO: `/v3/users/nova` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.824506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fdfa2-85df-4853-8623-964d0a8ae7de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:59.825941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fdfa2-85df-4853-8623-964d0a8ae7de None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-737fdfa2-85df-4853-8623-964d0a8ae7de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:49:59.837098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:49:59.838079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:49:59.839152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:49:59.839152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:49:59.839152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:49:59.839152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:49:59.839152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:49:59.839152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:49:59.839152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:49:59.839152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:49:59.839152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:49:59.839152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:49:59.839152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 400/810] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 22 15:49:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:49:59.839745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fdfa2-85df-4853-8623-964d0a8ae7de None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:59.915342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3dd0f-fcf6-4e0d-b2b3-06eb4e70a305 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:59.930150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:49:59.954151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdeccd5-b2d8-4f18-9515-a413d13decb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:49:59.954787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdeccd5-b2d8-4f18-9515-a413d13decb8 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:49:59.955064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdeccd5-b2d8-4f18-9515-a413d13decb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:49:59.955255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fdfa2-85df-4853-8623-964d0a8ae7de None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:49:59.955357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdeccd5-b2d8-4f18-9515-a413d13decb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:49:59.955970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdeccd5-b2d8-4f18-9515-a413d13decb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:49:59.956266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdeccd5-b2d8-4f18-9515-a413d13decb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:49:59.957663 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdeccd5-b2d8-4f18-9515-a413d13decb8 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:49:59.970301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 411/811] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:49:59.971282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdeccd5-b2d8-4f18-9515-a413d13decb8 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:49:59.999465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2ca58-26fd-4225-8ca2-a5fd6e85a66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:00.000444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ca58-26fd-4225-8ca2-a5fd6e85a66a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:00.000771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:00.000906 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ca58-26fd-4225-8ca2-a5fd6e85a66a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:00.001169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ca58-26fd-4225-8ca2-a5fd6e85a66a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:00.008739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2ca58-26fd-4225-8ca2-a5fd6e85a66a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:00.010209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2ca58-26fd-4225-8ca2-a5fd6e85a66a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-57f2ca58-26fd-4225-8ca2-a5fd6e85a66a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:50:00.022071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:00.023020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:00.023928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:50:00.023928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:50:00.023928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:50:00.023928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:50:00.023928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:50:00.023928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:50:00.023928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:00.023928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:00.023928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 401/812] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:49:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:00.024427 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2ca58-26fd-4225-8ca2-a5fd6e85a66a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:00.080273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdeccd5-b2d8-4f18-9515-a413d13decb8 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:00.114670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b9cdf-4fed-4250-a71a-1a5dfc8a6125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:00.115297 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b9cdf-4fed-4250-a71a-1a5dfc8a6125 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:00.115570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b9cdf-4fed-4250-a71a-1a5dfc8a6125 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:00.115834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b9cdf-4fed-4250-a71a-1a5dfc8a6125 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:00.116418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b9cdf-4fed-4250-a71a-1a5dfc8a6125 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:00.117799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b9cdf-4fed-4250-a71a-1a5dfc8a6125 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-e01b9cdf-4fed-4250-a71a-1a5dfc8a6125 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:00.126392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:00.127621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:00.128489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 412/813] 10.222.0.77 () {56 vars in 1129 bytes} [Mon Aug 22 15:49:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:00.129290 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b9cdf-4fed-4250-a71a-1a5dfc8a6125 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:00.129361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2ca58-26fd-4225-8ca2-a5fd6e85a66a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:00.163204 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10f183-f3c8-467e-9fc1-d3e871846672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:00.163835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10f183-f3c8-467e-9fc1-d3e871846672 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:00.164110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10f183-f3c8-467e-9fc1-d3e871846672 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:00.164414 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10f183-f3c8-467e-9fc1-d3e871846672 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:00.165198 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10f183-f3c8-467e-9fc1-d3e871846672 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:00.165562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10f183-f3c8-467e-9fc1-d3e871846672 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:00.167001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10f183-f3c8-467e-9fc1-d3e871846672 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:00.183936 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:00.190935 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 402/814] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 22 15:50:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:00.191926 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10f183-f3c8-467e-9fc1-d3e871846672 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:00.224466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:00.233730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b9cdf-4fed-4250-a71a-1a5dfc8a6125 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:00.268540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57e24f-1975-4a6f-a978-b98e8123a8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:00.269164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57e24f-1975-4a6f-a978-b98e8123a8eb None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:00.269436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57e24f-1975-4a6f-a978-b98e8123a8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:00.269702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57e24f-1975-4a6f-a978-b98e8123a8eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:00.276555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57e24f-1975-4a6f-a978-b98e8123a8eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:00.277996 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57e24f-1975-4a6f-a978-b98e8123a8eb None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-cb57e24f-1975-4a6f-a978-b98e8123a8eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:50:00.288964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:00.289857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:00.290885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:50:00.290885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:50:00.290885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:50:00.290885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:50:00.290885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:50:00.290885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:50:00.290885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:00.290885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:00.290885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 413/815] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:00.291375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57e24f-1975-4a6f-a978-b98e8123a8eb None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:00.298744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10f183-f3c8-467e-9fc1-d3e871846672 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:00.335987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53481f-28ef-490f-bb14-f83984a0ab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:00.336600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53481f-28ef-490f-bb14-f83984a0ab82 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:00.336871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53481f-28ef-490f-bb14-f83984a0ab82 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:00.337172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53481f-28ef-490f-bb14-f83984a0ab82 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:00.337948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53481f-28ef-490f-bb14-f83984a0ab82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:00.338248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53481f-28ef-490f-bb14-f83984a0ab82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:00.339709 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53481f-28ef-490f-bb14-f83984a0ab82 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:00.351148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 403/816] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:50:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:00.351954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53481f-28ef-490f-bb14-f83984a0ab82 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:00.398758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57e24f-1975-4a6f-a978-b98e8123a8eb None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:00.420053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:00.436274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f91db-1115-47a6-bfde-de02ac76f7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:00.436918 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f91db-1115-47a6-bfde-de02ac76f7df None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:00.437197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f91db-1115-47a6-bfde-de02ac76f7df None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:00.437472 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f91db-1115-47a6-bfde-de02ac76f7df None admin] PATH_INFO: `/v3/services/network` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:00.438068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f91db-1115-47a6-bfde-de02ac76f7df None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:00.439857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f91db-1115-47a6-bfde-de02ac76f7df None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-7a4f91db-1115-47a6-bfde-de02ac76f7df None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:00.449441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:00.450997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:00.452004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 414/817] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:00 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:00.452927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f91db-1115-47a6-bfde-de02ac76f7df None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:00.473087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:00.483217 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53481f-28ef-490f-bb14-f83984a0ab82 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:00.519755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605cd5-6a87-42cc-a6fe-ebea2111a399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:00.520371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605cd5-6a87-42cc-a6fe-ebea2111a399 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:00.520648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605cd5-6a87-42cc-a6fe-ebea2111a399 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:00.520918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605cd5-6a87-42cc-a6fe-ebea2111a399 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:00.521553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6605cd5-6a87-42cc-a6fe-ebea2111a399 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:00.521854 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6605cd5-6a87-42cc-a6fe-ebea2111a399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:00.523418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6605cd5-6a87-42cc-a6fe-ebea2111a399 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:00.529967 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 404/818] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Aug 22 15:50:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:00.530853 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605cd5-6a87-42cc-a6fe-ebea2111a399 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:00.560978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f91db-1115-47a6-bfde-de02ac76f7df None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:00.596801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f53ab0-5acb-430c-b960-29754b718099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:00.597415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f53ab0-5acb-430c-b960-29754b718099 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:00.597696 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f53ab0-5acb-430c-b960-29754b718099 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:00.597969 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f53ab0-5acb-430c-b960-29754b718099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:00.644252 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605cd5-6a87-42cc-a6fe-ebea2111a399 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:00.666373 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f53ab0-5acb-430c-b960-29754b718099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:00.667969 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f53ab0-5acb-430c-b960-29754b718099 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:00.668813 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:00.681466 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a77350-11ae-41cc-b1f1-3fc8b2b4b895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:00.682040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a77350-11ae-41cc-b1f1-3fc8b2b4b895 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:00.682314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a77350-11ae-41cc-b1f1-3fc8b2b4b895 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:00.682578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a77350-11ae-41cc-b1f1-3fc8b2b4b895 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:00.685868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a77350-11ae-41cc-b1f1-3fc8b2b4b895 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:00.686363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a77350-11ae-41cc-b1f1-3fc8b2b4b895 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:00.687444 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:00.689301 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a77350-11ae-41cc-b1f1-3fc8b2b4b895 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:00.703908 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 405/819] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:50:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:00.704787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a77350-11ae-41cc-b1f1-3fc8b2b4b895 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:00.776192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 415/820] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:50:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:00.777092 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f53ab0-5acb-430c-b960-29754b718099 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:00.806997 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a77350-11ae-41cc-b1f1-3fc8b2b4b895 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:00.842406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff842bc-6780-4d30-8739-b19c86161b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:00.843109 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff842bc-6780-4d30-8739-b19c86161b3c None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:00.843390 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff842bc-6780-4d30-8739-b19c86161b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:00.843662 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff842bc-6780-4d30-8739-b19c86161b3c None admin] PATH_INFO: `/v3/projects/318c7f21f9d14e149f668863f748e89f/users/7d8a49035be2479b87c797bf53c9919b/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:00.845612 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff842bc-6780-4d30-8739-b19c86161b3c None admin] RBAC: Authorizing `identity:create_grant(project_id=318c7f21f9d14e149f668863f748e89f, user_id=7d8a49035be2479b87c797bf53c9919b, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:00.847105 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff842bc-6780-4d30-8739-b19c86161b3c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:00.861040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 406/821] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:50:00 2022] PUT /identity/v3/projects/318c7f21f9d14e149f668863f748e89f/users/7d8a49035be2479b87c797bf53c9919b/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:50:00.861872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff842bc-6780-4d30-8739-b19c86161b3c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:00.886179 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f53ab0-5acb-430c-b960-29754b718099 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:00.904850 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:00.921038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:00.927203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099732cc-6039-43a2-99b1-0cd17c84d1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:00.928032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099732cc-6039-43a2-99b1-0cd17c84d1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:00.928413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099732cc-6039-43a2-99b1-0cd17c84d1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:00.928742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099732cc-6039-43a2-99b1-0cd17c84d1d3 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:00.929471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099732cc-6039-43a2-99b1-0cd17c84d1d3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:00.929841 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099732cc-6039-43a2-99b1-0cd17c84d1d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:00.931579 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099732cc-6039-43a2-99b1-0cd17c84d1d3 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:00.942349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 416/822] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 22 15:50:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:00.942349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099732cc-6039-43a2-99b1-0cd17c84d1d3 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:00.993559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff842bc-6780-4d30-8739-b19c86161b3c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:01.043940 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9430016-c41f-494a-ad58-fc0987b65566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:01.044554 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430016-c41f-494a-ad58-fc0987b65566 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:01.044827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430016-c41f-494a-ad58-fc0987b65566 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:01.045095 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430016-c41f-494a-ad58-fc0987b65566 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:01.045734 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9430016-c41f-494a-ad58-fc0987b65566 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:01.046035 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9430016-c41f-494a-ad58-fc0987b65566 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:01.047473 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9430016-c41f-494a-ad58-fc0987b65566 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:01.053086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 407/823] 10.222.0.77 () {56 vars in 1124 bytes} [Mon Aug 22 15:50:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:01.054060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9430016-c41f-494a-ad58-fc0987b65566 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:01.078011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099732cc-6039-43a2-99b1-0cd17c84d1d3 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:01.116189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d72984-a0e2-416b-acbc-d6ef24d88946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:01.116851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d72984-a0e2-416b-acbc-d6ef24d88946 None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:01.117125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d72984-a0e2-416b-acbc-d6ef24d88946 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:01.117394 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d72984-a0e2-416b-acbc-d6ef24d88946 None admin] PATH_INFO: `/v3/projects/318c7f21f9d14e149f668863f748e89f/users/68876ef8dc62494996c1497819e980d1/roles/2160bd7482684f0295250953180cc1b9` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:01.132991 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d72984-a0e2-416b-acbc-d6ef24d88946 None admin] RBAC: Authorizing `identity:create_grant(project_id=318c7f21f9d14e149f668863f748e89f, user_id=68876ef8dc62494996c1497819e980d1, role_id=2160bd7482684f0295250953180cc1b9)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:01.134532 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d72984-a0e2-416b-acbc-d6ef24d88946 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:01.150616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 417/824] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:50:00 2022] PUT /identity/v3/projects/318c7f21f9d14e149f668863f748e89f/users/68876ef8dc62494996c1497819e980d1/roles/2160bd7482684f0295250953180cc1b9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:50:01.152318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d72984-a0e2-416b-acbc-d6ef24d88946 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:01.172287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9430016-c41f-494a-ad58-fc0987b65566 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:01.184099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:01.196166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:01.215866 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d83a0-0ebe-4f08-b431-d18041904fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:01.216527 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d83a0-0ebe-4f08-b431-d18041904fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:01.216805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d83a0-0ebe-4f08-b431-d18041904fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:01.217073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d83a0-0ebe-4f08-b431-d18041904fb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:01.230389 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d83a0-0ebe-4f08-b431-d18041904fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:01.232155 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d83a0-0ebe-4f08-b431-d18041904fb9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-143d83a0-0ebe-4f08-b431-d18041904fb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:01.250407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:01.251696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:01.252809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:01.252809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:01.252809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:01.256540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 408/825] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:01.257504 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d83a0-0ebe-4f08-b431-d18041904fb9 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:01.318538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d72984-a0e2-416b-acbc-d6ef24d88946 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:01.375077 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc960d28-646e-49af-a740-4c39b2edca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:01.375946 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc960d28-646e-49af-a740-4c39b2edca91 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:01.376365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc960d28-646e-49af-a740-4c39b2edca91 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:01.376706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc960d28-646e-49af-a740-4c39b2edca91 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:01.377459 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc960d28-646e-49af-a740-4c39b2edca91 None admin] RBAC: Adding query filter params (type=network) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:01.377768 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc960d28-646e-49af-a740-4c39b2edca91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:01.379726 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc960d28-646e-49af-a740-4c39b2edca91 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:01.386192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 418/826] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 22 15:50:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:01.387120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc960d28-646e-49af-a740-4c39b2edca91 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:01.405570 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d83a0-0ebe-4f08-b431-d18041904fb9 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:01.448756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc62bf-d2c9-4393-9f68-5e90682005d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:01.449378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc62bf-d2c9-4393-9f68-5e90682005d8 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:01.449754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc62bf-d2c9-4393-9f68-5e90682005d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:01.450098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc62bf-d2c9-4393-9f68-5e90682005d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:01.450912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc62bf-d2c9-4393-9f68-5e90682005d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:01.452344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc62bf-d2c9-4393-9f68-5e90682005d8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:01.480558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 409/827] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 15:50:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:50:01.482936 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc62bf-d2c9-4393-9f68-5e90682005d8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:01.509068 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:01.544799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:01.573002 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc960d28-646e-49af-a740-4c39b2edca91 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:01.648553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ed445-5cd4-468a-8768-8f713122b984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:01.649451 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ed445-5cd4-468a-8768-8f713122b984 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:01.649937 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ed445-5cd4-468a-8768-8f713122b984 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:01.650387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ed445-5cd4-468a-8768-8f713122b984 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:01.651240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ed445-5cd4-468a-8768-8f713122b984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:01.651687 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ed445-5cd4-468a-8768-8f713122b984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:01.653241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ed445-5cd4-468a-8768-8f713122b984 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:01.656993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc62bf-d2c9-4393-9f68-5e90682005d8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:01.668380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 419/828] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:01.674229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ed445-5cd4-468a-8768-8f713122b984 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:01.719259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef302-1a3a-446f-b4c3-e519c008198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:01.720239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef302-1a3a-446f-b4c3-e519c008198b None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:01.721139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef302-1a3a-446f-b4c3-e519c008198b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:01.721631 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef302-1a3a-446f-b4c3-e519c008198b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:01.724824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ef302-1a3a-446f-b4c3-e519c008198b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:01.726641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ef302-1a3a-446f-b4c3-e519c008198b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:01.762032 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 410/829] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 15:50:01 2022] POST /identity/v3/endpoints => generated 337 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:50:01.842308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ed445-5cd4-468a-8768-8f713122b984 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:01.898033 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d5ff0-ea66-4ba0-aacc-b159338179c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:01.898926 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d5ff0-ea66-4ba0-aacc-b159338179c5 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:01.899203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d5ff0-ea66-4ba0-aacc-b159338179c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:01.899577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d5ff0-ea66-4ba0-aacc-b159338179c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:01.913411 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d5ff0-ea66-4ba0-aacc-b159338179c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:01.915012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d5ff0-ea66-4ba0-aacc-b159338179c5 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-ef3d5ff0-ea66-4ba0-aacc-b159338179c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:50:01.931219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:01.932186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:01.933163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:50:01.933163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:50:01.933163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:50:01.933163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:50:01.933163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:50:01.933163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:50:01.933163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:01.933163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:01.933163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 420/830] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:01.938625 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef302-1a3a-446f-b4c3-e519c008198b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:02.037072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:02.093538 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef302-1a3a-446f-b4c3-e519c008198b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:02.134019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd978403-acc3-4110-a99b-f21056df9759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:02.134679 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd978403-acc3-4110-a99b-f21056df9759 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:02.134963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd978403-acc3-4110-a99b-f21056df9759 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:02.135234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd978403-acc3-4110-a99b-f21056df9759 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:02.135930 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd978403-acc3-4110-a99b-f21056df9759 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:02.136232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd978403-acc3-4110-a99b-f21056df9759 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:02.137681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd978403-acc3-4110-a99b-f21056df9759 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:02.154406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 411/831] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:50:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:02.162270 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d5ff0-ea66-4ba0-aacc-b159338179c5 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:02.182048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:02.283469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d5ff0-ea66-4ba0-aacc-b159338179c5 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:02.322345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bae35d-3b2e-43ca-9184-73ab23ce6238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:02.322904 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bae35d-3b2e-43ca-9184-73ab23ce6238 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:02.323178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bae35d-3b2e-43ca-9184-73ab23ce6238 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:02.323450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bae35d-3b2e-43ca-9184-73ab23ce6238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:02.324184 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bae35d-3b2e-43ca-9184-73ab23ce6238 None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=20e4a18ab77642baa9adb9a4b49fbcc2) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:02.324493 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bae35d-3b2e-43ca-9184-73ab23ce6238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:02.326026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bae35d-3b2e-43ca-9184-73ab23ce6238 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:02.333392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 421/832] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:50:02 2022] GET /identity/v3/role_assignments?user.id=20e4a18ab77642baa9adb9a4b49fbcc2&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:02.948239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c48eb-5208-4e17-b49d-5f5a6200c514 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:02.948803 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c48eb-5208-4e17-b49d-5f5a6200c514 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:02.948803 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c48eb-5208-4e17-b49d-5f5a6200c514 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:02.950364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 412/833] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:02.955875 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7367a-9271-407f-a083-872035cff444 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:02.956336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7367a-9271-407f-a083-872035cff444 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:02.956437 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7367a-9271-407f-a083-872035cff444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:02.975847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-6ef7367a-9271-407f-a083-872035cff444 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:02.977047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-6ef7367a-9271-407f-a083-872035cff444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:03.040726 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:03.050986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 422/834] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:03.291173 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d142bef-d958-4e7c-b000-549b0ed43503 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:03.291371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d142bef-d958-4e7c-b000-549b0ed43503 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:03.291790 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d142bef-d958-4e7c-b000-549b0ed43503 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:03.293505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 413/835] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:03.299061 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b273f4-b461-474b-8098-5f7c3fe42c4d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:03.299420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b273f4-b461-474b-8098-5f7c3fe42c4d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:03.299762 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b273f4-b461-474b-8098-5f7c3fe42c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:03.319423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d142bef-d958-4e7c-b000-549b0ed43503 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:03.446697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-89b273f4-b461-474b-8098-5f7c3fe42c4d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:03.447971 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-89b273f4-b461-474b-8098-5f7c3fe42c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:03.530772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 423/836] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:03.565412 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d142bef-d958-4e7c-b000-549b0ed43503 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:03.594392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:03.603216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fbc4f-5f16-4869-93d4-a3983218e74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:03.604082 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fbc4f-5f16-4869-93d4-a3983218e74c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:03.604348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fbc4f-5f16-4869-93d4-a3983218e74c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:03.604621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fbc4f-5f16-4869-93d4-a3983218e74c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:03.616308 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fbc4f-5f16-4869-93d4-a3983218e74c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7d4fbc4f-5f16-4869-93d4-a3983218e74c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:50:03.625452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:03.626994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:03.628312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:03.628312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:03.628312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:03.628312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:03.628312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:50:03.628312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:50:03.628312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:50:03.628312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:50:03.628312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:50:03.628312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:50:03.628312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:50:03.628312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:03.628312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 414/837] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:50:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:03.640057 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b273f4-b461-474b-8098-5f7c3fe42c4d None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:03.749188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b273f4-b461-474b-8098-5f7c3fe42c4d None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:03.783933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:03.790029 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fd346-1fbf-478e-ada2-550d48133654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:03.790709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fd346-1fbf-478e-ada2-550d48133654 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:03.791405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fd346-1fbf-478e-ada2-550d48133654 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:03.791684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fd346-1fbf-478e-ada2-550d48133654 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:03.792372 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fd346-1fbf-478e-ada2-550d48133654 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:03.793069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fd346-1fbf-478e-ada2-550d48133654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:03.794494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fd346-1fbf-478e-ada2-550d48133654 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:03.798108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942f082-21e8-4965-9a0b-ec1ec1b45322 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:03.798394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942f082-21e8-4965-9a0b-ec1ec1b45322 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:03.798702 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942f082-21e8-4965-9a0b-ec1ec1b45322 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:03.800320 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 415/838] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:03.804191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 424/839] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:50:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:03.805584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010da77-e33c-4fd8-a900-85b2fcece7fa None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:03.805928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010da77-e33c-4fd8-a900-85b2fcece7fa None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:03.806201 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6010da77-e33c-4fd8-a900-85b2fcece7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:03.810409 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fd346-1fbf-478e-ada2-550d48133654 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:03.825651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6010da77-e33c-4fd8-a900-85b2fcece7fa None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:03.826934 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6010da77-e33c-4fd8-a900-85b2fcece7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:03.906478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 416/840] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:50:03.907551 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010da77-e33c-4fd8-a900-85b2fcece7fa None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:03.941733 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fd346-1fbf-478e-ada2-550d48133654 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:03.990745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c5104-1b3d-4175-946b-f9ca5dbebab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:03.991656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c5104-1b3d-4175-946b-f9ca5dbebab4 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:03.991656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c5104-1b3d-4175-946b-f9ca5dbebab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:03.992028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c5104-1b3d-4175-946b-f9ca5dbebab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:04.009087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c5104-1b3d-4175-946b-f9ca5dbebab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:04.010736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c5104-1b3d-4175-946b-f9ca5dbebab4 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-b68c5104-1b3d-4175-946b-f9ca5dbebab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:04.040667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:04.042507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:04.044393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:04.044393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:04.044393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:04.046846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 425/841] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:04.055312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c5104-1b3d-4175-946b-f9ca5dbebab4 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:04.077425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6010da77-e33c-4fd8-a900-85b2fcece7fa None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:04.102397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:04.128480 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67420a5f-aa34-44bf-9d5e-893562770824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:04.129592 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67420a5f-aa34-44bf-9d5e-893562770824 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:04.130317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67420a5f-aa34-44bf-9d5e-893562770824 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:04.130951 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67420a5f-aa34-44bf-9d5e-893562770824 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:04.141574 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:04.153222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67420a5f-aa34-44bf-9d5e-893562770824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-67420a5f-aa34-44bf-9d5e-893562770824 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:50:04.159552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:04.161380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:04.163873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:04.163873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:04.163873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:04.163873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:04.163873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:50:04.163873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:50:04.163873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:50:04.163873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:50:04.163873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:50:04.163873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:50:04.163873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:50:04.163873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:04.166023 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 417/842] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:50:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:04.167462 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67420a5f-aa34-44bf-9d5e-893562770824 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:04.248005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c5104-1b3d-4175-946b-f9ca5dbebab4 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:04.287254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67420a5f-aa34-44bf-9d5e-893562770824 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:04.301770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cede711-902a-4b69-a052-db35d65447a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:04.302402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cede711-902a-4b69-a052-db35d65447a8 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:04.302699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cede711-902a-4b69-a052-db35d65447a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:04.303103 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cede711-902a-4b69-a052-db35d65447a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:04.303633 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cede711-902a-4b69-a052-db35d65447a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:04.304301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cede711-902a-4b69-a052-db35d65447a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:04.305376 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cede711-902a-4b69-a052-db35d65447a8 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:04.323167 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 426/843] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:04.324669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cede711-902a-4b69-a052-db35d65447a8 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:04.338156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5152f-0d04-42f4-8ffe-b5e21c4e495a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:04.338979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5152f-0d04-42f4-8ffe-b5e21c4e495a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:04.339217 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5152f-0d04-42f4-8ffe-b5e21c4e495a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:04.339484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5152f-0d04-42f4-8ffe-b5e21c4e495a None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:04.340194 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5152f-0d04-42f4-8ffe-b5e21c4e495a None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:04.340491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5152f-0d04-42f4-8ffe-b5e21c4e495a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:04.341932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5152f-0d04-42f4-8ffe-b5e21c4e495a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:04.351004 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 418/844] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:50:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:04.351885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5152f-0d04-42f4-8ffe-b5e21c4e495a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:04.413385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:04.465885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cede711-902a-4b69-a052-db35d65447a8 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:04.468341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:04.476544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5152f-0d04-42f4-8ffe-b5e21c4e495a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:04.502776 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae245fc4-5173-4538-a667-adcbe0734462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:04.503418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae245fc4-5173-4538-a667-adcbe0734462 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:04.503701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae245fc4-5173-4538-a667-adcbe0734462 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:04.503947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae245fc4-5173-4538-a667-adcbe0734462 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:04.504539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae245fc4-5173-4538-a667-adcbe0734462 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:04.505920 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae245fc4-5173-4538-a667-adcbe0734462 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:04.514356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045f7d8-a41a-4ff6-8bc4-042adbf5d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-ae245fc4-5173-4538-a667-adcbe0734462 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:04.514840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:04.515831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:04.516679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:04.516679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:04.516679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:04.516679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:04.516679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:04.516679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:04.516679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:04.516679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:04.516679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:04.516679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:04.516679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:04.516679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:04.516679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:50:04.516679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:04.517443 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045f7d8-a41a-4ff6-8bc4-042adbf5d0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:04.517443 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045f7d8-a41a-4ff6-8bc4-042adbf5d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:04.517443 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045f7d8-a41a-4ff6-8bc4-042adbf5d0b6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:04.517716 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 427/845] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:50:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:04.517716 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae245fc4-5173-4538-a667-adcbe0734462 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:04.527198 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045f7d8-a41a-4ff6-8bc4-042adbf5d0b6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:04.528386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045f7d8-a41a-4ff6-8bc4-042adbf5d0b6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-b045f7d8-a41a-4ff6-8bc4-042adbf5d0b6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:50:04.541299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:04.542543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:04.543765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:04.543765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:04.543765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:50:04.543765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:50:04.543765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:50:04.543765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:50:04.543765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:50:04.543765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:50:04.543765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 15:50:04.543765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:04.543765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 419/846] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:50:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:04.543765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03779f3f-7727-46a0-bd49-65668b4c037f None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:04.544570 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03779f3f-7727-46a0-bd49-65668b4c037f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:04.544570 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03779f3f-7727-46a0-bd49-65668b4c037f None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:04.549632 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 420/847] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:04.549632 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03779f3f-7727-46a0-bd49-65668b4c037f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:04.633191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae245fc4-5173-4538-a667-adcbe0734462 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:04.657981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:04.662776 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03779f3f-7727-46a0-bd49-65668b4c037f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:04.669629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d78e6-78b6-4463-a6ba-5d360a52a8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:04.670273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d78e6-78b6-4463-a6ba-5d360a52a8ba None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:04.670531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d78e6-78b6-4463-a6ba-5d360a52a8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:04.670831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d78e6-78b6-4463-a6ba-5d360a52a8ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:04.682219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d78e6-78b6-4463-a6ba-5d360a52a8ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:04.683717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d78e6-78b6-4463-a6ba-5d360a52a8ba None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-e62d78e6-78b6-4463-a6ba-5d360a52a8ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:04.698753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:04.700048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:04.701181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:04.701181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:04.701181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:04.701380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341cff8-0e13-413c-beb0-62ad7336af5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:04.701380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341cff8-0e13-413c-beb0-62ad7336af5e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:04.701566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 428/848] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:04.701672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341cff8-0e13-413c-beb0-62ad7336af5e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:04.701672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341cff8-0e13-413c-beb0-62ad7336af5e None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:04.701874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d78e6-78b6-4463-a6ba-5d360a52a8ba None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:04.701949 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341cff8-0e13-413c-beb0-62ad7336af5e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:04.701949 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341cff8-0e13-413c-beb0-62ad7336af5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:04.703029 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341cff8-0e13-413c-beb0-62ad7336af5e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:04.709829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 421/849] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:50:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:04.711404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605655ce-c510-40b3-b0ba-6d747e92ba22 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:04.711731 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605655ce-c510-40b3-b0ba-6d747e92ba22 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:04.712031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605655ce-c510-40b3-b0ba-6d747e92ba22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:04.732831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:04.733382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-605655ce-c510-40b3-b0ba-6d747e92ba22 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:04.734701 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-605655ce-c510-40b3-b0ba-6d747e92ba22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:04.824262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 422/850] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:04.826024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605655ce-c510-40b3-b0ba-6d747e92ba22 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:04.861129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d78e6-78b6-4463-a6ba-5d360a52a8ba None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:04.903212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b84cf2-06f2-4e56-81b8-391437fecc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:04.903924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b84cf2-06f2-4e56-81b8-391437fecc84 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:04.904298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b84cf2-06f2-4e56-81b8-391437fecc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:04.904567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b84cf2-06f2-4e56-81b8-391437fecc84 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:04.905315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b84cf2-06f2-4e56-81b8-391437fecc84 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:04.905610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b84cf2-06f2-4e56-81b8-391437fecc84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:04.907170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b84cf2-06f2-4e56-81b8-391437fecc84 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:04.930634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 429/851] 10.222.0.77 () {56 vars in 1135 bytes} [Mon Aug 22 15:50:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:04.931629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b84cf2-06f2-4e56-81b8-391437fecc84 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:04.946111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:04.956796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605655ce-c510-40b3-b0ba-6d747e92ba22 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:04.995319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dfc03-3ea7-4d85-81e4-0d6bcf3284ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:04.995945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dfc03-3ea7-4d85-81e4-0d6bcf3284ae None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:04.996223 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dfc03-3ea7-4d85-81e4-0d6bcf3284ae None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:04.996493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dfc03-3ea7-4d85-81e4-0d6bcf3284ae None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:04.997161 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dfc03-3ea7-4d85-81e4-0d6bcf3284ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:04.997457 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dfc03-3ea7-4d85-81e4-0d6bcf3284ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:04.998881 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dfc03-3ea7-4d85-81e4-0d6bcf3284ae None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:05.011535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 423/852] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:05.012401 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dfc03-3ea7-4d85-81e4-0d6bcf3284ae None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:05.033005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:05.058512 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b84cf2-06f2-4e56-81b8-391437fecc84 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:05.098749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3710b3-828c-4950-8b61-6953a919c748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:05.099439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3710b3-828c-4950-8b61-6953a919c748 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:05.099720 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3710b3-828c-4950-8b61-6953a919c748 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:05.100038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3710b3-828c-4950-8b61-6953a919c748 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:05.100748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3710b3-828c-4950-8b61-6953a919c748 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:05.101046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3710b3-828c-4950-8b61-6953a919c748 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:05.102427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3710b3-828c-4950-8b61-6953a919c748 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:05.107972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 430/853] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:50:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:05.108937 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3710b3-828c-4950-8b61-6953a919c748 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:05.163981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dfc03-3ea7-4d85-81e4-0d6bcf3284ae None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:05.212622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23f17e-11fc-4f87-8ee9-96f1aafda4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:05.213549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23f17e-11fc-4f87-8ee9-96f1aafda4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:05.213824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23f17e-11fc-4f87-8ee9-96f1aafda4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:05.214108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23f17e-11fc-4f87-8ee9-96f1aafda4e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:05.231628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3710b3-828c-4950-8b61-6953a919c748 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:05.250418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:05.278862 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba3fb2-602e-4c65-be25-6ee5542105e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:05.279525 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba3fb2-602e-4c65-be25-6ee5542105e8 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:05.279801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba3fb2-602e-4c65-be25-6ee5542105e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:05.280073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba3fb2-602e-4c65-be25-6ee5542105e8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:05.289215 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba3fb2-602e-4c65-be25-6ee5542105e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:05.290787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba3fb2-602e-4c65-be25-6ee5542105e8 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-62ba3fb2-602e-4c65-be25-6ee5542105e8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:50:05.305284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:05.307457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:05.309134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:05.309134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:05.309134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:50:05.309134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:50:05.309134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:50:05.309134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:50:05.309134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:50:05.309134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:50:05.309134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:50:05.309134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:05.309134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 431/854] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 22 15:50:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:05.309134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba3fb2-602e-4c65-be25-6ee5542105e8 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:05.313142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:05.332741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23f17e-11fc-4f87-8ee9-96f1aafda4e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:05.334817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23f17e-11fc-4f87-8ee9-96f1aafda4e3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:05.426035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba3fb2-602e-4c65-be25-6ee5542105e8 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:05.476240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4757f-fa78-48cd-aea8-ff03e89d18fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:05.476890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4757f-fa78-48cd-aea8-ff03e89d18fb None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:05.477177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4757f-fa78-48cd-aea8-ff03e89d18fb None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:05.477447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4757f-fa78-48cd-aea8-ff03e89d18fb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:05.477980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 424/855] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:50:05 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:05.478914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23f17e-11fc-4f87-8ee9-96f1aafda4e3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:05.479614 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4757f-fa78-48cd-aea8-ff03e89d18fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:05.481967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4757f-fa78-48cd-aea8-ff03e89d18fb None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-9ba4757f-fa78-48cd-aea8-ff03e89d18fb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:05.497551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:05.498569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:05.499507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:05.499507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:05.499507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:05.499507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:05.499507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:05.499507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:05.499507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:05.499507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:05.499507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:05.499507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:05.499507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:05.499507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:05.499507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:50:05.499507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:05.500253 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 432/856] 10.222.0.77 () {56 vars in 1132 bytes} [Mon Aug 22 15:50:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:05.501184 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4757f-fa78-48cd-aea8-ff03e89d18fb None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:05.550928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:05.581566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:05.606908 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23f17e-11fc-4f87-8ee9-96f1aafda4e3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:05.620022 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4757f-fa78-48cd-aea8-ff03e89d18fb None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:05.647843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad60e0-f100-4416-a117-d37369410c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:05.648532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad60e0-f100-4416-a117-d37369410c07 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:05.648836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad60e0-f100-4416-a117-d37369410c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:05.649428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad60e0-f100-4416-a117-d37369410c07 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:05.650006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad60e0-f100-4416-a117-d37369410c07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:05.650311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad60e0-f100-4416-a117-d37369410c07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:05.651954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad60e0-f100-4416-a117-d37369410c07 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:05.658377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f04ad8-5796-43fd-83d5-6bffed72aeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:05.659059 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04ad8-5796-43fd-83d5-6bffed72aeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:05.659332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04ad8-5796-43fd-83d5-6bffed72aeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:05.659598 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04ad8-5796-43fd-83d5-6bffed72aeb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:05.674070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f04ad8-5796-43fd-83d5-6bffed72aeb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:05.680032 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 425/857] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Aug 22 15:50:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:05.680227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f04ad8-5796-43fd-83d5-6bffed72aeb2 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:05.680322 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad60e0-f100-4416-a117-d37369410c07 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-c1f04ad8-5796-43fd-83d5-6bffed72aeb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:05.700028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:05.701500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:05.702495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:05.702495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:05.702495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:05.702495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 433/858] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:05.702495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f04ad8-5796-43fd-83d5-6bffed72aeb2 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:05.824587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad60e0-f100-4416-a117-d37369410c07 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:05.838971 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f04ad8-5796-43fd-83d5-6bffed72aeb2 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:05.839850 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:05.859416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:05.864894 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd29f6-d465-4e44-ae2d-31ec457cfd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:05.865444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd29f6-d465-4e44-ae2d-31ec457cfd96 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:05.865719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd29f6-d465-4e44-ae2d-31ec457cfd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:05.865998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd29f6-d465-4e44-ae2d-31ec457cfd96 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:05.866667 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd29f6-d465-4e44-ae2d-31ec457cfd96 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:05.866976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd29f6-d465-4e44-ae2d-31ec457cfd96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:05.868448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd29f6-d465-4e44-ae2d-31ec457cfd96 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:05.873456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 426/859] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 22 15:50:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:05.874168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd29f6-d465-4e44-ae2d-31ec457cfd96 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:05.884165 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df549386-bd77-43a4-8b1c-99b019f48ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:05.884902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df549386-bd77-43a4-8b1c-99b019f48ecd None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:05.885241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df549386-bd77-43a4-8b1c-99b019f48ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:05.885585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df549386-bd77-43a4-8b1c-99b019f48ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:05.976254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df549386-bd77-43a4-8b1c-99b019f48ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:05.978385 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df549386-bd77-43a4-8b1c-99b019f48ecd None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:05.999999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd29f6-d465-4e44-ae2d-31ec457cfd96 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:06.061020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963eda-b09c-4428-9538-e3a626650c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:06.062044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963eda-b09c-4428-9538-e3a626650c10 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:06.062543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963eda-b09c-4428-9538-e3a626650c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:06.063056 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963eda-b09c-4428-9538-e3a626650c10 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:06.063924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6963eda-b09c-4428-9538-e3a626650c10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:06.064621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6963eda-b09c-4428-9538-e3a626650c10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:06.066044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6963eda-b09c-4428-9538-e3a626650c10 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:06.089203 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 427/860] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:06.089203 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963eda-b09c-4428-9538-e3a626650c10 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:06.131613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:06.155302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 434/861] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:50:05 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:06.157792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df549386-bd77-43a4-8b1c-99b019f48ecd None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:06.190701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:06.223463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963eda-b09c-4428-9538-e3a626650c10 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:06.270784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12a42c-5ad3-4062-a340-ae590508249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:06.271832 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12a42c-5ad3-4062-a340-ae590508249a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:06.272359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12a42c-5ad3-4062-a340-ae590508249a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:06.272894 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12a42c-5ad3-4062-a340-ae590508249a None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:06.273982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12a42c-5ad3-4062-a340-ae590508249a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:06.274312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12a42c-5ad3-4062-a340-ae590508249a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:06.275928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12a42c-5ad3-4062-a340-ae590508249a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:06.282174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 428/862] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 22 15:50:06 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:06.290768 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12a42c-5ad3-4062-a340-ae590508249a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:06.306454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df549386-bd77-43a4-8b1c-99b019f48ecd None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:06.358852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebfde9-cadb-4730-8b76-c620a04d52fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:06.359510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebfde9-cadb-4730-8b76-c620a04d52fb None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:06.359783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebfde9-cadb-4730-8b76-c620a04d52fb None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:06.360233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebfde9-cadb-4730-8b76-c620a04d52fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:06.370778 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebfde9-cadb-4730-8b76-c620a04d52fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:06.372833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebfde9-cadb-4730-8b76-c620a04d52fb None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-35ebfde9-cadb-4730-8b76-c620a04d52fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:50:06.389302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:06.390314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:06.391263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:50:06.391263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:50:06.391263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:50:06.391263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:50:06.391263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:50:06.391263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:50:06.391263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:06.391263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:06.391263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 435/863] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:06.401261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebfde9-cadb-4730-8b76-c620a04d52fb None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:06.480755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12a42c-5ad3-4062-a340-ae590508249a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:06.483653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:06.539847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:06.543888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8562719-0e10-4d15-bff1-8efdccdf32cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:06.545456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8562719-0e10-4d15-bff1-8efdccdf32cb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:06.546232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8562719-0e10-4d15-bff1-8efdccdf32cb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:06.547076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8562719-0e10-4d15-bff1-8efdccdf32cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:06.565604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebfde9-cadb-4730-8b76-c620a04d52fb None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:06.571163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8562719-0e10-4d15-bff1-8efdccdf32cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:06.574758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8562719-0e10-4d15-bff1-8efdccdf32cb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:06.604152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc38c3-7e66-47fa-8b4d-f9adb3e12b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:06.604769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc38c3-7e66-47fa-8b4d-f9adb3e12b1d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:06.605043 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc38c3-7e66-47fa-8b4d-f9adb3e12b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:06.605313 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc38c3-7e66-47fa-8b4d-f9adb3e12b1d None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:06.606020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc38c3-7e66-47fa-8b4d-f9adb3e12b1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:06.606325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc38c3-7e66-47fa-8b4d-f9adb3e12b1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-a8562719-0e10-4d15-bff1-8efdccdf32cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:06.607759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:06.609591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:06.611451 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:06.611451 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:06.611451 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:06.611802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc38c3-7e66-47fa-8b4d-f9adb3e12b1d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:06.623116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 429/865] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:06.625044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8562719-0e10-4d15-bff1-8efdccdf32cb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:06.626821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 436/865] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:50:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:06.628285 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc38c3-7e66-47fa-8b4d-f9adb3e12b1d None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:06.763203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc38c3-7e66-47fa-8b4d-f9adb3e12b1d None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:06.813684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee2f59-8677-46fc-81f6-d85b0b524693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:06.815415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee2f59-8677-46fc-81f6-d85b0b524693 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:06.815691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee2f59-8677-46fc-81f6-d85b0b524693 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:06.817161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee2f59-8677-46fc-81f6-d85b0b524693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:06.818546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee2f59-8677-46fc-81f6-d85b0b524693 None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=7d8a49035be2479b87c797bf53c9919b) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:06.818546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee2f59-8677-46fc-81f6-d85b0b524693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:06.819750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee2f59-8677-46fc-81f6-d85b0b524693 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:06.838073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8562719-0e10-4d15-bff1-8efdccdf32cb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:06.843283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 437/866] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:50:06 2022] GET /identity/v3/role_assignments?user.id=7d8a49035be2479b87c797bf53c9919b&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:06.900141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398ca48-0b5d-4921-a9db-3b7ecf3216ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:06.901280 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398ca48-0b5d-4921-a9db-3b7ecf3216ee None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:06.901852 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398ca48-0b5d-4921-a9db-3b7ecf3216ee None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:06.902448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398ca48-0b5d-4921-a9db-3b7ecf3216ee None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:06.903552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398ca48-0b5d-4921-a9db-3b7ecf3216ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:06.904108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398ca48-0b5d-4921-a9db-3b7ecf3216ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:06.906059 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398ca48-0b5d-4921-a9db-3b7ecf3216ee None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:06.926239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 430/867] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:06.932909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee2f59-8677-46fc-81f6-d85b0b524693 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:06.936457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:07.092279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee2f59-8677-46fc-81f6-d85b0b524693 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:07.157531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5bfbd-624d-4525-aed3-d3af435e2a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:07.159947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5bfbd-624d-4525-aed3-d3af435e2a36 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:07.160727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5bfbd-624d-4525-aed3-d3af435e2a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:07.161591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5bfbd-624d-4525-aed3-d3af435e2a36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:07.174815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5bfbd-624d-4525-aed3-d3af435e2a36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:07.178116 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5bfbd-624d-4525-aed3-d3af435e2a36 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-5cd5bfbd-624d-4525-aed3-d3af435e2a36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:50:07.202055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:07.203669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:07.205423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:50:07.205423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:50:07.205423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:50:07.205423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:50:07.205423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:50:07.205423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:50:07.205423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:07.205423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:07.209800 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 438/868] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:07.219833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398ca48-0b5d-4921-a9db-3b7ecf3216ee None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:07.246345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:07.379268 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd138292-678d-4ca1-a20f-9a991da3725b None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:07.379587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd138292-678d-4ca1-a20f-9a991da3725b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:07.379936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd138292-678d-4ca1-a20f-9a991da3725b None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:07.381415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 439/869] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:07.392149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5189c-a95a-43f0-89fd-3845e5728dcf None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:07.392447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5189c-a95a-43f0-89fd-3845e5728dcf None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:07.392789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5189c-a95a-43f0-89fd-3845e5728dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:07.412284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-13f5189c-a95a-43f0-89fd-3845e5728dcf None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:07.413998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-13f5189c-a95a-43f0-89fd-3845e5728dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:07.418861 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398ca48-0b5d-4921-a9db-3b7ecf3216ee None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:07.461342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfbb6f-e866-4af9-9e2b-933d8a2d218b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:07.462496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfbb6f-e866-4af9-9e2b-933d8a2d218b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:07.463016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfbb6f-e866-4af9-9e2b-933d8a2d218b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:07.463490 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfbb6f-e866-4af9-9e2b-933d8a2d218b None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:07.464453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfbb6f-e866-4af9-9e2b-933d8a2d218b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:07.464992 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfbb6f-e866-4af9-9e2b-933d8a2d218b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:07.466819 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfbb6f-e866-4af9-9e2b-933d8a2d218b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:07.482711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 431/870] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:50:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:07.490727 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfbb6f-e866-4af9-9e2b-933d8a2d218b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:07.492094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:07.520476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 440/871] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:07.638058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:07.684948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfbb6f-e866-4af9-9e2b-933d8a2d218b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:07.749296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce6fea-db42-4ad5-8891-8e4b5fdafb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:07.750338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce6fea-db42-4ad5-8891-8e4b5fdafb3f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:07.750882 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce6fea-db42-4ad5-8891-8e4b5fdafb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:07.751359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce6fea-db42-4ad5-8891-8e4b5fdafb3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:07.752727 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce6fea-db42-4ad5-8891-8e4b5fdafb3f None admin] RBAC: Adding query filter params (role.id=2160bd7482684f0295250953180cc1b9, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=68876ef8dc62494996c1497819e980d1) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:07.753234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce6fea-db42-4ad5-8891-8e4b5fdafb3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:07.755770 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce6fea-db42-4ad5-8891-8e4b5fdafb3f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:07.764604 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 432/872] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:50:07 2022] GET /identity/v3/role_assignments?user.id=68876ef8dc62494996c1497819e980d1&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=2160bd7482684f0295250953180cc1b9 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:07.782050 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5189c-a95a-43f0-89fd-3845e5728dcf None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:07.917488 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5189c-a95a-43f0-89fd-3845e5728dcf None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:07.959808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fadf0-d1ed-441d-a209-0ea9d5a34eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:07.960449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fadf0-d1ed-441d-a209-0ea9d5a34eb6 None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:07.960725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fadf0-d1ed-441d-a209-0ea9d5a34eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:07.961055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fadf0-d1ed-441d-a209-0ea9d5a34eb6 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:07.961734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fadf0-d1ed-441d-a209-0ea9d5a34eb6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:07.963262 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fadf0-d1ed-441d-a209-0ea9d5a34eb6 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:07.988656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 441/873] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 22 15:50:07 2022] POST /identity/v3/services => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:50:08.341114 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880c8ed-79ff-4281-b988-2fc30fe2af20 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:08.341672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880c8ed-79ff-4281-b988-2fc30fe2af20 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:08.341672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880c8ed-79ff-4281-b988-2fc30fe2af20 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:08.343365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 433/874] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:08.349269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e4128-4f93-401e-9b0e-57983a6805a8 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:08.350209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e4128-4f93-401e-9b0e-57983a6805a8 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:08.350777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e4128-4f93-401e-9b0e-57983a6805a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:08.370366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-db4e4128-4f93-401e-9b0e-57983a6805a8 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:08.372100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-db4e4128-4f93-401e-9b0e-57983a6805a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:08.424393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:08.454898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 442/875] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:50:08.729223 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880c8ed-79ff-4281-b988-2fc30fe2af20 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:08.844896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880c8ed-79ff-4281-b988-2fc30fe2af20 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:08.882842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970beeb-3f5e-4224-b6ad-1ebf10b5f1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:08.883546 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970beeb-3f5e-4224-b6ad-1ebf10b5f1d0 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:08.883870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970beeb-3f5e-4224-b6ad-1ebf10b5f1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:08.884199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970beeb-3f5e-4224-b6ad-1ebf10b5f1d0 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:08.884880 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970beeb-3f5e-4224-b6ad-1ebf10b5f1d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:08.886324 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970beeb-3f5e-4224-b6ad-1ebf10b5f1d0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:08.891480 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:08.908187 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 434/876] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 22 15:50:08 2022] POST /identity/v3/services => generated 269 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:50:09.005432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a277b4-eef4-4352-a044-2837307cd2fe None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:09.005807 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a277b4-eef4-4352-a044-2837307cd2fe None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:09.006172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a277b4-eef4-4352-a044-2837307cd2fe None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:09.008245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 443/877] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:09.014758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d457e4-583c-4ac7-b72c-0aeface76b1f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:09.015052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d457e4-583c-4ac7-b72c-0aeface76b1f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:09.015447 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d457e4-583c-4ac7-b72c-0aeface76b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:09.036189 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d6d457e4-583c-4ac7-b72c-0aeface76b1f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:09.037437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d6d457e4-583c-4ac7-b72c-0aeface76b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:09.130741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 435/878] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:09.493329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a277b4-eef4-4352-a044-2837307cd2fe None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:09.603539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a277b4-eef4-4352-a044-2837307cd2fe None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:09.646004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655a22c-fb88-4b28-a96c-833b54107064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:09.646703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655a22c-fb88-4b28-a96c-833b54107064 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:09.646972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655a22c-fb88-4b28-a96c-833b54107064 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:09.647240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655a22c-fb88-4b28-a96c-833b54107064 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:09.647856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655a22c-fb88-4b28-a96c-833b54107064 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:09.649293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655a22c-fb88-4b28-a96c-833b54107064 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-d655a22c-fb88-4b28-a96c-833b54107064 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:09.659195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:09.660342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:09.661193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 444/879] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 22 15:50:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:09.670089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d457e4-583c-4ac7-b72c-0aeface76b1f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:09.854075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d457e4-583c-4ac7-b72c-0aeface76b1f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:09.888231 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:09.898285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1844163-2d18-46a5-ad90-094f5073327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:09.898980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1844163-2d18-46a5-ad90-094f5073327c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:09.899259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1844163-2d18-46a5-ad90-094f5073327c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:09.899593 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1844163-2d18-46a5-ad90-094f5073327c None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:09.900253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1844163-2d18-46a5-ad90-094f5073327c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:09.900613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1844163-2d18-46a5-ad90-094f5073327c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:09.902039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1844163-2d18-46a5-ad90-094f5073327c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:09.908351 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 436/880] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 22 15:50:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:09.917459 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655a22c-fb88-4b28-a96c-833b54107064 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:09.999982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bc21f-7037-4fd6-acbb-d1e4902d9096 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:10.000657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bc21f-7037-4fd6-acbb-d1e4902d9096 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:10.001669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bc21f-7037-4fd6-acbb-d1e4902d9096 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:10.003634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 437/881] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:10.006710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:10.009807 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a3f72-411d-4679-ba95-4b643d28b71c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:10.010153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a3f72-411d-4679-ba95-4b643d28b71c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:10.010323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a3f72-411d-4679-ba95-4b643d28b71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:10.037396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-309a3f72-411d-4679-ba95-4b643d28b71c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:10.037396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-309a3f72-411d-4679-ba95-4b643d28b71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:10.122073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655a22c-fb88-4b28-a96c-833b54107064 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:10.147129 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 438/882] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:50:10.192619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6281f-0c0f-4a2b-b366-e76955042dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:10.194286 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6281f-0c0f-4a2b-b366-e76955042dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:10.195092 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6281f-0c0f-4a2b-b366-e76955042dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:10.195828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6281f-0c0f-4a2b-b366-e76955042dd3 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:10.197401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6281f-0c0f-4a2b-b366-e76955042dd3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:10.198233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6281f-0c0f-4a2b-b366-e76955042dd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:10.201276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6281f-0c0f-4a2b-b366-e76955042dd3 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:10.218825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 445/883] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 22 15:50:09 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:10.421776 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a3f72-411d-4679-ba95-4b643d28b71c None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:10.465725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aab443-51c2-4685-901f-c6dca10e132f None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:10.466258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aab443-51c2-4685-901f-c6dca10e132f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:10.466661 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aab443-51c2-4685-901f-c6dca10e132f None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:10.469448 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 446/884] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:10.478215 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc782f3-fa03-448b-8d50-532e1ff23380 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:10.478512 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc782f3-fa03-448b-8d50-532e1ff23380 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:10.478890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc782f3-fa03-448b-8d50-532e1ff23380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:10.499243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-ebc782f3-fa03-448b-8d50-532e1ff23380 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:10.500458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ebc782f3-fa03-448b-8d50-532e1ff23380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:10.599403 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 447/885] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:10.611071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a3f72-411d-4679-ba95-4b643d28b71c None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:10.638041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:10.660903 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2ac77-8d46-4850-842f-57b2448b305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:10.661929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2ac77-8d46-4850-842f-57b2448b305f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:10.662388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2ac77-8d46-4850-842f-57b2448b305f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:10.662859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2ac77-8d46-4850-842f-57b2448b305f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:10.676671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2ac77-8d46-4850-842f-57b2448b305f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-53f2ac77-8d46-4850-842f-57b2448b305f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:50:10.682665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:10.683681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:10.684536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:10.684536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:10.684536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:10.684536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:10.684536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:50:10.684536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:50:10.684536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:50:10.684536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:50:10.684536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:50:10.684536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:50:10.684536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:50:10.684536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:10.687055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 439/886] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Aug 22 15:50:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:10.694058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc782f3-fa03-448b-8d50-532e1ff23380 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:10.737887 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:10.866754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc782f3-fa03-448b-8d50-532e1ff23380 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:10.921561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018a041-622d-4072-a514-2fdd6424048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:10.922200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018a041-622d-4072-a514-2fdd6424048c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:10.922479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018a041-622d-4072-a514-2fdd6424048c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:10.922781 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018a041-622d-4072-a514-2fdd6424048c None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:10.923481 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018a041-622d-4072-a514-2fdd6424048c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:10.923789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018a041-622d-4072-a514-2fdd6424048c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:10.925223 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018a041-622d-4072-a514-2fdd6424048c None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:10.935663 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 448/887] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Aug 22 15:50:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:10.936077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2ac77-8d46-4850-842f-57b2448b305f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:10.941715 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018a041-622d-4072-a514-2fdd6424048c None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:11.052027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:11.056374 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2ac77-8d46-4850-842f-57b2448b305f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:11.057046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018a041-622d-4072-a514-2fdd6424048c None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:11.096653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf20d3-aff7-48d7-a1b6-4feba3b31289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:11.097859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf20d3-aff7-48d7-a1b6-4feba3b31289 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:11.098448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf20d3-aff7-48d7-a1b6-4feba3b31289 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:11.099018 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf20d3-aff7-48d7-a1b6-4feba3b31289 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:11.099856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf20d3-aff7-48d7-a1b6-4feba3b31289 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:11.100859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962a343-8410-4939-8d9b-1388b2f00a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:11.101525 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962a343-8410-4939-8d9b-1388b2f00a17 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:11.101804 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962a343-8410-4939-8d9b-1388b2f00a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:11.102072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962a343-8410-4939-8d9b-1388b2f00a17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:11.102874 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf20d3-aff7-48d7-a1b6-4feba3b31289 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-f1cf20d3-aff7-48d7-a1b6-4feba3b31289 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:11.113507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:11.114573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:11.115844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:11.115844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:11.115844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:11.115844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:11.115844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:11.115844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:11.115844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:11.115844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:11.115844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:11.115844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:11.115844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:11.115844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:11.115844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:50:11.115844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:11.116591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962a343-8410-4939-8d9b-1388b2f00a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:11.117439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962a343-8410-4939-8d9b-1388b2f00a17 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:11.123036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 440/888] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:50:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:11.125573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf20d3-aff7-48d7-a1b6-4feba3b31289 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-6962a343-8410-4939-8d9b-1388b2f00a17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:11.134758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:11.135783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:11.136672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:11.136672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:11.136672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:11.138694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 449/889] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:11.142257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962a343-8410-4939-8d9b-1388b2f00a17 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:11.183260 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:11.258327 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf20d3-aff7-48d7-a1b6-4feba3b31289 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:11.276713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962a343-8410-4939-8d9b-1388b2f00a17 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:11.317933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcc8d7-ce2b-4c79-9584-3a27f590d6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:11.319740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcc8d7-ce2b-4c79-9584-3a27f590d6eb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:11.320223 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcc8d7-ce2b-4c79-9584-3a27f590d6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:11.320912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcc8d7-ce2b-4c79-9584-3a27f590d6eb None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:11.322083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcc8d7-ce2b-4c79-9584-3a27f590d6eb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:11.322573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcc8d7-ce2b-4c79-9584-3a27f590d6eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:11.324590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcc8d7-ce2b-4c79-9584-3a27f590d6eb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:11.325079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ee148-5381-4ba4-a554-b26c8ea78c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:11.325716 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ee148-5381-4ba4-a554-b26c8ea78c10 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:11.326368 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ee148-5381-4ba4-a554-b26c8ea78c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:11.326712 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ee148-5381-4ba4-a554-b26c8ea78c10 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:11.327527 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ee148-5381-4ba4-a554-b26c8ea78c10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:11.327825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ee148-5381-4ba4-a554-b26c8ea78c10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:11.329252 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ee148-5381-4ba4-a554-b26c8ea78c10 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:11.338647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 441/890] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:50:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:11.340525 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34d3ac-9f4a-4a79-9d4a-e89acb4b9201 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:11.340801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34d3ac-9f4a-4a79-9d4a-e89acb4b9201 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:11.341071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34d3ac-9f4a-4a79-9d4a-e89acb4b9201 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:11.348132 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 442/891] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:11.348132 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34d3ac-9f4a-4a79-9d4a-e89acb4b9201 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:11.357395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 450/892] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:11.358491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f36bb-e439-4beb-a89e-2be04ec4ad4b None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:11.358799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f36bb-e439-4beb-a89e-2be04ec4ad4b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:11.359068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f36bb-e439-4beb-a89e-2be04ec4ad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:11.378633 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-086f36bb-e439-4beb-a89e-2be04ec4ad4b None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:11.379864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-086f36bb-e439-4beb-a89e-2be04ec4ad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:11.383651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:11.464195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 451/893] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:11.465455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f36bb-e439-4beb-a89e-2be04ec4ad4b None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:11.509326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34d3ac-9f4a-4a79-9d4a-e89acb4b9201 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:11.515202 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:11.565573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33513d3-0eba-4cf2-b941-9cc19e171586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:11.567043 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33513d3-0eba-4cf2-b941-9cc19e171586 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:11.567474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33513d3-0eba-4cf2-b941-9cc19e171586 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:11.567925 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33513d3-0eba-4cf2-b941-9cc19e171586 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:11.569033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33513d3-0eba-4cf2-b941-9cc19e171586 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:11.569541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33513d3-0eba-4cf2-b941-9cc19e171586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:11.572101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33513d3-0eba-4cf2-b941-9cc19e171586 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:11.587431 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 443/894] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:50:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:11.590801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33513d3-0eba-4cf2-b941-9cc19e171586 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:11.624969 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f36bb-e439-4beb-a89e-2be04ec4ad4b None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:11.669950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec6d78-7b5c-4f00-8ea3-ec05b243e2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:11.671937 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec6d78-7b5c-4f00-8ea3-ec05b243e2fe None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:11.672432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec6d78-7b5c-4f00-8ea3-ec05b243e2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:11.672892 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec6d78-7b5c-4f00-8ea3-ec05b243e2fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:11.683541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec6d78-7b5c-4f00-8ea3-ec05b243e2fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:11.685827 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec6d78-7b5c-4f00-8ea3-ec05b243e2fe None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:11.689892 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-d2ec6d78-7b5c-4f00-8ea3-ec05b243e2fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:50:11.703220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:11.704257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:11.705232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:11.705232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:11.705232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:50:11.705232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:50:11.705232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:50:11.705232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:50:11.705232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:50:11.705232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:50:11.705232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:50:11.705232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:11.712761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 452/895] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 22 15:50:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:11.715886 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec6d78-7b5c-4f00-8ea3-ec05b243e2fe None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:11.777289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33513d3-0eba-4cf2-b941-9cc19e171586 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:11.822221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5cd5b-3eda-4b34-a31f-e502da0abea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:11.823323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5cd5b-3eda-4b34-a31f-e502da0abea8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:11.823778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5cd5b-3eda-4b34-a31f-e502da0abea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:11.824259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5cd5b-3eda-4b34-a31f-e502da0abea8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:11.825584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5cd5b-3eda-4b34-a31f-e502da0abea8 None admin] RBAC: Adding query filter params (interface=public, service_id=b666f374af9445bc823d189313a83c83, region_id=RegionOne) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:11.826136 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5cd5b-3eda-4b34-a31f-e502da0abea8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:11.828871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5cd5b-3eda-4b34-a31f-e502da0abea8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:11.838797 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 444/896] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 22 15:50:11 2022] GET /identity/v3/endpoints?service_id=b666f374af9445bc823d189313a83c83&interface=public®ion_id=RegionOne => generated 194 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:11.844569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5cd5b-3eda-4b34-a31f-e502da0abea8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:11.865604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec6d78-7b5c-4f00-8ea3-ec05b243e2fe None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:11.884941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:11.911300 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e616da7-123a-4910-a919-1d836e0320c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:11.911929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e616da7-123a-4910-a919-1d836e0320c1 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:11.912797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e616da7-123a-4910-a919-1d836e0320c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:11.913088 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e616da7-123a-4910-a919-1d836e0320c1 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:11.913865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e616da7-123a-4910-a919-1d836e0320c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:11.914179 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e616da7-123a-4910-a919-1d836e0320c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:11.915765 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e616da7-123a-4910-a919-1d836e0320c1 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:11.939554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 453/897] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Aug 22 15:50:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:11.940473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e616da7-123a-4910-a919-1d836e0320c1 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:11.977765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5cd5b-3eda-4b34-a31f-e502da0abea8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:12.020729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8527eb2-8d72-47ee-a22c-2280aeb55c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:12.021387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8527eb2-8d72-47ee-a22c-2280aeb55c01 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:12.021664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8527eb2-8d72-47ee-a22c-2280aeb55c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:12.021940 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8527eb2-8d72-47ee-a22c-2280aeb55c01 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:12.022547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8527eb2-8d72-47ee-a22c-2280aeb55c01 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:12.024015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8527eb2-8d72-47ee-a22c-2280aeb55c01 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-d8527eb2-8d72-47ee-a22c-2280aeb55c01 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:12.038505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:12.040542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:12.043141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 445/898] 10.222.0.77 () {56 vars in 1132 bytes} [Mon Aug 22 15:50:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:12.045664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8527eb2-8d72-47ee-a22c-2280aeb55c01 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:12.046286 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:12.101903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e616da7-123a-4910-a919-1d836e0320c1 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:12.150102 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271ecdc-01e3-4736-bdd5-752b016878f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:12.151222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271ecdc-01e3-4736-bdd5-752b016878f8 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:12.151504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271ecdc-01e3-4736-bdd5-752b016878f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:12.151934 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271ecdc-01e3-4736-bdd5-752b016878f8 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:12.152570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271ecdc-01e3-4736-bdd5-752b016878f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:12.153972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271ecdc-01e3-4736-bdd5-752b016878f8 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:12.169453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 454/899] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 22 15:50:11 2022] GET /identity/v3/services => generated 1268 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:50:12.169453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271ecdc-01e3-4736-bdd5-752b016878f8 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:12.217765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:12.228649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8527eb2-8d72-47ee-a22c-2280aeb55c01 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:12.288919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cf5b4-13c9-493a-b137-807dbd6a1dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:12.289969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cf5b4-13c9-493a-b137-807dbd6a1dde None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:12.290610 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cf5b4-13c9-493a-b137-807dbd6a1dde None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:12.291160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cf5b4-13c9-493a-b137-807dbd6a1dde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:12.341384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271ecdc-01e3-4736-bdd5-752b016878f8 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:12.378537 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:12.403322 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc0984-5d73-4ebe-9693-b3dca699c901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:12.403955 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc0984-5d73-4ebe-9693-b3dca699c901 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:12.404235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc0984-5d73-4ebe-9693-b3dca699c901 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:12.404509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc0984-5d73-4ebe-9693-b3dca699c901 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:12.405638 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc0984-5d73-4ebe-9693-b3dca699c901 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:12.405942 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc0984-5d73-4ebe-9693-b3dca699c901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:12.407432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc0984-5d73-4ebe-9693-b3dca699c901 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:12.414381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 455/900] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 22 15:50:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:12.421197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc0984-5d73-4ebe-9693-b3dca699c901 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:12.448666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cf5b4-13c9-493a-b137-807dbd6a1dde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:12.450861 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cf5b4-13c9-493a-b137-807dbd6a1dde None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:12.568599 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc0984-5d73-4ebe-9693-b3dca699c901 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:12.612212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6307e8-27f6-422e-932b-78677ef4c130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:12.612845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6307e8-27f6-422e-932b-78677ef4c130 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:12.613112 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6307e8-27f6-422e-932b-78677ef4c130 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:12.613379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6307e8-27f6-422e-932b-78677ef4c130 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:12.614031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6307e8-27f6-422e-932b-78677ef4c130 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:12.614333 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6307e8-27f6-422e-932b-78677ef4c130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:12.615797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6307e8-27f6-422e-932b-78677ef4c130 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:12.621801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 456/901] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 22 15:50:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:12.623412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5382-77c1-4eca-a80f-da3b3b5ba6fc None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:12.623698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5382-77c1-4eca-a80f-da3b3b5ba6fc None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:12.623969 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5382-77c1-4eca-a80f-da3b3b5ba6fc None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:12.625553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 457/902] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:12.631064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e5382-77c1-4eca-a80f-da3b3b5ba6fc None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:12.641614 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:12.651971 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 446/903] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:50:12 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:12.654075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e89f8-ac13-4a9f-bf21-4693baa8bd68 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:12.654476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e89f8-ac13-4a9f-bf21-4693baa8bd68 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:12.654912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e89f8-ac13-4a9f-bf21-4693baa8bd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:12.681665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-cb1e89f8-ac13-4a9f-bf21-4693baa8bd68 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:12.683667 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cb1e89f8-ac13-4a9f-bf21-4693baa8bd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:12.725147 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:12.791203 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 447/904] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:12.791203 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e89f8-ac13-4a9f-bf21-4693baa8bd68 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:12.825838 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e5382-77c1-4eca-a80f-da3b3b5ba6fc None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:12.888660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d536-b95e-4045-a008-aafba16d82ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:12.889714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d536-b95e-4045-a008-aafba16d82ef None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:12.890195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d536-b95e-4045-a008-aafba16d82ef None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:12.890698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d536-b95e-4045-a008-aafba16d82ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:12.892322 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d536-b95e-4045-a008-aafba16d82ef None admin] RBAC: Adding query filter params (interface=public, service_id=68126b7c4bc743c1ba9d7b5d49c65de4, region_id=RegionOne) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:12.892770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d536-b95e-4045-a008-aafba16d82ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:12.895606 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d536-b95e-4045-a008-aafba16d82ef None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:12.909536 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 458/905] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 22 15:50:12 2022] GET /identity/v3/endpoints?service_id=68126b7c4bc743c1ba9d7b5d49c65de4&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:12.911775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d536-b95e-4045-a008-aafba16d82ef None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:12.955033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e89f8-ac13-4a9f-bf21-4693baa8bd68 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:13.007021 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:13.018768 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449ab07-5e05-471b-b9cf-64614eafd250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:13.019413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449ab07-5e05-471b-b9cf-64614eafd250 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:13.019691 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449ab07-5e05-471b-b9cf-64614eafd250 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:13.019961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449ab07-5e05-471b-b9cf-64614eafd250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:13.035313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449ab07-5e05-471b-b9cf-64614eafd250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:13.038515 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449ab07-5e05-471b-b9cf-64614eafd250 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:13.048209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d536-b95e-4045-a008-aafba16d82ef None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:13.067042 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-f449ab07-5e05-471b-b9cf-64614eafd250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:13.072505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:13.074345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:13.076250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:13.076250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:13.076250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:13.087311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 448/906] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:13.091330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449ab07-5e05-471b-b9cf-64614eafd250 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:13.091576 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e1dc1-c689-4f50-b993-954e24376001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:13.092302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e1dc1-c689-4f50-b993-954e24376001 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:13.092672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e1dc1-c689-4f50-b993-954e24376001 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:13.093012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e1dc1-c689-4f50-b993-954e24376001 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:13.093699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e1dc1-c689-4f50-b993-954e24376001 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:13.095405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e1dc1-c689-4f50-b993-954e24376001 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:13.110190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 459/907] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 22 15:50:12 2022] GET /identity/v3/services => generated 1268 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:50:13.226544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449ab07-5e05-471b-b9cf-64614eafd250 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:13.271561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64add06f-de1a-4931-ad85-c05ba0e691dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:13.271561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64add06f-de1a-4931-ad85-c05ba0e691dc None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:13.271841 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64add06f-de1a-4931-ad85-c05ba0e691dc None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:13.271945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64add06f-de1a-4931-ad85-c05ba0e691dc None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:13.272586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64add06f-de1a-4931-ad85-c05ba0e691dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:13.272889 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64add06f-de1a-4931-ad85-c05ba0e691dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:13.274305 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64add06f-de1a-4931-ad85-c05ba0e691dc None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:13.288529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 449/908] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:13.294666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e1dc1-c689-4f50-b993-954e24376001 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:13.300259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64add06f-de1a-4931-ad85-c05ba0e691dc None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:13.384984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:13.508871 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e1dc1-c689-4f50-b993-954e24376001 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:13.527257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64add06f-de1a-4931-ad85-c05ba0e691dc None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:13.587699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27687065-de58-458c-9b87-cf85a0258504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:13.588685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27687065-de58-458c-9b87-cf85a0258504 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:13.589190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27687065-de58-458c-9b87-cf85a0258504 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:13.589594 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27687065-de58-458c-9b87-cf85a0258504 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:13.603740 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27687065-de58-458c-9b87-cf85a0258504 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:13.605143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b44b1-daca-4089-99e9-e26cd02b2c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:13.606288 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27687065-de58-458c-9b87-cf85a0258504 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:13.606862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b44b1-daca-4089-99e9-e26cd02b2c4a None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:13.607616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b44b1-daca-4089-99e9-e26cd02b2c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:13.608411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b44b1-daca-4089-99e9-e26cd02b2c4a None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:13.610478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b44b1-daca-4089-99e9-e26cd02b2c4a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:13.614168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b44b1-daca-4089-99e9-e26cd02b2c4a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-27687065-de58-458c-9b87-cf85a0258504 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:50:13.630132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:13.632634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:13.634357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:50:13.634357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:50:13.634357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:50:13.634357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:50:13.634357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:50:13.634357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:50:13.634357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:13.634357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:13.639133 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 460/909] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:13.643035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27687065-de58-458c-9b87-cf85a0258504 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:13.655637 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 450/910] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 22 15:50:13 2022] POST /identity/v3/services => generated 241 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:50:13.712210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:13.792110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27687065-de58-458c-9b87-cf85a0258504 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:13.842408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c7c31-59b5-4f24-91e7-f9fb2a66c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:13.843398 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c7c31-59b5-4f24-91e7-f9fb2a66c656 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:13.843865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c7c31-59b5-4f24-91e7-f9fb2a66c656 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:13.844418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c7c31-59b5-4f24-91e7-f9fb2a66c656 None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:13.845376 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c7c31-59b5-4f24-91e7-f9fb2a66c656 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:13.845871 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c7c31-59b5-4f24-91e7-f9fb2a66c656 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:13.847711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c7c31-59b5-4f24-91e7-f9fb2a66c656 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:13.863753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 461/911] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:50:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:13.873793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b44b1-daca-4089-99e9-e26cd02b2c4a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:14.039044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:14.049342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b44b1-daca-4089-99e9-e26cd02b2c4a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:14.115540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec6d93-6f0e-4b7c-9fad-138f7ffa8ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:14.116415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec6d93-6f0e-4b7c-9fad-138f7ffa8ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:14.116880 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec6d93-6f0e-4b7c-9fad-138f7ffa8ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:14.117342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec6d93-6f0e-4b7c-9fad-138f7ffa8ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:14.118663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec6d93-6f0e-4b7c-9fad-138f7ffa8ba4 None admin] RBAC: Adding query filter params (role.id=63241abe50fa4120be0a77336cc5e7e0, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=68876ef8dc62494996c1497819e980d1) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:14.119202 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec6d93-6f0e-4b7c-9fad-138f7ffa8ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:14.121995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec6d93-6f0e-4b7c-9fad-138f7ffa8ba4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:14.137799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 451/912] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:50:13 2022] GET /identity/v3/role_assignments?user.id=68876ef8dc62494996c1497819e980d1&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=63241abe50fa4120be0a77336cc5e7e0 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:14.313574 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e03b9-6fa3-4b5d-9123-c88497f57add None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:14.313942 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e03b9-6fa3-4b5d-9123-c88497f57add None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:14.314126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e03b9-6fa3-4b5d-9123-c88497f57add None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:14.316273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 462/913] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:14.322399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01794a61-2f18-4168-a74a-e5bb57ba5a28 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:14.322709 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01794a61-2f18-4168-a74a-e5bb57ba5a28 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:14.322993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01794a61-2f18-4168-a74a-e5bb57ba5a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:14.345378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-01794a61-2f18-4168-a74a-e5bb57ba5a28 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:14.347144 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-01794a61-2f18-4168-a74a-e5bb57ba5a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:14.433267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 452/914] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:14.711215 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e03b9-6fa3-4b5d-9123-c88497f57add None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:14.835819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:14.851957 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e03b9-6fa3-4b5d-9123-c88497f57add None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:14.923619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee133d78-cf75-4b80-a339-cd2a809e6add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:14.925160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee133d78-cf75-4b80-a339-cd2a809e6add None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:14.925867 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee133d78-cf75-4b80-a339-cd2a809e6add None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:14.926582 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee133d78-cf75-4b80-a339-cd2a809e6add None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:14.927904 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee133d78-cf75-4b80-a339-cd2a809e6add None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:14.930709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee133d78-cf75-4b80-a339-cd2a809e6add None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-ee133d78-cf75-4b80-a339-cd2a809e6add None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:14.949151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:14.951422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:14.953318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:14.953318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:14.953318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:14.953318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:14.953318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:14.953318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:14.953318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:14.953318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:14.953318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:14.953318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:14.953318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:14.953318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:14.953318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 15:50:14.953318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:14.957660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 463/915] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:50:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:14.963701 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01794a61-2f18-4168-a74a-e5bb57ba5a28 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:15.135461 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:15.157138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01794a61-2f18-4168-a74a-e5bb57ba5a28 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:15.195623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be87d9-00fe-4a61-ab6d-c5eb5199e317 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:15.196094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be87d9-00fe-4a61-ab6d-c5eb5199e317 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:15.196712 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be87d9-00fe-4a61-ab6d-c5eb5199e317 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:15.200949 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790cecb-3b01-4d83-8fef-adb354b59d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:15.201597 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790cecb-3b01-4d83-8fef-adb354b59d67 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:15.201874 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790cecb-3b01-4d83-8fef-adb354b59d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:15.202146 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790cecb-3b01-4d83-8fef-adb354b59d67 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:15.202851 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790cecb-3b01-4d83-8fef-adb354b59d67 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:15.203153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790cecb-3b01-4d83-8fef-adb354b59d67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:15.204588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790cecb-3b01-4d83-8fef-adb354b59d67 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:15.204769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 464/916] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:15.206866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2ebd2-eff7-4fac-80fc-6587d5dc8317 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:15.207351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2ebd2-eff7-4fac-80fc-6587d5dc8317 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:15.207840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2ebd2-eff7-4fac-80fc-6587d5dc8317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:15.210797 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 453/917] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:50:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:15.216917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790cecb-3b01-4d83-8fef-adb354b59d67 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:15.243458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c0d2ebd2-eff7-4fac-80fc-6587d5dc8317 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:15.246205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c0d2ebd2-eff7-4fac-80fc-6587d5dc8317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:15.376236 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790cecb-3b01-4d83-8fef-adb354b59d67 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:15.385359 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 465/918] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:15.446632 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1909b-95f6-4ff9-b57b-49e6f85f8578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:15.448156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1909b-95f6-4ff9-b57b-49e6f85f8578 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:15.448942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1909b-95f6-4ff9-b57b-49e6f85f8578 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:15.449681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1909b-95f6-4ff9-b57b-49e6f85f8578 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:15.451147 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1909b-95f6-4ff9-b57b-49e6f85f8578 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:15.452057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1909b-95f6-4ff9-b57b-49e6f85f8578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:15.455158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1909b-95f6-4ff9-b57b-49e6f85f8578 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:15.468393 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 454/919] 10.222.0.77 () {56 vars in 1114 bytes} [Mon Aug 22 15:50:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:15.482714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2ebd2-eff7-4fac-80fc-6587d5dc8317 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:15.697009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:15.729232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2ebd2-eff7-4fac-80fc-6587d5dc8317 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:15.768664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1909b-95f6-4ff9-b57b-49e6f85f8578 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:15.822625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96cdbe-fdd1-4f0d-b6e4-546804ddff1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:15.824193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96cdbe-fdd1-4f0d-b6e4-546804ddff1a None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:15.825049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96cdbe-fdd1-4f0d-b6e4-546804ddff1a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:15.825764 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96cdbe-fdd1-4f0d-b6e4-546804ddff1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:15.827415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96cdbe-fdd1-4f0d-b6e4-546804ddff1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:15.830506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96cdbe-fdd1-4f0d-b6e4-546804ddff1a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:15.840704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:15.887508 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 466/920] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 15:50:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:50:16.038758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1909b-95f6-4ff9-b57b-49e6f85f8578 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:16.112469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f4290-06d9-45a7-a163-523b9f2b4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:16.113142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4290-06d9-45a7-a163-523b9f2b4b05 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:16.118639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4290-06d9-45a7-a163-523b9f2b4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:16.118639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4290-06d9-45a7-a163-523b9f2b4b05 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:16.118639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f4290-06d9-45a7-a163-523b9f2b4b05 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:16.118639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f4290-06d9-45a7-a163-523b9f2b4b05 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-e29f4290-06d9-45a7-a163-523b9f2b4b05 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:16.127019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:16.128869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:16.130655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 455/921] 10.222.0.77 () {56 vars in 1132 bytes} [Mon Aug 22 15:50:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:16.136368 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96cdbe-fdd1-4f0d-b6e4-546804ddff1a None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:16.200846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff949318-d874-428a-bde7-378905e6f41d None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:16.201160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff949318-d874-428a-bde7-378905e6f41d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:16.201487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff949318-d874-428a-bde7-378905e6f41d None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:16.203197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 456/922] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:16.209049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1ebf8-abe3-4fe5-94e1-4b7bf9d09598 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:16.209330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1ebf8-abe3-4fe5-94e1-4b7bf9d09598 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:16.209712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1ebf8-abe3-4fe5-94e1-4b7bf9d09598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:16.229653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a3c1ebf8-abe3-4fe5-94e1-4b7bf9d09598 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:16.231008 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a3c1ebf8-abe3-4fe5-94e1-4b7bf9d09598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:16.316241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96cdbe-fdd1-4f0d-b6e4-546804ddff1a None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:16.358042 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd82e57-bfb7-4aef-a99e-097e008a621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:16.358712 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd82e57-bfb7-4aef-a99e-097e008a621f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:16.359062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd82e57-bfb7-4aef-a99e-097e008a621f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:16.359338 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd82e57-bfb7-4aef-a99e-097e008a621f None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:16.360009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd82e57-bfb7-4aef-a99e-097e008a621f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:16.360299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd82e57-bfb7-4aef-a99e-097e008a621f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:16.361872 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd82e57-bfb7-4aef-a99e-097e008a621f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:16.374628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 467/923] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 22 15:50:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:16.374835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 457/924] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:50:16.380520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd82e57-bfb7-4aef-a99e-097e008a621f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:16.439520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:16.482337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7d730-d7fd-454b-8a46-83943565ffb1 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:16.482715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7d730-d7fd-454b-8a46-83943565ffb1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:16.482902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7d730-d7fd-454b-8a46-83943565ffb1 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:16.484996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 458/925] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:16.492248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf3fb8-81a2-4790-8323-ed9e87a03e30 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:16.492677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf3fb8-81a2-4790-8323-ed9e87a03e30 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:16.493054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf3fb8-81a2-4790-8323-ed9e87a03e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:16.518085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-dcaf3fb8-81a2-4790-8323-ed9e87a03e30 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:16.519360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-dcaf3fb8-81a2-4790-8323-ed9e87a03e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:16.522724 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:16.530388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd82e57-bfb7-4aef-a99e-097e008a621f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:16.571971 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fdd90-ca3e-4243-9fff-56c82ae3e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:16.572680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fdd90-ca3e-4243-9fff-56c82ae3e725 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:16.573043 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fdd90-ca3e-4243-9fff-56c82ae3e725 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:16.573409 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fdd90-ca3e-4243-9fff-56c82ae3e725 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:16.574148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fdd90-ca3e-4243-9fff-56c82ae3e725 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:16.574541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fdd90-ca3e-4243-9fff-56c82ae3e725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:16.576092 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fdd90-ca3e-4243-9fff-56c82ae3e725 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:16.582679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 468/926] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 22 15:50:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:16.591889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fdd90-ca3e-4243-9fff-56c82ae3e725 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:16.614229 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 459/927] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:16.690798 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:16.725089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fdd90-ca3e-4243-9fff-56c82ae3e725 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:16.763379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c74cb1-2044-484a-a714-a5f1188d0f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:16.764172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c74cb1-2044-484a-a714-a5f1188d0f4a None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:16.764327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c74cb1-2044-484a-a714-a5f1188d0f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:16.764597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c74cb1-2044-484a-a714-a5f1188d0f4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:16.765299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c74cb1-2044-484a-a714-a5f1188d0f4a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:16.766777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c74cb1-2044-484a-a714-a5f1188d0f4a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:16.792648 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 469/928] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 15:50:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:50:16.819593 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf3fb8-81a2-4790-8323-ed9e87a03e30 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:16.924203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c74cb1-2044-484a-a714-a5f1188d0f4a None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:16.951274 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf3fb8-81a2-4790-8323-ed9e87a03e30 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:17.002352 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7e984-2594-4cda-9984-6b41aaaf5187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:17.003084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7e984-2594-4cda-9984-6b41aaaf5187 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:17.003365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7e984-2594-4cda-9984-6b41aaaf5187 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:17.003641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7e984-2594-4cda-9984-6b41aaaf5187 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:17.004259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7e984-2594-4cda-9984-6b41aaaf5187 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:17.005819 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7e984-2594-4cda-9984-6b41aaaf5187 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:17.009159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ecb7e984-2594-4cda-9984-6b41aaaf5187 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:17.017233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:17.018675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:17.019606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:17.019606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:17.019606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:17.019606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:17.019606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:17.019606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:17.019606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:17.019606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:17.019606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:17.019606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:17.019606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:17.019606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:17.019606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:17.019606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:17.022770 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 460/929] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 22 15:50:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:17.029071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7e984-2594-4cda-9984-6b41aaaf5187 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:17.084854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c74cb1-2044-484a-a714-a5f1188d0f4a None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:17.121039 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:17.126160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527626b-fb69-4f5b-95de-6e501fca7198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:17.127283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527626b-fb69-4f5b-95de-6e501fca7198 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:17.127767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527626b-fb69-4f5b-95de-6e501fca7198 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:17.128228 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527626b-fb69-4f5b-95de-6e501fca7198 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:17.153786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527626b-fb69-4f5b-95de-6e501fca7198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-0527626b-fb69-4f5b-95de-6e501fca7198 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:50:17.165183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:17.166218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:17.167142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:17.167142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:17.167142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:17.167142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:17.167142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:50:17.167142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:50:17.167142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:50:17.167142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:50:17.167142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:50:17.167142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:50:17.167142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:50:17.167142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:17.170268 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 470/930] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Aug 22 15:50:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:17.176385 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527626b-fb69-4f5b-95de-6e501fca7198 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:17.191901 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7e984-2594-4cda-9984-6b41aaaf5187 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:17.264050 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca0d5a-1f41-4695-9c3b-30e8a7bdb307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:17.265132 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca0d5a-1f41-4695-9c3b-30e8a7bdb307 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:17.265626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca0d5a-1f41-4695-9c3b-30e8a7bdb307 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:17.266111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca0d5a-1f41-4695-9c3b-30e8a7bdb307 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:17.267529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca0d5a-1f41-4695-9c3b-30e8a7bdb307 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:17.268502 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca0d5a-1f41-4695-9c3b-30e8a7bdb307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:17.271259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca0d5a-1f41-4695-9c3b-30e8a7bdb307 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:17.281814 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 461/931] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 22 15:50:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:17.291366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca0d5a-1f41-4695-9c3b-30e8a7bdb307 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:17.322628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527626b-fb69-4f5b-95de-6e501fca7198 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:17.369447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe1ed8-0da0-4d38-bf84-b47b56636ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:17.370377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe1ed8-0da0-4d38-bf84-b47b56636ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:17.370834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe1ed8-0da0-4d38-bf84-b47b56636ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:17.371253 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe1ed8-0da0-4d38-bf84-b47b56636ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:17.372110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe1ed8-0da0-4d38-bf84-b47b56636ae5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:17.372591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe1ed8-0da0-4d38-bf84-b47b56636ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:17.374164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe1ed8-0da0-4d38-bf84-b47b56636ae5 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:17.395551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 471/932] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Aug 22 15:50:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:17.398028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe1ed8-0da0-4d38-bf84-b47b56636ae5 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:17.431891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:17.472735 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:17.513829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca0d5a-1f41-4695-9c3b-30e8a7bdb307 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:17.542041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe1ed8-0da0-4d38-bf84-b47b56636ae5 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:17.584623 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c1755-c951-4934-9c98-91ebd2485c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:17.586010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c1755-c951-4934-9c98-91ebd2485c9f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:17.586496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c1755-c951-4934-9c98-91ebd2485c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:17.587058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c1755-c951-4934-9c98-91ebd2485c9f None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:17.588425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c1755-c951-4934-9c98-91ebd2485c9f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:17.588976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c1755-c951-4934-9c98-91ebd2485c9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:17.589336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310f49c-3f09-4500-bae2-d3029601dc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:17.590223 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310f49c-3f09-4500-bae2-d3029601dc28 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:17.590776 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310f49c-3f09-4500-bae2-d3029601dc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:17.591253 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310f49c-3f09-4500-bae2-d3029601dc28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:17.591672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c1755-c951-4934-9c98-91ebd2485c9f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:17.602381 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 462/933] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 22 15:50:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:17.607131 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310f49c-3f09-4500-bae2-d3029601dc28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:17.608638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c1755-c951-4934-9c98-91ebd2485c9f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:17.609089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310f49c-3f09-4500-bae2-d3029601dc28 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-4310f49c-3f09-4500-bae2-d3029601dc28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:17.629148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:17.630351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:17.631304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:17.631304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:17.631304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:17.640188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 472/934] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:17.641742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310f49c-3f09-4500-bae2-d3029601dc28 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:17.807157 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310f49c-3f09-4500-bae2-d3029601dc28 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:17.810146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:17.832569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c1755-c951-4934-9c98-91ebd2485c9f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:17.872530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff355660-5306-49f0-b8fb-390cbab22929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:17.873571 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff355660-5306-49f0-b8fb-390cbab22929 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:17.874053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff355660-5306-49f0-b8fb-390cbab22929 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:17.874161 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:17.874711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff355660-5306-49f0-b8fb-390cbab22929 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:17.875608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff355660-5306-49f0-b8fb-390cbab22929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:17.876204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff355660-5306-49f0-b8fb-390cbab22929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:17.877907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff355660-5306-49f0-b8fb-390cbab22929 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:17.894649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dabe4e-b8f4-42b0-9322-0522a9b7db0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:17.896190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dabe4e-b8f4-42b0-9322-0522a9b7db0c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:17.896891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dabe4e-b8f4-42b0-9322-0522a9b7db0c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:17.897586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dabe4e-b8f4-42b0-9322-0522a9b7db0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:17.899320 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dabe4e-b8f4-42b0-9322-0522a9b7db0c None admin] RBAC: Adding query filter params (interface=public, service_id=700e1494890444aa807d2f3ca15d731d, region_id=RegionOne) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:17.900318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dabe4e-b8f4-42b0-9322-0522a9b7db0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:17.901136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 473/935] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:17.902265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff355660-5306-49f0-b8fb-390cbab22929 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:17.903971 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dabe4e-b8f4-42b0-9322-0522a9b7db0c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:17.919717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 463/936] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 22 15:50:17 2022] GET /identity/v3/endpoints?service_id=700e1494890444aa807d2f3ca15d731d&interface=public®ion_id=RegionOne => generated 194 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:17.924607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dabe4e-b8f4-42b0-9322-0522a9b7db0c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:18.032748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff355660-5306-49f0-b8fb-390cbab22929 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:18.081130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c9ad1-1083-4d5b-ab10-b9f3f06c40e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:18.081680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c9ad1-1083-4d5b-ab10-b9f3f06c40e4 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:18.082038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c9ad1-1083-4d5b-ab10-b9f3f06c40e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:18.082298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c9ad1-1083-4d5b-ab10-b9f3f06c40e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:18.091937 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c9ad1-1083-4d5b-ab10-b9f3f06c40e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:18.093445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c9ad1-1083-4d5b-ab10-b9f3f06c40e4 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-058c9ad1-1083-4d5b-ab10-b9f3f06c40e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:50:18.107412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:18.109257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:18.111477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:18.111477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:18.111477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:50:18.111477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:50:18.111477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:50:18.111477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:50:18.111477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:50:18.111477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:50:18.111477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:50:18.111477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:18.114432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 474/937] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 22 15:50:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:18.115908 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdc9fa-47b8-4808-a1d0-226a9729f74f None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:18.116188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdc9fa-47b8-4808-a1d0-226a9729f74f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:18.116471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdc9fa-47b8-4808-a1d0-226a9729f74f None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:18.122652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 475/938] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:18.122652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdc9fa-47b8-4808-a1d0-226a9729f74f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:18.122957 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dabe4e-b8f4-42b0-9322-0522a9b7db0c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:18.154436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:18.201038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a483426-d7b1-41fe-8a66-34627e582c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:18.202111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a483426-d7b1-41fe-8a66-34627e582c27 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:18.202718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a483426-d7b1-41fe-8a66-34627e582c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:18.203149 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a483426-d7b1-41fe-8a66-34627e582c27 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:18.204325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a483426-d7b1-41fe-8a66-34627e582c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:18.207919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a483426-d7b1-41fe-8a66-34627e582c27 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:18.228995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 464/939] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 22 15:50:17 2022] GET /identity/v3/services => generated 1497 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:50:18.228995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46043beb-bc75-4cbb-9049-c958417e3da2 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:18.228995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46043beb-bc75-4cbb-9049-c958417e3da2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:18.228995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46043beb-bc75-4cbb-9049-c958417e3da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:18.261685 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-46043beb-bc75-4cbb-9049-c958417e3da2 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:18.263966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-46043beb-bc75-4cbb-9049-c958417e3da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:18.340953 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdc9fa-47b8-4808-a1d0-226a9729f74f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:18.370952 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:18.406923 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 465/940] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:18.418123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75126e-0760-4747-aa35-5d2588199108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:18.419294 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75126e-0760-4747-aa35-5d2588199108 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:18.419855 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75126e-0760-4747-aa35-5d2588199108 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:18.420345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75126e-0760-4747-aa35-5d2588199108 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:18.421813 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75126e-0760-4747-aa35-5d2588199108 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:18.422349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75126e-0760-4747-aa35-5d2588199108 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:18.425097 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75126e-0760-4747-aa35-5d2588199108 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:18.463280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 476/941] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Aug 22 15:50:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:18.470136 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46043beb-bc75-4cbb-9049-c958417e3da2 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:18.652409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46043beb-bc75-4cbb-9049-c958417e3da2 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:18.721324 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749b7fe-5d9c-42c5-94f0-4f28de750544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:18.722426 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749b7fe-5d9c-42c5-94f0-4f28de750544 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:18.722951 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749b7fe-5d9c-42c5-94f0-4f28de750544 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:18.723411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749b7fe-5d9c-42c5-94f0-4f28de750544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:18.744601 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749b7fe-5d9c-42c5-94f0-4f28de750544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:18.750753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749b7fe-5d9c-42c5-94f0-4f28de750544 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c749b7fe-5d9c-42c5-94f0-4f28de750544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:18.781588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:18.783470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:18.785151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:18.785151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:18.785151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:18.785151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 466/942] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:18.787987 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75126e-0760-4747-aa35-5d2588199108 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:18.880623 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749b7fe-5d9c-42c5-94f0-4f28de750544 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:18.895254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:18.920688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75126e-0760-4747-aa35-5d2588199108 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:18.963455 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:18.975344 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83b869-1cce-4e76-8faa-f3fdf88e7910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:18.976366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83b869-1cce-4e76-8faa-f3fdf88e7910 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:18.976793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83b869-1cce-4e76-8faa-f3fdf88e7910 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:18.977226 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83b869-1cce-4e76-8faa-f3fdf88e7910 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:18.978121 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83b869-1cce-4e76-8faa-f3fdf88e7910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:18.978958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83b869-1cce-4e76-8faa-f3fdf88e7910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:18.981241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83b869-1cce-4e76-8faa-f3fdf88e7910 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:18.997248 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 477/943] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:19.008529 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83b869-1cce-4e76-8faa-f3fdf88e7910 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:19.080853 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749b7fe-5d9c-42c5-94f0-4f28de750544 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:19.134770 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617581b-05bf-4b22-95cc-26df50c499a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:19.135834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617581b-05bf-4b22-95cc-26df50c499a0 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:19.136327 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617581b-05bf-4b22-95cc-26df50c499a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:19.136813 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617581b-05bf-4b22-95cc-26df50c499a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:19.138227 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617581b-05bf-4b22-95cc-26df50c499a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:19.141266 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617581b-05bf-4b22-95cc-26df50c499a0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:19.146657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: WARNING keystone.server.flask.common [None req-8617581b-05bf-4b22-95cc-26df50c499a0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 15:50:19.181999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.sql.core [None req-8617581b-05bf-4b22-95cc-26df50c499a0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 15:50:19.181999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 15:50:19.181999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [parameters: {'id': 'c35cf87378af462781c41ecfbab96225', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 15:50:19.181999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81661) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 15:50:19.203137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83b869-1cce-4e76-8faa-f3fdf88e7910 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:19.218588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-8617581b-05bf-4b22-95cc-26df50c499a0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c35cf87378af462781c41ecfbab96225.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c35cf87378af462781c41ecfbab96225. Aug 22 15:50:19.218588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:19.218588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 15:50:19.218588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 15:50:19.218588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 15:50:19.218588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 15:50:19.218588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 15:50:19.218588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 15:50:19.218588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 15:50:19.218588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application conn.query(q) Aug 22 15:50:19.218588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 15:50:19.218588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 15:50:19.218588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result.read() Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 22 15:50:19.219868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application next(self.gen) Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application yield resource Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application next(self.gen) Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise self.value Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application session.commit() Aug 22 15:50:19.220800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.session.flush() Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application compat.raise_( Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 15:50:19.221696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 15:50:19.222659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application conn.query(q) Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result.read() Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 15:50:19.223452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [parameters: {'id': 'c35cf87378af462781c41ecfbab96225', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:19.224344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:19.225130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:19.226052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:19.226052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 22 15:50:19.226052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 22 15:50:19.226052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:19.226052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:19.226052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 22 15:50:19.226052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 22 15:50:19.226052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c35cf87378af462781c41ecfbab96225. Aug 22 15:50:19.226052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:19.226052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 467/944] 10.222.0.77 () {60 vars in 1140 bytes} [Mon Aug 22 15:50:18 2022] POST /identity/v3/projects => generated 262 bytes in 342 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:19.226052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e91dad-e356-4c92-b098-7c3026e9a320 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:19.226052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e91dad-e356-4c92-b098-7c3026e9a320 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:19.228827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e91dad-e356-4c92-b098-7c3026e9a320 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:19.238668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 468/945] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:19 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:19.238668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e91dad-e356-4c92-b098-7c3026e9a320 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:19.285975 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbbd8f-a438-47da-85a6-00eefe5d210b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:19.287325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbbd8f-a438-47da-85a6-00eefe5d210b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:19.287914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbbd8f-a438-47da-85a6-00eefe5d210b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:19.288450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbbd8f-a438-47da-85a6-00eefe5d210b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:19.302338 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbbd8f-a438-47da-85a6-00eefe5d210b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:19.305156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbbd8f-a438-47da-85a6-00eefe5d210b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:19.310670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-7acbbd8f-a438-47da-85a6-00eefe5d210b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:50:19.332246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:19.333158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:19.334046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:50:19.334046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:50:19.334046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:50:19.334046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:50:19.334046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:50:19.334046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:50:19.334046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:19.334046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:19.334478 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 478/946] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:19.336662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44236786-dc77-4077-81eb-839e2bd32b5c None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:19.337204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44236786-dc77-4077-81eb-839e2bd32b5c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:19.337690 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44236786-dc77-4077-81eb-839e2bd32b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:19.370033 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-44236786-dc77-4077-81eb-839e2bd32b5c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:19.372145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-44236786-dc77-4077-81eb-839e2bd32b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:19.392956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:19.408284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e91dad-e356-4c92-b098-7c3026e9a320 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:19.456043 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365756bb-bf53-4caa-a724-60911ededc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:19.456590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365756bb-bf53-4caa-a724-60911ededc4b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:19.456883 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365756bb-bf53-4caa-a724-60911ededc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:19.457181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365756bb-bf53-4caa-a724-60911ededc4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:19.467656 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365756bb-bf53-4caa-a724-60911ededc4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:19.469314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365756bb-bf53-4caa-a724-60911ededc4b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-365756bb-bf53-4caa-a724-60911ededc4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:50:19.482859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:19.483834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:19.490884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:50:19.490884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:50:19.490884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:50:19.490884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:50:19.490884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:50:19.490884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:50:19.490884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:19.490884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:19.490884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 469/947] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:19.490884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365756bb-bf53-4caa-a724-60911ededc4b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:19.510657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 479/948] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:19.510657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44236786-dc77-4077-81eb-839e2bd32b5c None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:19.649084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365756bb-bf53-4caa-a724-60911ededc4b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:19.661869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44236786-dc77-4077-81eb-839e2bd32b5c None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:19.698900 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d646822-9acf-4b2e-ad29-c8867ad42be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:19.699654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646822-9acf-4b2e-ad29-c8867ad42be3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:19.699995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646822-9acf-4b2e-ad29-c8867ad42be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:19.700326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646822-9acf-4b2e-ad29-c8867ad42be3 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:19.701119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d646822-9acf-4b2e-ad29-c8867ad42be3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:19.701490 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d646822-9acf-4b2e-ad29-c8867ad42be3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:19.703106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d646822-9acf-4b2e-ad29-c8867ad42be3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:19.715122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:19.718122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 470/949] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:50:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:19.725151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d646822-9acf-4b2e-ad29-c8867ad42be3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:19.735608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8b771-cb47-452d-90d6-16b8baeeb5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:19.736625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8b771-cb47-452d-90d6-16b8baeeb5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:19.737093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8b771-cb47-452d-90d6-16b8baeeb5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:19.737549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8b771-cb47-452d-90d6-16b8baeeb5e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:19.738386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8b771-cb47-452d-90d6-16b8baeeb5e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:19.738798 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8b771-cb47-452d-90d6-16b8baeeb5e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:19.740538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8b771-cb47-452d-90d6-16b8baeeb5e3 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:19.756969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:19.781169 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 480/950] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 22 15:50:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:19.946838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d646822-9acf-4b2e-ad29-c8867ad42be3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:19.997734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8b771-cb47-452d-90d6-16b8baeeb5e3 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:20.025785 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514774f-d5c0-4b5e-84f1-29cd12a028b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:20.027544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514774f-d5c0-4b5e-84f1-29cd12a028b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:20.027544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514774f-d5c0-4b5e-84f1-29cd12a028b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:20.027813 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514774f-d5c0-4b5e-84f1-29cd12a028b4 None admin] PATH_INFO: `/v3/projects/318c7f21f9d14e149f668863f748e89f/users/68876ef8dc62494996c1497819e980d1/roles/63241abe50fa4120be0a77336cc5e7e0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:20.032635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514774f-d5c0-4b5e-84f1-29cd12a028b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=318c7f21f9d14e149f668863f748e89f, user_id=68876ef8dc62494996c1497819e980d1, role_id=63241abe50fa4120be0a77336cc5e7e0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:20.035848 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514774f-d5c0-4b5e-84f1-29cd12a028b4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:20.074652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 471/951] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:50:19 2022] PUT /identity/v3/projects/318c7f21f9d14e149f668863f748e89f/users/68876ef8dc62494996c1497819e980d1/roles/63241abe50fa4120be0a77336cc5e7e0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:50:20.189187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8b771-cb47-452d-90d6-16b8baeeb5e3 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:20.262304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca40fbb-9892-485c-8055-ad3ad3574fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:20.262997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca40fbb-9892-485c-8055-ad3ad3574fdf None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:20.263360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca40fbb-9892-485c-8055-ad3ad3574fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:20.263639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca40fbb-9892-485c-8055-ad3ad3574fdf None admin] PATH_INFO: `/v3/services/compute` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:20.264349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca40fbb-9892-485c-8055-ad3ad3574fdf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:20.267046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca40fbb-9892-485c-8055-ad3ad3574fdf None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-3ca40fbb-9892-485c-8055-ad3ad3574fdf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:20.283665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:20.284732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:20.285742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:20.285742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:20.285742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:20.285742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:20.285742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:20.285742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:20.285742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:20.285742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:20.285742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:20.285742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:20.285742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:20.285742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:20.285742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:50:20.285742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:20.286581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 481/952] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:20.302225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514774f-d5c0-4b5e-84f1-29cd12a028b4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:20.439039 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7c7df-a42b-4f22-bf0a-3b6b80e56b5a None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:20.439804 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7c7df-a42b-4f22-bf0a-3b6b80e56b5a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:20.440209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7c7df-a42b-4f22-bf0a-3b6b80e56b5a None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:20.440419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:20.442493 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 482/953] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:20.451492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f45f2-76cf-4c3f-95d0-3135462d8438 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:20.452370 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f45f2-76cf-4c3f-95d0-3135462d8438 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:20.452844 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f45f2-76cf-4c3f-95d0-3135462d8438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:20.492333 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-9d3f45f2-76cf-4c3f-95d0-3135462d8438 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:20.492673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514774f-d5c0-4b5e-84f1-29cd12a028b4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:20.493642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9d3f45f2-76cf-4c3f-95d0-3135462d8438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:20.552759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:20.567098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd51aca-ee86-4200-af1d-08f8fd6a710c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:20.568682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd51aca-ee86-4200-af1d-08f8fd6a710c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:20.569481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd51aca-ee86-4200-af1d-08f8fd6a710c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:20.570155 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd51aca-ee86-4200-af1d-08f8fd6a710c None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:20.571712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd51aca-ee86-4200-af1d-08f8fd6a710c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:20.572245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd51aca-ee86-4200-af1d-08f8fd6a710c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:20.574634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 483/954] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:50:20.574892 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd51aca-ee86-4200-af1d-08f8fd6a710c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:20.592103 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 472/955] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 22 15:50:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:20.592341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f45f2-76cf-4c3f-95d0-3135462d8438 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:20.711280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f45f2-76cf-4c3f-95d0-3135462d8438 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:20.762230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dc742-eb78-4ce5-8541-f80824833599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:20.763336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dc742-eb78-4ce5-8541-f80824833599 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:20.763831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dc742-eb78-4ce5-8541-f80824833599 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:20.764419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dc742-eb78-4ce5-8541-f80824833599 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:20.765325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dc742-eb78-4ce5-8541-f80824833599 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:20.765837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dc742-eb78-4ce5-8541-f80824833599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:20.767544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dc742-eb78-4ce5-8541-f80824833599 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:20.775175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 484/956] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 22 15:50:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:20.867878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd51aca-ee86-4200-af1d-08f8fd6a710c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:21.002233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd51aca-ee86-4200-af1d-08f8fd6a710c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:21.045057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0096a4-d1ca-4ffa-8e43-d36f579903f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:21.046083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0096a4-d1ca-4ffa-8e43-d36f579903f3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:21.046586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0096a4-d1ca-4ffa-8e43-d36f579903f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:21.047104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0096a4-d1ca-4ffa-8e43-d36f579903f3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:21.047958 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0096a4-d1ca-4ffa-8e43-d36f579903f3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:21.049574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0096a4-d1ca-4ffa-8e43-d36f579903f3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-bb0096a4-d1ca-4ffa-8e43-d36f579903f3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:21.060160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:21.061325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:21.062209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:21.062209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:21.062209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:21.062209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:21.062209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:21.062209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:21.062209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:21.062209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:21.062209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:21.062209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:21.062209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:21.062209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:21.062209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:21.062209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:21.065540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 473/957] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 22 15:50:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:21.072618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dc742-eb78-4ce5-8541-f80824833599 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:21.138666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:21.206478 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dc742-eb78-4ce5-8541-f80824833599 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:21.251984 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a454a-a178-4a39-8d94-d35d72caf037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:21.253258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a454a-a178-4a39-8d94-d35d72caf037 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:21.254080 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a454a-a178-4a39-8d94-d35d72caf037 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:21.254862 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a454a-a178-4a39-8d94-d35d72caf037 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:21.255774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a454a-a178-4a39-8d94-d35d72caf037 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:21.256428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a454a-a178-4a39-8d94-d35d72caf037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:21.258143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a454a-a178-4a39-8d94-d35d72caf037 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:21.264785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 485/958] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 22 15:50:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:21.271310 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0096a4-d1ca-4ffa-8e43-d36f579903f3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:21.274757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:21.421558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0096a4-d1ca-4ffa-8e43-d36f579903f3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:21.466225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd97c2-0965-4d68-971a-89714ca03e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:21.466898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd97c2-0965-4d68-971a-89714ca03e97 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:21.467170 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd97c2-0965-4d68-971a-89714ca03e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:21.467437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd97c2-0965-4d68-971a-89714ca03e97 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:21.468111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd97c2-0965-4d68-971a-89714ca03e97 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:21.468410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd97c2-0965-4d68-971a-89714ca03e97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:21.469849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd97c2-0965-4d68-971a-89714ca03e97 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:21.476360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 474/959] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 22 15:50:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:21.482969 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a454a-a178-4a39-8d94-d35d72caf037 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:21.605757 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a454a-a178-4a39-8d94-d35d72caf037 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:21.622297 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:21.647809 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e74b26-68ba-467d-a6b0-784153dabbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:21.648439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74b26-68ba-467d-a6b0-784153dabbce None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:21.648717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74b26-68ba-467d-a6b0-784153dabbce None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:21.648987 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e74b26-68ba-467d-a6b0-784153dabbce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:21.649721 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e74b26-68ba-467d-a6b0-784153dabbce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:21.651190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e74b26-68ba-467d-a6b0-784153dabbce None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:21.676446 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 486/960] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 15:50:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:50:22.527582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20615538-70e6-46e1-aca2-fc249209a31e None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:22.528476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20615538-70e6-46e1-aca2-fc249209a31e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:22.528476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20615538-70e6-46e1-aca2-fc249209a31e None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:22.529919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 475/961] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:22.536159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2f9b6-a29c-4971-960c-f44a3f9b425f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:22.537129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2f9b6-a29c-4971-960c-f44a3f9b425f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:22.537129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2f9b6-a29c-4971-960c-f44a3f9b425f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:22.556469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-31a2f9b6-a29c-4971-960c-f44a3f9b425f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:22.557705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-31a2f9b6-a29c-4971-960c-f44a3f9b425f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:22.646874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 487/962] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:22.919211 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20615538-70e6-46e1-aca2-fc249209a31e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:23.012076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:23.049114 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f864415-4882-4479-8678-8e7865e4d2b6 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:23.049557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f864415-4882-4479-8678-8e7865e4d2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:23.049787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f864415-4882-4479-8678-8e7865e4d2b6 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:23.051479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 488/963] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:23.057478 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a1b6-83f3-41f2-9c82-7a5885d29031 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:23.057877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20615538-70e6-46e1-aca2-fc249209a31e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:23.058168 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a1b6-83f3-41f2-9c82-7a5885d29031 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:23.058168 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447a1b6-83f3-41f2-9c82-7a5885d29031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:23.078976 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c447a1b6-83f3-41f2-9c82-7a5885d29031 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:23.080353 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c447a1b6-83f3-41f2-9c82-7a5885d29031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:23.102121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7eb9e-6776-4bc3-8573-e4f163f25fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:23.102955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7eb9e-6776-4bc3-8573-e4f163f25fef None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:23.103214 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7eb9e-6776-4bc3-8573-e4f163f25fef None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:23.103467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7eb9e-6776-4bc3-8573-e4f163f25fef None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:23.104288 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7eb9e-6776-4bc3-8573-e4f163f25fef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:23.105801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7eb9e-6776-4bc3-8573-e4f163f25fef None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:23.128549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.sql.core [None req-65e7eb9e-6776-4bc3-8573-e4f163f25fef None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 15:50:23.128549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 15:50:23.128549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [parameters: {'user_id': '0e40265d9f564ce49167ef6cc142ba24', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 15:50:23.128549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81661) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-65e7eb9e-6776-4bc3-8573-e4f163f25fef None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application conn.query(q) Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result.read() Aug 22 15:50:23.137458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 15:50:23.140275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application next(self.gen) Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application yield resource Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application next(self.gen) Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise self.value Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application session.commit() Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 15:50:23.142646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.session.flush() Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application compat.raise_( Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 15:50:23.145363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 15:50:23.159831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application conn.query(q) Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result.read() Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 15:50:23.162444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [parameters: {'user_id': '0e40265d9f564ce49167ef6cc142ba24', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:23.164489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 22 15:50:23.166331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 22 15:50:23.168793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 22 15:50:23.168793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 22 15:50:23.168793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 15:50:23.168793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 15:50:23.168793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 15:50:23.168793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:23.168793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 476/964] 10.222.0.77 () {60 vars in 1131 bytes} [Mon Aug 22 15:50:22 2022] POST /identity/v3/users => generated 160 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:23.168793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7eb9e-6776-4bc3-8573-e4f163f25fef None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:23.169935 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 489/965] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:50:23.273820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7eb9e-6776-4bc3-8573-e4f163f25fef None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:23.314908 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455f831-5a5d-483d-a30b-6c907e489d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:23.315656 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455f831-5a5d-483d-a30b-6c907e489d11 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:23.316010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455f831-5a5d-483d-a30b-6c907e489d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:23.316287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455f831-5a5d-483d-a30b-6c907e489d11 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:23.319094 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:23.326687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455f831-5a5d-483d-a30b-6c907e489d11 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:23.328120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455f831-5a5d-483d-a30b-6c907e489d11 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-2455f831-5a5d-483d-a30b-6c907e489d11 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:50:23.344532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:23.348006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:23.355749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:23.355749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:23.355749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:50:23.355749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:50:23.355749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:50:23.355749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:50:23.355749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:50:23.355749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:50:23.355749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 15:50:23.355749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:23.355749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 477/966] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:50:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:23.358060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447a1b6-83f3-41f2-9c82-7a5885d29031 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:23.393131 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:23.406636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c761c8-a28a-47d0-9f5c-6e73f7fa560e None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:23.406636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c761c8-a28a-47d0-9f5c-6e73f7fa560e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:23.406636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c761c8-a28a-47d0-9f5c-6e73f7fa560e None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:23.420533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 478/967] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:23 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:23.425613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5732db4-5f15-4cab-b839-ed2365922956 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:23.426723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5732db4-5f15-4cab-b839-ed2365922956 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:23.427540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5732db4-5f15-4cab-b839-ed2365922956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:23.459684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e5732db4-5f15-4cab-b839-ed2365922956 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:23.462364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e5732db4-5f15-4cab-b839-ed2365922956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:23.479189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447a1b6-83f3-41f2-9c82-7a5885d29031 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:23.540389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a27bd3-941f-43d9-8dd7-314968b81e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:23.541500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a27bd3-941f-43d9-8dd7-314968b81e5e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:23.542004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a27bd3-941f-43d9-8dd7-314968b81e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:23.542467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a27bd3-941f-43d9-8dd7-314968b81e5e None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:23.543859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a27bd3-941f-43d9-8dd7-314968b81e5e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:23.544413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a27bd3-941f-43d9-8dd7-314968b81e5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:23.546995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a27bd3-941f-43d9-8dd7-314968b81e5e None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:23.551175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 479/968] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:23.552825 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5732db4-5f15-4cab-b839-ed2365922956 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:23.611797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 490/969] 10.222.0.77 () {56 vars in 1101 bytes} [Mon Aug 22 15:50:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:23.748617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5732db4-5f15-4cab-b839-ed2365922956 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:23.790997 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:23.817247 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e177f40-5b18-445d-aff2-6b8838855639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:23.818552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e177f40-5b18-445d-aff2-6b8838855639 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:23.819281 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e177f40-5b18-445d-aff2-6b8838855639 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:23.819951 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e177f40-5b18-445d-aff2-6b8838855639 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:23.821263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e177f40-5b18-445d-aff2-6b8838855639 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:23.824137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e177f40-5b18-445d-aff2-6b8838855639 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:23.833583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a27bd3-941f-43d9-8dd7-314968b81e5e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:23.848027 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 480/970] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 22 15:50:23 2022] POST /identity/v3/services => generated 242 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:50:23.956829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc7e9d-66db-48ae-b74b-2314f23e4ee2 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:23.957185 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc7e9d-66db-48ae-b74b-2314f23e4ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:23.957436 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc7e9d-66db-48ae-b74b-2314f23e4ee2 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:23.958982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 481/971] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:23.965230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792414-d7a2-433a-acfe-a0fe60cd243a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:23.965670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792414-d7a2-433a-acfe-a0fe60cd243a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:23.966007 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792414-d7a2-433a-acfe-a0fe60cd243a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:23.981528 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:23.994839 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-86792414-d7a2-433a-acfe-a0fe60cd243a None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:23.997051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-86792414-d7a2-433a-acfe-a0fe60cd243a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:24.017092 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a27bd3-941f-43d9-8dd7-314968b81e5e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:24.079611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fce77e-64be-4b09-a72a-86c840ba3aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:24.080447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fce77e-64be-4b09-a72a-86c840ba3aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:24.080868 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fce77e-64be-4b09-a72a-86c840ba3aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:24.081281 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fce77e-64be-4b09-a72a-86c840ba3aa4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:24.096547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fce77e-64be-4b09-a72a-86c840ba3aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:50:24.101109 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 482/972] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-10fce77e-64be-4b09-a72a-86c840ba3aa4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:50:24.101452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:24.103484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:24.105266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:24.105266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:24.105266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:24.105266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:24.105266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:50:24.105266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:50:24.105266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:50:24.105266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:50:24.105266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:50:24.105266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:50:24.105266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:50:24.105266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:24.107244 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 491/973] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Aug 22 15:50:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:24.109847 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86792414-d7a2-433a-acfe-a0fe60cd243a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:24.278288 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86792414-d7a2-433a-acfe-a0fe60cd243a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:24.291779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:24.348209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc5688-2894-446f-8d35-eae6c61267c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:24.349259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5688-2894-446f-8d35-eae6c61267c1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:24.349733 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5688-2894-446f-8d35-eae6c61267c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:24.350205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5688-2894-446f-8d35-eae6c61267c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:24.351490 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc5688-2894-446f-8d35-eae6c61267c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:24.352023 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc5688-2894-446f-8d35-eae6c61267c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:24.354793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc5688-2894-446f-8d35-eae6c61267c1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:24.371167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 483/974] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Aug 22 15:50:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:24.379587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fce77e-64be-4b09-a72a-86c840ba3aa4 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:24.530514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fce77e-64be-4b09-a72a-86c840ba3aa4 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:24.548361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc5688-2894-446f-8d35-eae6c61267c1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:24.574235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96b8f2-dd85-4c26-99be-75aac83942ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:24.575014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96b8f2-dd85-4c26-99be-75aac83942ec None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:24.575153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96b8f2-dd85-4c26-99be-75aac83942ec None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:24.575434 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96b8f2-dd85-4c26-99be-75aac83942ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:24.583082 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:24.588769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96b8f2-dd85-4c26-99be-75aac83942ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:24.590266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96b8f2-dd85-4c26-99be-75aac83942ec None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-ff96b8f2-dd85-4c26-99be-75aac83942ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:24.609570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:24.611630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:24.613625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:24.613625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:24.613625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:24.613625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 492/975] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:24.624349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96b8f2-dd85-4c26-99be-75aac83942ec None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:24.734590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc5688-2894-446f-8d35-eae6c61267c1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:24.779743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96b8f2-dd85-4c26-99be-75aac83942ec None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:24.785621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00f619-4406-4d5d-8cb8-281b5e7fa81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:24.786541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00f619-4406-4d5d-8cb8-281b5e7fa81d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:24.787089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00f619-4406-4d5d-8cb8-281b5e7fa81d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:24.787594 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00f619-4406-4d5d-8cb8-281b5e7fa81d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:24.788631 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00f619-4406-4d5d-8cb8-281b5e7fa81d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:24.791191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00f619-4406-4d5d-8cb8-281b5e7fa81d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7d00f619-4406-4d5d-8cb8-281b5e7fa81d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:24.803041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:24.805110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:24.806954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 484/976] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 22 15:50:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:24.810465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00f619-4406-4d5d-8cb8-281b5e7fa81d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:24.827708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e266af-4443-40a4-91e2-93fa6bbab3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:24.828748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e266af-4443-40a4-91e2-93fa6bbab3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:24.828748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e266af-4443-40a4-91e2-93fa6bbab3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:24.829066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e266af-4443-40a4-91e2-93fa6bbab3c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:24.829752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e266af-4443-40a4-91e2-93fa6bbab3c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:24.830072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e266af-4443-40a4-91e2-93fa6bbab3c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:24.831619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e266af-4443-40a4-91e2-93fa6bbab3c7 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:24.846685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 493/977] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:24.852639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:24.852905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e266af-4443-40a4-91e2-93fa6bbab3c7 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:24.918877 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:24.945779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00f619-4406-4d5d-8cb8-281b5e7fa81d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:24.988662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e266af-4443-40a4-91e2-93fa6bbab3c7 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:25.013090 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471881e-9bbf-47d7-9075-21bd018b15e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:25.015305 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471881e-9bbf-47d7-9075-21bd018b15e4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:25.015907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471881e-9bbf-47d7-9075-21bd018b15e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:25.016523 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471881e-9bbf-47d7-9075-21bd018b15e4 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:25.017842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471881e-9bbf-47d7-9075-21bd018b15e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:25.018392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471881e-9bbf-47d7-9075-21bd018b15e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:25.020965 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471881e-9bbf-47d7-9075-21bd018b15e4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:25.035482 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 485/978] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 22 15:50:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:25.035770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94bb88-11ec-4dff-a8ca-8190c65b433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:25.035770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94bb88-11ec-4dff-a8ca-8190c65b433f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:25.035770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94bb88-11ec-4dff-a8ca-8190c65b433f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:25.035770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94bb88-11ec-4dff-a8ca-8190c65b433f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:25.037552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471881e-9bbf-47d7-9075-21bd018b15e4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:25.043362 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94bb88-11ec-4dff-a8ca-8190c65b433f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:25.044950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94bb88-11ec-4dff-a8ca-8190c65b433f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-3e94bb88-11ec-4dff-a8ca-8190c65b433f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:50:25.058176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:25.059433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:25.060565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:25.060565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:25.060565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:50:25.060565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:50:25.060565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:50:25.060565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:50:25.060565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:50:25.060565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:50:25.060565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 15:50:25.060565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:25.064162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 494/979] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 22 15:50:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:25.066016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94bb88-11ec-4dff-a8ca-8190c65b433f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:25.184443 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:25.191937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471881e-9bbf-47d7-9075-21bd018b15e4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:25.228690 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94bb88-11ec-4dff-a8ca-8190c65b433f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:25.237087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9755ce-955a-40bc-b9c9-75c121cb2f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:25.237717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9755ce-955a-40bc-b9c9-75c121cb2f7e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:25.237992 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9755ce-955a-40bc-b9c9-75c121cb2f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:25.238263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9755ce-955a-40bc-b9c9-75c121cb2f7e None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:25.238962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9755ce-955a-40bc-b9c9-75c121cb2f7e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:25.239264 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9755ce-955a-40bc-b9c9-75c121cb2f7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:25.240698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9755ce-955a-40bc-b9c9-75c121cb2f7e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:25.245163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:25.254146 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 486/980] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 22 15:50:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:25.255721 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9755ce-955a-40bc-b9c9-75c121cb2f7e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:25.276613 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20dac06-ab48-434a-922c-d243475646b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:25.277514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dac06-ab48-434a-922c-d243475646b7 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:25.277964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dac06-ab48-434a-922c-d243475646b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:25.278517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dac06-ab48-434a-922c-d243475646b7 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:25.279615 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dac06-ab48-434a-922c-d243475646b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:25.280159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dac06-ab48-434a-922c-d243475646b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:25.281981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dac06-ab48-434a-922c-d243475646b7 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:25.312533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 495/981] 10.222.0.77 () {56 vars in 1149 bytes} [Mon Aug 22 15:50:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:25.319110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20dac06-ab48-434a-922c-d243475646b7 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:25.402516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9755ce-955a-40bc-b9c9-75c121cb2f7e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:25.450336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17017c50-8783-43ee-998b-b7521819f154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:25.451087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20dac06-ab48-434a-922c-d243475646b7 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:25.451282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17017c50-8783-43ee-998b-b7521819f154 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:25.451655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17017c50-8783-43ee-998b-b7521819f154 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:25.452049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17017c50-8783-43ee-998b-b7521819f154 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:25.453094 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17017c50-8783-43ee-998b-b7521819f154 None admin] RBAC: Adding query filter params (interface=admin, service_id=700e1494890444aa807d2f3ca15d731d, region_id=RegionOne) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:25.453559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17017c50-8783-43ee-998b-b7521819f154 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:25.455747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17017c50-8783-43ee-998b-b7521819f154 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:25.467385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 487/982] 10.222.0.77 () {56 vars in 1249 bytes} [Mon Aug 22 15:50:25 2022] GET /identity/v3/endpoints?service_id=700e1494890444aa807d2f3ca15d731d&interface=admin®ion_id=RegionOne => generated 193 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:25.468893 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17017c50-8783-43ee-998b-b7521819f154 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:25.511893 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a7363-5eda-41a1-a9da-f3ea40628846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:25.512851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7363-5eda-41a1-a9da-f3ea40628846 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:25.513301 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:25.514322 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7363-5eda-41a1-a9da-f3ea40628846 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:25.514769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7363-5eda-41a1-a9da-f3ea40628846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:25.578780 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:25.647642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17017c50-8783-43ee-998b-b7521819f154 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:25.647933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a7363-5eda-41a1-a9da-f3ea40628846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:25.651314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a7363-5eda-41a1-a9da-f3ea40628846 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:25.697248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8365c0d-03e0-469b-a5e9-c8ed8d696dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:25.698116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8365c0d-03e0-469b-a5e9-c8ed8d696dfa None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:25.698565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8365c0d-03e0-469b-a5e9-c8ed8d696dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:25.699254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8365c0d-03e0-469b-a5e9-c8ed8d696dfa None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:25.700148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8365c0d-03e0-469b-a5e9-c8ed8d696dfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:25.701674 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8365c0d-03e0-469b-a5e9-c8ed8d696dfa None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:25.710695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 488/983] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 22 15:50:25 2022] GET /identity/v3/services => generated 1727 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 15:50:25.828265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 496/984] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:50:25 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 15:50:25.835843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8365c0d-03e0-469b-a5e9-c8ed8d696dfa None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:26.000388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:26.014624 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8365c0d-03e0-469b-a5e9-c8ed8d696dfa None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:26.059301 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bcfa9-70d9-4074-ac02-c1854e44f708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:26.060335 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bcfa9-70d9-4074-ac02-c1854e44f708 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:26.060779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bcfa9-70d9-4074-ac02-c1854e44f708 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:26.061248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bcfa9-70d9-4074-ac02-c1854e44f708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:26.082446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bcfa9-70d9-4074-ac02-c1854e44f708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:26.085235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bcfa9-70d9-4074-ac02-c1854e44f708 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c58bcfa9-70d9-4074-ac02-c1854e44f708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:26.114312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:26.116157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:26.117888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:26.117888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:26.117888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:26.122726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 489/985] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:26.126421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a7363-5eda-41a1-a9da-f3ea40628846 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:26.192780 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab358b-79a1-4062-964c-6936de7c1eb3 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:26.193046 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab358b-79a1-4062-964c-6936de7c1eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:26.193313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab358b-79a1-4062-964c-6936de7c1eb3 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:26.194992 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 490/986] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:26.201196 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7795d-b602-4db4-aaae-aa74123ef2d7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:26.201464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7795d-b602-4db4-aaae-aa74123ef2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:26.201711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7795d-b602-4db4-aaae-aa74123ef2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:26.228587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-cff7795d-b602-4db4-aaae-aa74123ef2d7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:26.230772 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cff7795d-b602-4db4-aaae-aa74123ef2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:26.242448 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:26.290234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a7363-5eda-41a1-a9da-f3ea40628846 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:26.347069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aa9b4-2901-4ce8-aa02-a2587043d4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:26.347888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aa9b4-2901-4ce8-aa02-a2587043d4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:26.348202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aa9b4-2901-4ce8-aa02-a2587043d4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:26.348463 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aa9b4-2901-4ce8-aa02-a2587043d4d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:26.349416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851aa9b4-2901-4ce8-aa02-a2587043d4d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:26.349916 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851aa9b4-2901-4ce8-aa02-a2587043d4d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:26.351545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851aa9b4-2901-4ce8-aa02-a2587043d4d3 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:26.356279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 491/987] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:50:26.372613 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 497/988] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:26.382325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7795d-b602-4db4-aaae-aa74123ef2d7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:26.520438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:26.579880 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7795d-b602-4db4-aaae-aa74123ef2d7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:26.646777 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3b00a-521c-4f4e-8b72-4842f8293fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:26.647485 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3b00a-521c-4f4e-8b72-4842f8293fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:26.647652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aa9b4-2901-4ce8-aa02-a2587043d4d3 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:26.648304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3b00a-521c-4f4e-8b72-4842f8293fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:26.648455 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3b00a-521c-4f4e-8b72-4842f8293fe3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:26.662124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3b00a-521c-4f4e-8b72-4842f8293fe3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:26.664819 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3b00a-521c-4f4e-8b72-4842f8293fe3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-32c3b00a-521c-4f4e-8b72-4842f8293fe3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:50:26.686349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:26.688378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:26.690493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:50:26.690493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:50:26.690493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:50:26.690493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:50:26.690493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:50:26.690493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:50:26.690493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:26.690493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:26.690493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 492/989] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:26.695120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3b00a-521c-4f4e-8b72-4842f8293fe3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:26.826160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aa9b4-2901-4ce8-aa02-a2587043d4d3 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:26.845103 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3b00a-521c-4f4e-8b72-4842f8293fe3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:26.877099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:26.898655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbf17d-a3e9-4001-9869-9848df719fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:26.900143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbf17d-a3e9-4001-9869-9848df719fdf None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:26.900645 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbf17d-a3e9-4001-9869-9848df719fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:26.901111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbf17d-a3e9-4001-9869-9848df719fdf None admin] PATH_INFO: `/v3/services/compute` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:26.902658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbf17d-a3e9-4001-9869-9848df719fdf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:26.904254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:26.908015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbf17d-a3e9-4001-9869-9848df719fdf None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:26.913418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d84fd5-6185-49c2-8ce8-cecd7ce52b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:26.914434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d84fd5-6185-49c2-8ce8-cecd7ce52b6e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:26.914935 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d84fd5-6185-49c2-8ce8-cecd7ce52b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:26.915434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d84fd5-6185-49c2-8ce8-cecd7ce52b6e None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:26.916704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d84fd5-6185-49c2-8ce8-cecd7ce52b6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:26.917213 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d84fd5-6185-49c2-8ce8-cecd7ce52b6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:26.919946 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d84fd5-6185-49c2-8ce8-cecd7ce52b6e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-2bdbf17d-a3e9-4001-9869-9848df719fdf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:26.929194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:26.931461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:26.933309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:26.933309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:26.933309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:26.933309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:26.933309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:26.933309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:26.933309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:26.933309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:26.933309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:26.933309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:26.933309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:26.933309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:26.933309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:50:26.933309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:26.935894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 498/990] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:26.940783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbf17d-a3e9-4001-9869-9848df719fdf None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:26.946218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 493/991] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:50:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:26.951814 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d84fd5-6185-49c2-8ce8-cecd7ce52b6e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:27.109108 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbf17d-a3e9-4001-9869-9848df719fdf None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:27.145816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d84fd5-6185-49c2-8ce8-cecd7ce52b6e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:27.170124 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff3a84-0baa-47d9-acae-c4973e73cbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:27.171209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff3a84-0baa-47d9-acae-c4973e73cbaa None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:27.171664 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff3a84-0baa-47d9-acae-c4973e73cbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:27.172512 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff3a84-0baa-47d9-acae-c4973e73cbaa None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:27.173184 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff3a84-0baa-47d9-acae-c4973e73cbaa None admin] RBAC: Adding query filter params (name=compute) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:27.173730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff3a84-0baa-47d9-acae-c4973e73cbaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:27.176357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff3a84-0baa-47d9-acae-c4973e73cbaa None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:27.192755 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 499/992] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 22 15:50:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:27.194798 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff3a84-0baa-47d9-acae-c4973e73cbaa None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:27.211049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048aa22-ed6e-43ca-a102-4babc15b575c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:27.212148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048aa22-ed6e-43ca-a102-4babc15b575c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:27.212608 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048aa22-ed6e-43ca-a102-4babc15b575c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:27.213051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048aa22-ed6e-43ca-a102-4babc15b575c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:27.214391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048aa22-ed6e-43ca-a102-4babc15b575c None admin] RBAC: Adding query filter params (role.id=63241abe50fa4120be0a77336cc5e7e0, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=68876ef8dc62494996c1497819e980d1) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:27.214963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048aa22-ed6e-43ca-a102-4babc15b575c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:27.217702 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a048aa22-ed6e-43ca-a102-4babc15b575c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:27.238640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 494/993] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:50:26 2022] GET /identity/v3/role_assignments?user.id=68876ef8dc62494996c1497819e980d1&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=63241abe50fa4120be0a77336cc5e7e0 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:27.324622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:27.426015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff3a84-0baa-47d9-acae-c4973e73cbaa None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:27.493239 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f7b0c-5eb0-41f0-821f-7f6e4259654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:27.494567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f7b0c-5eb0-41f0-821f-7f6e4259654d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:27.495158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f7b0c-5eb0-41f0-821f-7f6e4259654d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:27.495755 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f7b0c-5eb0-41f0-821f-7f6e4259654d None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:27.496957 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f7b0c-5eb0-41f0-821f-7f6e4259654d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:27.497601 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f7b0c-5eb0-41f0-821f-7f6e4259654d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:27.500383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f7b0c-5eb0-41f0-821f-7f6e4259654d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:27.510413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 500/994] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 22 15:50:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:27.516319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048aa22-ed6e-43ca-a102-4babc15b575c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:27.591910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:27.652107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048aa22-ed6e-43ca-a102-4babc15b575c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:27.695138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2ad4a-3894-4edf-b25c-83bb70fc4fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:27.695660 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2ad4a-3894-4edf-b25c-83bb70fc4fdc None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:27.695933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2ad4a-3894-4edf-b25c-83bb70fc4fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:27.696200 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2ad4a-3894-4edf-b25c-83bb70fc4fdc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:27.697027 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2ad4a-3894-4edf-b25c-83bb70fc4fdc None admin] RBAC: Adding query filter params (interface=public, service_id=d464ca918835478c94943a63dcb9b182, region_id=RegionOne) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:27.697288 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2ad4a-3894-4edf-b25c-83bb70fc4fdc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:27.698729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2ad4a-3894-4edf-b25c-83bb70fc4fdc None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:27.705335 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 495/995] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 22 15:50:27 2022] GET /identity/v3/endpoints?service_id=d464ca918835478c94943a63dcb9b182&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:27.711699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f7b0c-5eb0-41f0-821f-7f6e4259654d None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:27.869519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da62e9-c7e2-45fe-978e-fece29c47323 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:27.870100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da62e9-c7e2-45fe-978e-fece29c47323 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:27.870100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da62e9-c7e2-45fe-978e-fece29c47323 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:27.871683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 496/996] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:27.877245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5476467-5549-40ce-8240-7fde2fabb013 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:27.877530 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5476467-5549-40ce-8240-7fde2fabb013 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:27.877809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5476467-5549-40ce-8240-7fde2fabb013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:27.898291 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d5476467-5549-40ce-8240-7fde2fabb013 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:27.899621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d5476467-5549-40ce-8240-7fde2fabb013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:27.915192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f7b0c-5eb0-41f0-821f-7f6e4259654d None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:27.955793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:27.979421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c6e1-df89-4f4c-83b6-477cbc39b0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:27.980276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c6e1-df89-4f4c-83b6-477cbc39b0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:27.980633 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c6e1-df89-4f4c-83b6-477cbc39b0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:27.981012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c6e1-df89-4f4c-83b6-477cbc39b0d0 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:27.981654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734c6e1-df89-4f4c-83b6-477cbc39b0d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:27.983131 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734c6e1-df89-4f4c-83b6-477cbc39b0d0 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:27.994670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 497/997] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:50:27.994961 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 501/998] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 22 15:50:27 2022] GET /identity/v3/services => generated 1727 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:50:28.253651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5476467-5549-40ce-8240-7fde2fabb013 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:28.323224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:28.422643 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5476467-5549-40ce-8240-7fde2fabb013 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:28.492683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaf068-9311-480a-a414-5ab6f3140890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:28.493763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf068-9311-480a-a414-5ab6f3140890 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:28.494223 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf068-9311-480a-a414-5ab6f3140890 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:28.494686 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf068-9311-480a-a414-5ab6f3140890 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:28.495902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaf068-9311-480a-a414-5ab6f3140890 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:28.498661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaf068-9311-480a-a414-5ab6f3140890 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-bfbaf068-9311-480a-a414-5ab6f3140890 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:28.516077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:28.518025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:28.519750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 498/999] 10.222.0.77 () {56 vars in 1126 bytes} [Mon Aug 22 15:50:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:28.529023 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c6e1-df89-4f4c-83b6-477cbc39b0d0 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:28.729301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c6e1-df89-4f4c-83b6-477cbc39b0d0 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:28.791519 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ba878-b35a-4e8c-b9b8-5f80aa9c8117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:28.792432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ba878-b35a-4e8c-b9b8-5f80aa9c8117 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:28.792917 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ba878-b35a-4e8c-b9b8-5f80aa9c8117 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:28.793390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ba878-b35a-4e8c-b9b8-5f80aa9c8117 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:28.794632 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ba878-b35a-4e8c-b9b8-5f80aa9c8117 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:28.795167 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ba878-b35a-4e8c-b9b8-5f80aa9c8117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:28.797736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ba878-b35a-4e8c-b9b8-5f80aa9c8117 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:28.815331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 502/1000] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 22 15:50:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:28.818208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaf068-9311-480a-a414-5ab6f3140890 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:29.019366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaf068-9311-480a-a414-5ab6f3140890 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:29.048208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:29.088992 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfcab0-05f6-4a2b-a8e9-fda11cef5c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:29.090065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfcab0-05f6-4a2b-a8e9-fda11cef5c09 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:29.090542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfcab0-05f6-4a2b-a8e9-fda11cef5c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:29.091041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfcab0-05f6-4a2b-a8e9-fda11cef5c09 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:29.092153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfcab0-05f6-4a2b-a8e9-fda11cef5c09 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:29.092687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfcab0-05f6-4a2b-a8e9-fda11cef5c09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:29.095330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfcab0-05f6-4a2b-a8e9-fda11cef5c09 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:29.105571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 499/1001] 10.222.0.77 () {56 vars in 1122 bytes} [Mon Aug 22 15:50:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:29.114804 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ba878-b35a-4e8c-b9b8-5f80aa9c8117 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:29.216206 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:29.324862 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ba878-b35a-4e8c-b9b8-5f80aa9c8117 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:29.396125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bc6df-bdf7-46b6-8819-597c9201bb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:29.397291 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bc6df-bdf7-46b6-8819-597c9201bb24 None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:29.397771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bc6df-bdf7-46b6-8819-597c9201bb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:29.398234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bc6df-bdf7-46b6-8819-597c9201bb24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:29.399516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bc6df-bdf7-46b6-8819-597c9201bb24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:29.402163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bc6df-bdf7-46b6-8819-597c9201bb24 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:29.433559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 503/1002] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 15:50:29 2022] POST /identity/v3/endpoints => generated 325 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:50:29.605969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956f53-3a0e-43c2-b0e4-1c9cd026d3d9 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:29.606468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956f53-3a0e-43c2-b0e4-1c9cd026d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:29.606980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956f53-3a0e-43c2-b0e4-1c9cd026d3d9 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:29.609542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 500/1003] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:29.616852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16d6e8-b9e9-4cd1-bbf0-1c16a0596cce None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:29.617138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16d6e8-b9e9-4cd1-bbf0-1c16a0596cce None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:29.617473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16d6e8-b9e9-4cd1-bbf0-1c16a0596cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:29.641233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-ed16d6e8-b9e9-4cd1-bbf0-1c16a0596cce None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:29.642553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ed16d6e8-b9e9-4cd1-bbf0-1c16a0596cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:29.767972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 504/1004] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:29 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:50:30.048918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018fbb-893f-46c9-8106-2525df248125 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:30.049471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018fbb-893f-46c9-8106-2525df248125 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:30.049998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018fbb-893f-46c9-8106-2525df248125 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:30.052448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 501/1005] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:30.062496 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c12f-e645-4cd2-8bc0-812023701b78 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:30.063036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c12f-e645-4cd2-8bc0-812023701b78 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:30.063538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c12f-e645-4cd2-8bc0-812023701b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:30.078923 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7018fbb-893f-46c9-8106-2525df248125 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:30.093111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-5e51c12f-e645-4cd2-8bc0-812023701b78 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:30.094586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5e51c12f-e645-4cd2-8bc0-812023701b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:30.136349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:30.211498 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 505/1006] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:30 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:30.268532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7018fbb-893f-46c9-8106-2525df248125 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:30.336545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cba21c-7a06-4004-98fd-318279b96e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:30.337265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cba21c-7a06-4004-98fd-318279b96e3c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:30.337555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cba21c-7a06-4004-98fd-318279b96e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:30.337846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cba21c-7a06-4004-98fd-318279b96e3c None admin] PATH_INFO: `/v3/services/image` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:30.338409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cba21c-7a06-4004-98fd-318279b96e3c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:30.339873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cba21c-7a06-4004-98fd-318279b96e3c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-e9cba21c-7a06-4004-98fd-318279b96e3c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:30.351478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:30.353409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:30.355350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 502/1007] 10.222.0.77 () {56 vars in 1105 bytes} [Mon Aug 22 15:50:30 2022] GET /identity/v3/services/image => generated 86 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:30.363256 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51c12f-e645-4cd2-8bc0-812023701b78 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:30.566426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51c12f-e645-4cd2-8bc0-812023701b78 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:30.574377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cba21c-7a06-4004-98fd-318279b96e3c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:30.611978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543aa1d-3adf-4cc5-ba28-a576d2d24809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:30.612523 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543aa1d-3adf-4cc5-ba28-a576d2d24809 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:30.612790 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543aa1d-3adf-4cc5-ba28-a576d2d24809 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:30.613070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543aa1d-3adf-4cc5-ba28-a576d2d24809 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:30.613729 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543aa1d-3adf-4cc5-ba28-a576d2d24809 None admin] RBAC: Adding query filter params (name=image) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:30.614027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543aa1d-3adf-4cc5-ba28-a576d2d24809 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:30.615515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543aa1d-3adf-4cc5-ba28-a576d2d24809 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:30.621771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 506/1008] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:30.627939 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543aa1d-3adf-4cc5-ba28-a576d2d24809 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:30.660882 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:30.668020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:30.757764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cba21c-7a06-4004-98fd-318279b96e3c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:30.808067 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27005477-c14b-4861-9fcc-d5194d93e388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:30.808897 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005477-c14b-4861-9fcc-d5194d93e388 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:30.809283 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005477-c14b-4861-9fcc-d5194d93e388 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:30.809569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005477-c14b-4861-9fcc-d5194d93e388 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:30.810214 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27005477-c14b-4861-9fcc-d5194d93e388 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:30.811746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27005477-c14b-4861-9fcc-d5194d93e388 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:30.820695 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543aa1d-3adf-4cc5-ba28-a576d2d24809 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-27005477-c14b-4861-9fcc-d5194d93e388 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:30.823040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:30.824981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:30.826706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 503/1009] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:30.830890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27005477-c14b-4861-9fcc-d5194d93e388 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:30.873682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce107d-88b5-40da-8c2f-a1e575184aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:30.874217 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce107d-88b5-40da-8c2f-a1e575184aeb None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:30.874488 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce107d-88b5-40da-8c2f-a1e575184aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:30.875307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce107d-88b5-40da-8c2f-a1e575184aeb None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:30.875460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce107d-88b5-40da-8c2f-a1e575184aeb None admin] RBAC: Adding query filter params (type=image) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:30.875762 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce107d-88b5-40da-8c2f-a1e575184aeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:30.877202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce107d-88b5-40da-8c2f-a1e575184aeb None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:30.891065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 507/1010] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:30.989220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27005477-c14b-4861-9fcc-d5194d93e388 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:30.998545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:31.035017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2f04-401c-4ed0-914e-e483350f165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:31.036089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2f04-401c-4ed0-914e-e483350f165a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:31.036089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2f04-401c-4ed0-914e-e483350f165a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:31.036380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2f04-401c-4ed0-914e-e483350f165a None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:31.036950 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc2f04-401c-4ed0-914e-e483350f165a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:31.037224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc2f04-401c-4ed0-914e-e483350f165a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:31.038738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc2f04-401c-4ed0-914e-e483350f165a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:31.045177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 504/1011] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 22 15:50:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:31.054791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce107d-88b5-40da-8c2f-a1e575184aeb None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:31.270076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:31.289389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce107d-88b5-40da-8c2f-a1e575184aeb None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:31.358299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531af74-127f-45b2-8e98-671463bd8711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:31.359390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531af74-127f-45b2-8e98-671463bd8711 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:31.359882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531af74-127f-45b2-8e98-671463bd8711 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:31.360348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531af74-127f-45b2-8e98-671463bd8711 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:31.361538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531af74-127f-45b2-8e98-671463bd8711 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:31.362083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531af74-127f-45b2-8e98-671463bd8711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:31.364848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531af74-127f-45b2-8e98-671463bd8711 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:31.375330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 508/1012] 10.222.0.77 () {56 vars in 1112 bytes} [Mon Aug 22 15:50:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:31.384647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2f04-401c-4ed0-914e-e483350f165a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:31.575908 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2f04-401c-4ed0-914e-e483350f165a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:31.643108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfaeb86-abd6-4684-b144-e570b53987d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:31.644027 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaeb86-abd6-4684-b144-e570b53987d6 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:31.644481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaeb86-abd6-4684-b144-e570b53987d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:31.644921 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfaeb86-abd6-4684-b144-e570b53987d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:31.646051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfaeb86-abd6-4684-b144-e570b53987d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:31.648215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfaeb86-abd6-4684-b144-e570b53987d6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:31.685696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 505/1013] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 15:50:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:50:31.786429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2e599-2613-47af-ad9d-ebc31134c07f None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:31.787032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2e599-2613-47af-ad9d-ebc31134c07f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:31.787490 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2e599-2613-47af-ad9d-ebc31134c07f None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:31.790415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 509/1014] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:31.800109 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af51861-6361-4901-be08-52d66d47359f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:31.800585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af51861-6361-4901-be08-52d66d47359f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:31.801060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af51861-6361-4901-be08-52d66d47359f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:31.835289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3af51861-6361-4901-be08-52d66d47359f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:31.837312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3af51861-6361-4901-be08-52d66d47359f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:31.880300 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:31.968441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 506/1015] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:31 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:32.444119 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2e599-2613-47af-ad9d-ebc31134c07f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:32.627843 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2e599-2613-47af-ad9d-ebc31134c07f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:32.687327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c5b41-cca9-4ee8-923f-e451380ae2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:32.688282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c5b41-cca9-4ee8-923f-e451380ae2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:32.688770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c5b41-cca9-4ee8-923f-e451380ae2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:32.689169 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c5b41-cca9-4ee8-923f-e451380ae2d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:32.691423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c5b41-cca9-4ee8-923f-e451380ae2d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:32.693896 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c5b41-cca9-4ee8-923f-e451380ae2d9 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:32.696985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 510/1016] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:32.705940 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af51861-6361-4901-be08-52d66d47359f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:32.881349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af51861-6361-4901-be08-52d66d47359f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:32.953770 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d086d6-dba6-442e-b01d-7f61e0fde92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:32.954896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d086d6-dba6-442e-b01d-7f61e0fde92b None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:32.955369 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d086d6-dba6-442e-b01d-7f61e0fde92b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:32.955833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d086d6-dba6-442e-b01d-7f61e0fde92b None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:32.957096 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d086d6-dba6-442e-b01d-7f61e0fde92b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:32.959969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d086d6-dba6-442e-b01d-7f61e0fde92b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:33.013108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 507/1017] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 22 15:50:32 2022] POST /identity/v3/projects => generated 311 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:50:33.234401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4de86-380a-48c4-9105-b6f7c9e91ca9 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:33.234986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4de86-380a-48c4-9105-b6f7c9e91ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:33.235302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4de86-380a-48c4-9105-b6f7c9e91ca9 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:33.237864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 511/1018] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:33.246198 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe229f7-e315-4918-b9ea-2f40123033df None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:33.246665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe229f7-e315-4918-b9ea-2f40123033df None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:33.247122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe229f7-e315-4918-b9ea-2f40123033df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:33.259053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:33.277593 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-abe229f7-e315-4918-b9ea-2f40123033df None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:33.279399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-abe229f7-e315-4918-b9ea-2f40123033df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:33.396274 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 508/1019] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:33 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:33.880702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4de86-380a-48c4-9105-b6f7c9e91ca9 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:33.915598 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb119-35fb-43f9-83f3-4a238b128a05 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:33.916419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb119-35fb-43f9-83f3-4a238b128a05 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:33.916419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb119-35fb-43f9-83f3-4a238b128a05 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:33.917818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 509/1020] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:33.924959 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b60fd-d7b7-4402-92c6-741d0f5475c6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:33.925448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b60fd-d7b7-4402-92c6-741d0f5475c6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:33.925935 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b60fd-d7b7-4402-92c6-741d0f5475c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:33.931982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:33.953831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a11b60fd-d7b7-4402-92c6-741d0f5475c6 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:33.955811 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a11b60fd-d7b7-4402-92c6-741d0f5475c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:34.033793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4de86-380a-48c4-9105-b6f7c9e91ca9 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:34.053446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 510/1021] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:33 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:34.075122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0735c-00fc-4579-b356-29bccbd99d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:34.075763 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0735c-00fc-4579-b356-29bccbd99d46 None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:34.076035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0735c-00fc-4579-b356-29bccbd99d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:34.076300 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0735c-00fc-4579-b356-29bccbd99d46 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:34.076979 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0735c-00fc-4579-b356-29bccbd99d46 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:34.078408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0735c-00fc-4579-b356-29bccbd99d46 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:34.098538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 512/1022] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 22 15:50:33 2022] POST /identity/v3/services => generated 242 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:50:34.381121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b60fd-d7b7-4402-92c6-741d0f5475c6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:34.466456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:34.514564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b60fd-d7b7-4402-92c6-741d0f5475c6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:34.565978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b895f-d14d-4a55-a7fd-362ee1dd1261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:34.566671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b895f-d14d-4a55-a7fd-362ee1dd1261 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:34.566943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b895f-d14d-4a55-a7fd-362ee1dd1261 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:34.567195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b895f-d14d-4a55-a7fd-362ee1dd1261 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:34.581494 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b895f-d14d-4a55-a7fd-362ee1dd1261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-af1b895f-d14d-4a55-a7fd-362ee1dd1261 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:50:34.589826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:34.592028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:34.593799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:34.593799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:34.593799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:34.593799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:34.593799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:50:34.593799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:50:34.593799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:50:34.593799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:50:34.593799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:50:34.593799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:50:34.593799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:50:34.593799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:34.601337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 511/1023] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Aug 22 15:50:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:34.601662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0735c-00fc-4579-b356-29bccbd99d46 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:34.760452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:34.796539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0735c-00fc-4579-b356-29bccbd99d46 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:34.861140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913821e-7acf-4494-9f90-d0c51de9fd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:34.862053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913821e-7acf-4494-9f90-d0c51de9fd9a None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:34.862549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913821e-7acf-4494-9f90-d0c51de9fd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:34.863074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913821e-7acf-4494-9f90-d0c51de9fd9a None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:34.864287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913821e-7acf-4494-9f90-d0c51de9fd9a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:34.864848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913821e-7acf-4494-9f90-d0c51de9fd9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:34.867447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913821e-7acf-4494-9f90-d0c51de9fd9a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:34.884963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 513/1024] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Aug 22 15:50:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:34.894385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b895f-d14d-4a55-a7fd-362ee1dd1261 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:35.101218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b895f-d14d-4a55-a7fd-362ee1dd1261 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:35.148664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:35.176195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6575-79b6-4c22-9df3-4098c1bc7762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:35.177325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6575-79b6-4c22-9df3-4098c1bc7762 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:35.177792 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6575-79b6-4c22-9df3-4098c1bc7762 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:35.178269 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c6575-79b6-4c22-9df3-4098c1bc7762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:35.198463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6575-79b6-4c22-9df3-4098c1bc7762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:35.201178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c6575-79b6-4c22-9df3-4098c1bc7762 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-b73c6575-79b6-4c22-9df3-4098c1bc7762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:35.229342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:35.230360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:35.231646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:35.231646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:35.231646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:35.234966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 512/1025] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:35.241234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913821e-7acf-4494-9f90-d0c51de9fd9a None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:35.406936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913821e-7acf-4494-9f90-d0c51de9fd9a None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:35.468142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b214178-3c1c-49b9-bfbd-a438278f5b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:35.468779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214178-3c1c-49b9-bfbd-a438278f5b18 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:35.469050 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214178-3c1c-49b9-bfbd-a438278f5b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:35.469315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214178-3c1c-49b9-bfbd-a438278f5b18 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:35.469974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b214178-3c1c-49b9-bfbd-a438278f5b18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:35.470269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b214178-3c1c-49b9-bfbd-a438278f5b18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:35.471694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b214178-3c1c-49b9-bfbd-a438278f5b18 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:35.490633 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 514/1026] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:35.494633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6575-79b6-4c22-9df3-4098c1bc7762 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:35.521734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147df103-101a-4822-85d3-aff6684a2716 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:35.522187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147df103-101a-4822-85d3-aff6684a2716 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:35.522401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147df103-101a-4822-85d3-aff6684a2716 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:35.524282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 515/1027] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:35.530161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad72c6a-036a-42dc-9562-f6d0fd95322f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:35.530539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad72c6a-036a-42dc-9562-f6d0fd95322f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:35.530796 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad72c6a-036a-42dc-9562-f6d0fd95322f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:35.547030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:35.565665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-cad72c6a-036a-42dc-9562-f6d0fd95322f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:35.567819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-cad72c6a-036a-42dc-9562-f6d0fd95322f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:35.663449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 516/1028] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:35.679137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c6575-79b6-4c22-9df3-4098c1bc7762 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:35.727147 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685027d7-5dad-4533-a6d5-6472dcfe7666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:35.728052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685027d7-5dad-4533-a6d5-6472dcfe7666 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:35.728365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685027d7-5dad-4533-a6d5-6472dcfe7666 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:35.728669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685027d7-5dad-4533-a6d5-6472dcfe7666 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:35.739493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685027d7-5dad-4533-a6d5-6472dcfe7666 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:35.740976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685027d7-5dad-4533-a6d5-6472dcfe7666 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-685027d7-5dad-4533-a6d5-6472dcfe7666 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:50:35.753600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:35.761190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:35.763478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:35.763478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:35.763478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:50:35.763478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:50:35.763478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:50:35.763478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:50:35.763478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:50:35.763478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:50:35.763478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:50:35.763478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:35.763478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 513/1029] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 22 15:50:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:35.769729 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad72c6a-036a-42dc-9562-f6d0fd95322f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:35.929471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685027d7-5dad-4533-a6d5-6472dcfe7666 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:35.939270 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad72c6a-036a-42dc-9562-f6d0fd95322f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:35.971700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:35.993304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688abf76-39fd-4dd4-ba0d-486ba717c775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:35.994395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688abf76-39fd-4dd4-ba0d-486ba717c775 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:35.994925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688abf76-39fd-4dd4-ba0d-486ba717c775 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:35.995406 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688abf76-39fd-4dd4-ba0d-486ba717c775 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:35.996546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688abf76-39fd-4dd4-ba0d-486ba717c775 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:35.996858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688abf76-39fd-4dd4-ba0d-486ba717c775 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:35.998385 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688abf76-39fd-4dd4-ba0d-486ba717c775 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:36.002919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:36.021390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 517/1030] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 22 15:50:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:36.028422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688abf76-39fd-4dd4-ba0d-486ba717c775 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:36.074622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685027d7-5dad-4533-a6d5-6472dcfe7666 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:36.115507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079edca-2c7e-485d-a804-6420dcce7dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:36.116539 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079edca-2c7e-485d-a804-6420dcce7dcf None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:36.116539 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079edca-2c7e-485d-a804-6420dcce7dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:36.116786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079edca-2c7e-485d-a804-6420dcce7dcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:36.117826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079edca-2c7e-485d-a804-6420dcce7dcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:36.119389 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3079edca-2c7e-485d-a804-6420dcce7dcf None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:36.121012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 514/1031] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:36.122230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff49d-0b1f-462d-9a14-c818bb26090e None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:36.122574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff49d-0b1f-462d-9a14-c818bb26090e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:36.122781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff49d-0b1f-462d-9a14-c818bb26090e None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:36.126573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 515/1032] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:36.127717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ff49d-0b1f-462d-9a14-c818bb26090e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:36.151606 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688abf76-39fd-4dd4-ba0d-486ba717c775 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:36.198052 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463db411-1a3d-4a32-99ef-12c70fffd01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:36.198585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463db411-1a3d-4a32-99ef-12c70fffd01a None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:36.198894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463db411-1a3d-4a32-99ef-12c70fffd01a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:36.199163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463db411-1a3d-4a32-99ef-12c70fffd01a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:36.255953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:36.262236 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ff49d-0b1f-462d-9a14-c818bb26090e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:36.273158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:36.285612 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463db411-1a3d-4a32-99ef-12c70fffd01a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:36.287739 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463db411-1a3d-4a32-99ef-12c70fffd01a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:36.313459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910244bc-3e8a-41d7-9ad6-9225e0e6d670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:36.314091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910244bc-3e8a-41d7-9ad6-9225e0e6d670 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:36.314366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910244bc-3e8a-41d7-9ad6-9225e0e6d670 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:36.314640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910244bc-3e8a-41d7-9ad6-9225e0e6d670 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:36.315676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910244bc-3e8a-41d7-9ad6-9225e0e6d670 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:36.317161 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910244bc-3e8a-41d7-9ad6-9225e0e6d670 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:36.341093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 516/1033] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:50:36 2022] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:50:36.342841 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc8742-7624-4f36-94fb-62d6c97b6efc None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:36.346399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc8742-7624-4f36-94fb-62d6c97b6efc None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:36.349842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc8742-7624-4f36-94fb-62d6c97b6efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:36.372507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a1fc8742-7624-4f36-94fb-62d6c97b6efc None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:36.373768 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a1fc8742-7624-4f36-94fb-62d6c97b6efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:36.451594 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 518/1034] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:50:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 15:50:36.457653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463db411-1a3d-4a32-99ef-12c70fffd01a None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:36.474183 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 517/1035] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:36.592644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:36.603067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463db411-1a3d-4a32-99ef-12c70fffd01a None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:36.647588 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a6180-ce55-4524-a5cb-d7a80d15bc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:36.648334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a6180-ce55-4524-a5cb-d7a80d15bc91 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:36.648612 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a6180-ce55-4524-a5cb-d7a80d15bc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:36.648942 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a6180-ce55-4524-a5cb-d7a80d15bc91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:36.661275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a6180-ce55-4524-a5cb-d7a80d15bc91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:36.662825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a6180-ce55-4524-a5cb-d7a80d15bc91 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-ef6a6180-ce55-4524-a5cb-d7a80d15bc91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:36.684913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:36.685945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:36.686857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:36.686857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:36.686857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:36.687587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 519/1036] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:36.695373 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc8742-7624-4f36-94fb-62d6c97b6efc None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:36.736938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a6180-ce55-4524-a5cb-d7a80d15bc91 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:36.806836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:36.828499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc8742-7624-4f36-94fb-62d6c97b6efc None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:36.871662 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d33ac-dfee-456c-b8e6-e4446ef8abad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:36.872298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d33ac-dfee-456c-b8e6-e4446ef8abad None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:36.872578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d33ac-dfee-456c-b8e6-e4446ef8abad None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:36.872846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d33ac-dfee-456c-b8e6-e4446ef8abad None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:36.873708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d33ac-dfee-456c-b8e6-e4446ef8abad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:36.874099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d33ac-dfee-456c-b8e6-e4446ef8abad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:36.875743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d33ac-dfee-456c-b8e6-e4446ef8abad None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:36.898634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 518/1037] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:36.898913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a6180-ce55-4524-a5cb-d7a80d15bc91 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:36.900117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d33ac-dfee-456c-b8e6-e4446ef8abad None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:36.947733 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e59b3-e5a2-4d60-9d3b-153bbb7e9d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:36.948563 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e59b3-e5a2-4d60-9d3b-153bbb7e9d86 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:36.948911 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e59b3-e5a2-4d60-9d3b-153bbb7e9d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:36.949276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e59b3-e5a2-4d60-9d3b-153bbb7e9d86 None admin] PATH_INFO: `/v3/services/image` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:36.950746 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e59b3-e5a2-4d60-9d3b-153bbb7e9d86 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:36.952316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e59b3-e5a2-4d60-9d3b-153bbb7e9d86 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-193e59b3-e5a2-4d60-9d3b-153bbb7e9d86 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:36.962725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:36.964554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:36.965858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 520/1038] 10.222.0.77 () {56 vars in 1105 bytes} [Mon Aug 22 15:50:36 2022] GET /identity/v3/services/image => generated 86 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:36.970217 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e59b3-e5a2-4d60-9d3b-153bbb7e9d86 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:36.986858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:37.035998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d33ac-dfee-456c-b8e6-e4446ef8abad None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:37.078357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a5620-76bb-4d36-b3f5-89d67288641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:37.079040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5620-76bb-4d36-b3f5-89d67288641f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:37.079316 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5620-76bb-4d36-b3f5-89d67288641f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:37.079591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5620-76bb-4d36-b3f5-89d67288641f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:37.088113 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a5620-76bb-4d36-b3f5-89d67288641f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:37.089612 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a5620-76bb-4d36-b3f5-89d67288641f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:37.097906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e59b3-e5a2-4d60-9d3b-153bbb7e9d86 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-a20a5620-76bb-4d36-b3f5-89d67288641f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:50:37.102122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:37.103284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:37.104297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:50:37.104297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:50:37.104297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:50:37.104297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:50:37.104297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:50:37.104297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:50:37.104297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:37.104297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:37.108248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 519/1039] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:37.109159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a5620-76bb-4d36-b3f5-89d67288641f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:37.122521 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:37.143874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56bcef-df76-4ef4-b519-f91b12acfa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:37.144502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56bcef-df76-4ef4-b519-f91b12acfa9b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:37.144774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56bcef-df76-4ef4-b519-f91b12acfa9b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:37.145043 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56bcef-df76-4ef4-b519-f91b12acfa9b None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:37.145699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56bcef-df76-4ef4-b519-f91b12acfa9b None admin] RBAC: Adding query filter params (name=image) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:37.146076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56bcef-df76-4ef4-b519-f91b12acfa9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:37.147433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56bcef-df76-4ef4-b519-f91b12acfa9b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:37.154996 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 521/1040] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:37.160823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56bcef-df76-4ef4-b519-f91b12acfa9b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:37.253560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a5620-76bb-4d36-b3f5-89d67288641f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:37.270581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:37.294617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ad0c4-d898-45ec-9787-20e8ff408584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:37.295613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ad0c4-d898-45ec-9787-20e8ff408584 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:37.295882 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ad0c4-d898-45ec-9787-20e8ff408584 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:37.296153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ad0c4-d898-45ec-9787-20e8ff408584 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:37.296860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ad0c4-d898-45ec-9787-20e8ff408584 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:37.297167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ad0c4-d898-45ec-9787-20e8ff408584 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:37.298740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ad0c4-d898-45ec-9787-20e8ff408584 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:37.308346 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56bcef-df76-4ef4-b519-f91b12acfa9b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:37.312159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 520/1041] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:50:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:37.318721 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ad0c4-d898-45ec-9787-20e8ff408584 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:37.368985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78838-ef0d-45f9-a93d-1ae310b1fef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:37.369968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78838-ef0d-45f9-a93d-1ae310b1fef5 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:37.370491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78838-ef0d-45f9-a93d-1ae310b1fef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:37.371225 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78838-ef0d-45f9-a93d-1ae310b1fef5 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:37.371769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a78838-ef0d-45f9-a93d-1ae310b1fef5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:37.372264 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a78838-ef0d-45f9-a93d-1ae310b1fef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:37.374722 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a78838-ef0d-45f9-a93d-1ae310b1fef5 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:37.391584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 522/1042] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:37.392693 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78838-ef0d-45f9-a93d-1ae310b1fef5 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:37.425321 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:37.481167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ad0c4-d898-45ec-9787-20e8ff408584 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:37.518436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78838-ef0d-45f9-a93d-1ae310b1fef5 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:37.524175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93daf04-5c6c-4631-812f-e86e53028394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:37.524798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93daf04-5c6c-4631-812f-e86e53028394 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:37.525352 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93daf04-5c6c-4631-812f-e86e53028394 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:37.525537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93daf04-5c6c-4631-812f-e86e53028394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:37.526241 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93daf04-5c6c-4631-812f-e86e53028394 None admin] RBAC: Adding query filter params (role.id=63241abe50fa4120be0a77336cc5e7e0, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=20e4a18ab77642baa9adb9a4b49fbcc2) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:37.526555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93daf04-5c6c-4631-812f-e86e53028394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:37.528081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93daf04-5c6c-4631-812f-e86e53028394 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:37.534443 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 521/1043] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:50:37 2022] GET /identity/v3/role_assignments?user.id=20e4a18ab77642baa9adb9a4b49fbcc2&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=63241abe50fa4120be0a77336cc5e7e0 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:37.585443 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54401b08-2234-4191-a846-e60fbc0869f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:37.586958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54401b08-2234-4191-a846-e60fbc0869f4 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:37.587777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54401b08-2234-4191-a846-e60fbc0869f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:37.588533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54401b08-2234-4191-a846-e60fbc0869f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:37.590158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54401b08-2234-4191-a846-e60fbc0869f4 None admin] RBAC: Adding query filter params (interface=public, service_id=f510fc7019984e98b73bf88c02bfde41, region_id=RegionOne) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:37.591103 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54401b08-2234-4191-a846-e60fbc0869f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:37.594186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54401b08-2234-4191-a846-e60fbc0869f4 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:37.604782 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 523/1044] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 22 15:50:37 2022] GET /identity/v3/endpoints?service_id=f510fc7019984e98b73bf88c02bfde41&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:37.611218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93daf04-5c6c-4631-812f-e86e53028394 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:37.772824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93daf04-5c6c-4631-812f-e86e53028394 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:37.810343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:37.819032 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d80be0-5ae9-43e6-84af-66b4464088ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:37.819642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d80be0-5ae9-43e6-84af-66b4464088ba None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:37.820383 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d80be0-5ae9-43e6-84af-66b4464088ba None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:37.820383 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d80be0-5ae9-43e6-84af-66b4464088ba None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:37.820795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d80be0-5ae9-43e6-84af-66b4464088ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:37.822349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d80be0-5ae9-43e6-84af-66b4464088ba None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:37.840214 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 522/1045] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 22 15:50:37 2022] GET /identity/v3/services => generated 1957 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:50:38.423557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f9189-4e12-4ef4-850f-4f20ac7ab5ff None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:38.424388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f9189-4e12-4ef4-850f-4f20ac7ab5ff None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:38.424388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f9189-4e12-4ef4-850f-4f20ac7ab5ff None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:38.425901 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 524/1046] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:38.431825 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ace880-f098-49c2-a358-e7f1ed597ee7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:38.432608 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ace880-f098-49c2-a358-e7f1ed597ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:38.432608 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ace880-f098-49c2-a358-e7f1ed597ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:38.460824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-02ace880-f098-49c2-a358-e7f1ed597ee7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:38.462085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-02ace880-f098-49c2-a358-e7f1ed597ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:38.542138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 523/1047] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:38.812197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f9189-4e12-4ef4-850f-4f20ac7ab5ff None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:38.816062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:38.947158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f9189-4e12-4ef4-850f-4f20ac7ab5ff None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:38.992128 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6cf62-fef2-4b03-8367-a75c59a4eefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:38.992496 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6cf62-fef2-4b03-8367-a75c59a4eefc None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:38.992698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6cf62-fef2-4b03-8367-a75c59a4eefc None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:38.992971 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6cf62-fef2-4b03-8367-a75c59a4eefc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:39.008433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6cf62-fef2-4b03-8367-a75c59a4eefc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-77a6cf62-fef2-4b03-8367-a75c59a4eefc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:50:39.013462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:39.019380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:39.020289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:39.020289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:39.020289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:39.020289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:39.020289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:50:39.020289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:50:39.020289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:50:39.020289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:50:39.020289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:50:39.020289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:50:39.020289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:50:39.020289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:39.020289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 525/1048] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:50:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:39.022006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ace880-f098-49c2-a358-e7f1ed597ee7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:39.154326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ace880-f098-49c2-a358-e7f1ed597ee7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:39.187603 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:39.201719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc035b-df64-4384-b8dd-2218793bbcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:39.202350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc035b-df64-4384-b8dd-2218793bbcfb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:39.202642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc035b-df64-4384-b8dd-2218793bbcfb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:39.202918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc035b-df64-4384-b8dd-2218793bbcfb None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:39.203607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc035b-df64-4384-b8dd-2218793bbcfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:39.203904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc035b-df64-4384-b8dd-2218793bbcfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:39.206572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc035b-df64-4384-b8dd-2218793bbcfb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:39.219978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 524/1049] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:50:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:39.222428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6cf62-fef2-4b03-8367-a75c59a4eefc None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:39.298704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:39.347865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6cf62-fef2-4b03-8367-a75c59a4eefc None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:39.405400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078231a9-dba1-446b-8108-30934f297026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:39.407557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078231a9-dba1-446b-8108-30934f297026 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:39.407557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078231a9-dba1-446b-8108-30934f297026 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:39.407557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078231a9-dba1-446b-8108-30934f297026 None admin] PATH_INFO: `/v3/users/8a404cd3000a4255a819541cd727243c` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:39.422998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078231a9-dba1-446b-8108-30934f297026 None admin] RBAC: Authorizing `identity:get_user(user_id=8a404cd3000a4255a819541cd727243c)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:39.424466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078231a9-dba1-446b-8108-30934f297026 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:39.431265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 526/1050] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:50:39 2022] GET /identity/v3/users/8a404cd3000a4255a819541cd727243c => generated 285 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:39.433062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc035b-df64-4384-b8dd-2218793bbcfb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:39.543136 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc035b-df64-4384-b8dd-2218793bbcfb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:39.581978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698f2cd-f9dc-4f7d-9a29-b259d2815183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:39.582924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f2cd-f9dc-4f7d-9a29-b259d2815183 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:39.583360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f2cd-f9dc-4f7d-9a29-b259d2815183 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:39.583779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f2cd-f9dc-4f7d-9a29-b259d2815183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:39.648814 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:39.666345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698f2cd-f9dc-4f7d-9a29-b259d2815183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:39.668147 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698f2cd-f9dc-4f7d-9a29-b259d2815183 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:39.775127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 525/1051] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:50:39 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:39.781438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078231a9-dba1-446b-8108-30934f297026 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:39.894889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078231a9-dba1-446b-8108-30934f297026 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:39.918242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:39.934837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb66a8a-281a-4dea-9ebc-025bdaeb48ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:39.935468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66a8a-281a-4dea-9ebc-025bdaeb48ba None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:39.935742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66a8a-281a-4dea-9ebc-025bdaeb48ba None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:39.936009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66a8a-281a-4dea-9ebc-025bdaeb48ba None admin] PATH_INFO: `/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:39.937180 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb66a8a-281a-4dea-9ebc-025bdaeb48ba None admin] RBAC: Authorizing `identity:get_project(project_id=c8b02321bb6148b5bd6b42abaf235cf0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:39.938644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb66a8a-281a-4dea-9ebc-025bdaeb48ba None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:39.946504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 527/1052] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:50:39 2022] GET /identity/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:39.948226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698f2cd-f9dc-4f7d-9a29-b259d2815183 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:40.045221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:40.065038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698f2cd-f9dc-4f7d-9a29-b259d2815183 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:40.109316 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c905dd-de9e-4362-9c90-d4dfcf0f29d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:40.109930 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c905dd-de9e-4362-9c90-d4dfcf0f29d7 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:40.110231 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c905dd-de9e-4362-9c90-d4dfcf0f29d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:40.110478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c905dd-de9e-4362-9c90-d4dfcf0f29d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:40.111285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c905dd-de9e-4362-9c90-d4dfcf0f29d7 None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=c8b02321bb6148b5bd6b42abaf235cf0, user.id=8a404cd3000a4255a819541cd727243c) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:40.111666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c905dd-de9e-4362-9c90-d4dfcf0f29d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:40.113142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c905dd-de9e-4362-9c90-d4dfcf0f29d7 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:40.119950 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 526/1053] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:50:39 2022] GET /identity/v3/role_assignments?user.id=8a404cd3000a4255a819541cd727243c&scope.project.id=c8b02321bb6148b5bd6b42abaf235cf0&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:40.215109 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b4554-2c1f-4b3a-9732-2f6d4881e392 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:40.215573 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b4554-2c1f-4b3a-9732-2f6d4881e392 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:40.215975 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b4554-2c1f-4b3a-9732-2f6d4881e392 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:40.218718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 528/1054] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:40.227595 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098cf22-5ef2-4287-a911-c8233284bd19 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:40.228126 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098cf22-5ef2-4287-a911-c8233284bd19 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:40.228634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098cf22-5ef2-4287-a911-c8233284bd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:40.259662 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f098cf22-5ef2-4287-a911-c8233284bd19 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:40.261659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f098cf22-5ef2-4287-a911-c8233284bd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:40.378766 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 527/1055] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:40.544845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0ad5-dd04-41cc-a9f1-a3611b1cbd3e None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:40.545354 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0ad5-dd04-41cc-a9f1-a3611b1cbd3e None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:40.545354 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0ad5-dd04-41cc-a9f1-a3611b1cbd3e None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:40.550653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 529/1056] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:40.554996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e936fd-f21f-4829-8962-f89bbd079a73 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:40.555561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e936fd-f21f-4829-8962-f89bbd079a73 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:40.555942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e936fd-f21f-4829-8962-f89bbd079a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:40.584216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-10e936fd-f21f-4829-8962-f89bbd079a73 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:40.585438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-10e936fd-f21f-4829-8962-f89bbd079a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:40.650827 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a0ad5-dd04-41cc-a9f1-a3611b1cbd3e None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:40.678799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 528/1057] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:40.795178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a0ad5-dd04-41cc-a9f1-a3611b1cbd3e None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:40.833090 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785d5d1-e566-4160-bf93-c81cd14c95ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:40.833740 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785d5d1-e566-4160-bf93-c81cd14c95ca None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:40.834012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785d5d1-e566-4160-bf93-c81cd14c95ca None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:40.834279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785d5d1-e566-4160-bf93-c81cd14c95ca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:40.848716 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785d5d1-e566-4160-bf93-c81cd14c95ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-5785d5d1-e566-4160-bf93-c81cd14c95ca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:50:40.857506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:40.858549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:40.859786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:40.859786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:40.859786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:40.859786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:40.859786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:50:40.859786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:50:40.859786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:50:40.859786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:50:40.859786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:50:40.859786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:50:40.859786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:50:40.859786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:40.862932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 530/1058] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Aug 22 15:50:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:40.868814 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e936fd-f21f-4829-8962-f89bbd079a73 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:40.885308 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:40.944424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785d5d1-e566-4160-bf93-c81cd14c95ca None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:40.998099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:41.012267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e936fd-f21f-4829-8962-f89bbd079a73 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:41.067518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c58a2-364f-4786-b3e4-b527a1a8c510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:41.068043 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c58a2-364f-4786-b3e4-b527a1a8c510 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:41.068320 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c58a2-364f-4786-b3e4-b527a1a8c510 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:41.068591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c58a2-364f-4786-b3e4-b527a1a8c510 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:41.069273 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c58a2-364f-4786-b3e4-b527a1a8c510 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:41.069579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c58a2-364f-4786-b3e4-b527a1a8c510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:41.069870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785d5d1-e566-4160-bf93-c81cd14c95ca None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:41.071014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c58a2-364f-4786-b3e4-b527a1a8c510 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:41.087120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 529/1059] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Aug 22 15:50:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:41.091616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c58a2-364f-4786-b3e4-b527a1a8c510 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:41.131356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae802f-7a72-47b0-80b6-da126736bf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:41.132465 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae802f-7a72-47b0-80b6-da126736bf9a None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:41.132959 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae802f-7a72-47b0-80b6-da126736bf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:41.133437 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae802f-7a72-47b0-80b6-da126736bf9a None admin] PATH_INFO: `/v3/services/image` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:41.134533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae802f-7a72-47b0-80b6-da126736bf9a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:41.137263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae802f-7a72-47b0-80b6-da126736bf9a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-27ae802f-7a72-47b0-80b6-da126736bf9a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:41.151505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:41.152719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:41.153584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 531/1060] 10.222.0.77 () {56 vars in 1105 bytes} [Mon Aug 22 15:50:40 2022] GET /identity/v3/services/image => generated 86 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:41.162931 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae802f-7a72-47b0-80b6-da126736bf9a None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:41.210386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:41.254524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c58a2-364f-4786-b3e4-b527a1a8c510 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:41.311018 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb19785-8151-4d4d-9a68-ddee3af2cfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:41.311988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb19785-8151-4d4d-9a68-ddee3af2cfda None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:41.312424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb19785-8151-4d4d-9a68-ddee3af2cfda None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:41.312865 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb19785-8151-4d4d-9a68-ddee3af2cfda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:41.319933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae802f-7a72-47b0-80b6-da126736bf9a None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:41.338178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb19785-8151-4d4d-9a68-ddee3af2cfda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:41.339706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb19785-8151-4d4d-9a68-ddee3af2cfda None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:41.339866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ddb19785-8151-4d4d-9a68-ddee3af2cfda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:41.355182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:41.356276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:41.357172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:41.357172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:41.357172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:41.357172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 530/1061] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:41.362386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb19785-8151-4d4d-9a68-ddee3af2cfda None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:41.367756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895eec5-d0d6-4a43-8c15-9d6ed6d81dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:41.368382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895eec5-d0d6-4a43-8c15-9d6ed6d81dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:41.368769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895eec5-d0d6-4a43-8c15-9d6ed6d81dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:41.369026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895eec5-d0d6-4a43-8c15-9d6ed6d81dc7 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:41.369684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895eec5-d0d6-4a43-8c15-9d6ed6d81dc7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:41.369979 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895eec5-d0d6-4a43-8c15-9d6ed6d81dc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:41.371413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895eec5-d0d6-4a43-8c15-9d6ed6d81dc7 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:41.379187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 532/1062] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:41.385124 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895eec5-d0d6-4a43-8c15-9d6ed6d81dc7 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:41.502756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb19785-8151-4d4d-9a68-ddee3af2cfda None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:41.519484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895eec5-d0d6-4a43-8c15-9d6ed6d81dc7 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:41.542387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:41.559790 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8aafec-d06e-4228-bf0d-dde22b9e195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:41.560777 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aafec-d06e-4228-bf0d-dde22b9e195b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:41.560997 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aafec-d06e-4228-bf0d-dde22b9e195b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:41.561336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aafec-d06e-4228-bf0d-dde22b9e195b None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:41.562062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8aafec-d06e-4228-bf0d-dde22b9e195b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:41.562423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8aafec-d06e-4228-bf0d-dde22b9e195b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:41.563914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8aafec-d06e-4228-bf0d-dde22b9e195b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:41.579423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 531/1063] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:41.579874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030767c2-9a49-4312-8456-d58aaf1c4069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:41.580509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030767c2-9a49-4312-8456-d58aaf1c4069 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:41.580784 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030767c2-9a49-4312-8456-d58aaf1c4069 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:41.581049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030767c2-9a49-4312-8456-d58aaf1c4069 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:41.581695 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030767c2-9a49-4312-8456-d58aaf1c4069 None admin] RBAC: Adding query filter params (type=image) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:41.581992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030767c2-9a49-4312-8456-d58aaf1c4069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:41.583426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030767c2-9a49-4312-8456-d58aaf1c4069 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:41.585795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8aafec-d06e-4228-bf0d-dde22b9e195b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:41.590049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 533/1064] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:41.595947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030767c2-9a49-4312-8456-d58aaf1c4069 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:41.649217 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:41.723249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8aafec-d06e-4228-bf0d-dde22b9e195b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:41.735154 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030767c2-9a49-4312-8456-d58aaf1c4069 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:41.766139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589803d-bc92-4f55-9820-49d5f5d8edaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:41.766813 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589803d-bc92-4f55-9820-49d5f5d8edaf None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:41.767091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589803d-bc92-4f55-9820-49d5f5d8edaf None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:41.767363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589803d-bc92-4f55-9820-49d5f5d8edaf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:41.774715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589803d-bc92-4f55-9820-49d5f5d8edaf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:41.776111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61027a43-f255-4735-8280-81a5977fb593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:41.776319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589803d-bc92-4f55-9820-49d5f5d8edaf None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:41.777326 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61027a43-f255-4735-8280-81a5977fb593 None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:41.777779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61027a43-f255-4735-8280-81a5977fb593 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:41.778219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61027a43-f255-4735-8280-81a5977fb593 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:41.779109 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61027a43-f255-4735-8280-81a5977fb593 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:41.780717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61027a43-f255-4735-8280-81a5977fb593 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-e589803d-bc92-4f55-9820-49d5f5d8edaf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:50:41.793044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:41.795175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:41.796635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:41.796635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:41.796635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:50:41.796635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:50:41.796635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:50:41.796635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:50:41.796635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:50:41.796635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:50:41.796635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:50:41.796635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:41.796635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 532/1065] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 22 15:50:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:41.800344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589803d-bc92-4f55-9820-49d5f5d8edaf None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:41.814213 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 534/1066] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 15:50:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:50:41.866577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:41.959378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589803d-bc92-4f55-9820-49d5f5d8edaf None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:42.029822 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59c619-e119-43b3-9f57-2c119cefb472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:42.030386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59c619-e119-43b3-9f57-2c119cefb472 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:42.031404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59c619-e119-43b3-9f57-2c119cefb472 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:42.031404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59c619-e119-43b3-9f57-2c119cefb472 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:42.031689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59c619-e119-43b3-9f57-2c119cefb472 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:42.031985 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59c619-e119-43b3-9f57-2c119cefb472 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:42.033472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59c619-e119-43b3-9f57-2c119cefb472 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:42.055129 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 533/1067] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 22 15:50:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:42.061337 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61027a43-f255-4735-8280-81a5977fb593 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:42.074378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b630da-64f9-425c-9051-585102a291b9 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:42.074695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b630da-64f9-425c-9051-585102a291b9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:42.074975 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b630da-64f9-425c-9051-585102a291b9 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:42.076400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 534/1068] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:42.082256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe32fb2-5cc0-4256-a734-fa42dba0bf57 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:42.082542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe32fb2-5cc0-4256-a734-fa42dba0bf57 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:42.082862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe32fb2-5cc0-4256-a734-fa42dba0bf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:42.101531 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-efe32fb2-5cc0-4256-a734-fa42dba0bf57 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:42.102768 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-efe32fb2-5cc0-4256-a734-fa42dba0bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:42.180401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:42.187954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61027a43-f255-4735-8280-81a5977fb593 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:42.194146 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 535/1069] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:50:42.247551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1423c-3155-4587-ba1f-5caadf22d9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:42.248674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1423c-3155-4587-ba1f-5caadf22d9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:42.249171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1423c-3155-4587-ba1f-5caadf22d9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:42.249658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1423c-3155-4587-ba1f-5caadf22d9d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:42.269020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1423c-3155-4587-ba1f-5caadf22d9d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:42.271590 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1423c-3155-4587-ba1f-5caadf22d9d6 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-54d1423c-3155-4587-ba1f-5caadf22d9d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:42.294914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:42.296473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:42.297853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:42.297853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:42.297853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:42.303244 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 535/1070] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:42.307070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe32fb2-5cc0-4256-a734-fa42dba0bf57 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:42.361252 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:42.446743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe32fb2-5cc0-4256-a734-fa42dba0bf57 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:42.459355 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1423c-3155-4587-ba1f-5caadf22d9d6 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:42.483021 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120664f-1649-40b0-8875-abf0d40c5f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:42.483642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120664f-1649-40b0-8875-abf0d40c5f26 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:42.483921 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120664f-1649-40b0-8875-abf0d40c5f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:42.484196 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120664f-1649-40b0-8875-abf0d40c5f26 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:42.484847 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120664f-1649-40b0-8875-abf0d40c5f26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:42.485144 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120664f-1649-40b0-8875-abf0d40c5f26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:42.486523 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120664f-1649-40b0-8875-abf0d40c5f26 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:42.503356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 536/1071] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:42.511608 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120664f-1649-40b0-8875-abf0d40c5f26 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:42.601782 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1423c-3155-4587-ba1f-5caadf22d9d6 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:42.632232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:42.654630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120664f-1649-40b0-8875-abf0d40c5f26 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:42.658059 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306cad8-19f1-4aff-adda-f838e725276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:42.658864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306cad8-19f1-4aff-adda-f838e725276c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:42.659313 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306cad8-19f1-4aff-adda-f838e725276c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:42.659759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306cad8-19f1-4aff-adda-f838e725276c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:42.676284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306cad8-19f1-4aff-adda-f838e725276c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-0306cad8-19f1-4aff-adda-f838e725276c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:50:42.684767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:42.686808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:42.687707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:42.687707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:42.687707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:42.687707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:42.687707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:50:42.687707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:50:42.687707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:50:42.687707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:50:42.687707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:50:42.687707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:50:42.687707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:50:42.687707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:42.687707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 536/1072] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:50:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:42.693612 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306cad8-19f1-4aff-adda-f838e725276c None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:42.714698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:42.720902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a9b66-b482-44ca-817e-f01a68db6afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:42.722375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9b66-b482-44ca-817e-f01a68db6afc None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:42.722885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9b66-b482-44ca-817e-f01a68db6afc None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:42.723474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9b66-b482-44ca-817e-f01a68db6afc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:42.734431 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a9b66-b482-44ca-817e-f01a68db6afc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:42.736883 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a9b66-b482-44ca-817e-f01a68db6afc None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ad7a9b66-b482-44ca-817e-f01a68db6afc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:50:42.755843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:42.756826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:42.763503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:50:42.763503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:50:42.763503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:50:42.763503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:50:42.763503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:50:42.763503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:50:42.763503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:42.763503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:42.763503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 537/1073] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:42.764070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a9b66-b482-44ca-817e-f01a68db6afc None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:42.848430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306cad8-19f1-4aff-adda-f838e725276c None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:42.888622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a9b66-b482-44ca-817e-f01a68db6afc None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:42.893028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179e622-1a33-44e1-b70a-fe68d075658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:42.893793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179e622-1a33-44e1-b70a-fe68d075658b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:42.893962 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179e622-1a33-44e1-b70a-fe68d075658b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:42.894181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179e622-1a33-44e1-b70a-fe68d075658b None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:42.894903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179e622-1a33-44e1-b70a-fe68d075658b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:42.895237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179e622-1a33-44e1-b70a-fe68d075658b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:42.897009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179e622-1a33-44e1-b70a-fe68d075658b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:42.906997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 537/1074] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:50:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:42.912635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179e622-1a33-44e1-b70a-fe68d075658b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:42.937577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69b293-73cf-4834-9e67-1abdba3cfdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:42.938294 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69b293-73cf-4834-9e67-1abdba3cfdaf None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:42.939152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69b293-73cf-4834-9e67-1abdba3cfdaf None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:42.939493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69b293-73cf-4834-9e67-1abdba3cfdaf None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:42.940268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69b293-73cf-4834-9e67-1abdba3cfdaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:42.940933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69b293-73cf-4834-9e67-1abdba3cfdaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:42.942448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69b293-73cf-4834-9e67-1abdba3cfdaf None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:42.956193 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 538/1075] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:50:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:42.962689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69b293-73cf-4834-9e67-1abdba3cfdaf None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:42.976069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:42.998440 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:43.036567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179e622-1a33-44e1-b70a-fe68d075658b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:43.077366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fca167-49a5-45cf-94f4-73165b9868cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:43.078093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fca167-49a5-45cf-94f4-73165b9868cc None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:43.078548 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fca167-49a5-45cf-94f4-73165b9868cc None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:43.078919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fca167-49a5-45cf-94f4-73165b9868cc None admin] PATH_INFO: `/v3/users/8a404cd3000a4255a819541cd727243c` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:43.080232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fca167-49a5-45cf-94f4-73165b9868cc None admin] RBAC: Authorizing `identity:get_user(user_id=8a404cd3000a4255a819541cd727243c)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:43.081746 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fca167-49a5-45cf-94f4-73165b9868cc None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:43.088544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 538/1076] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:50:42 2022] GET /identity/v3/users/8a404cd3000a4255a819541cd727243c => generated 285 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:43.089456 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fca167-49a5-45cf-94f4-73165b9868cc None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:43.089592 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69b293-73cf-4834-9e67-1abdba3cfdaf None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:43.144069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96620e5c-8750-40dc-b780-818153ece2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:43.145123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96620e5c-8750-40dc-b780-818153ece2b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:43.145638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96620e5c-8750-40dc-b780-818153ece2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:43.146154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96620e5c-8750-40dc-b780-818153ece2b1 None admin] PATH_INFO: `/v3/projects/318c7f21f9d14e149f668863f748e89f/users/20e4a18ab77642baa9adb9a4b49fbcc2/roles/63241abe50fa4120be0a77336cc5e7e0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:43.149550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96620e5c-8750-40dc-b780-818153ece2b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=318c7f21f9d14e149f668863f748e89f, user_id=20e4a18ab77642baa9adb9a4b49fbcc2, role_id=63241abe50fa4120be0a77336cc5e7e0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:43.152212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96620e5c-8750-40dc-b780-818153ece2b1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:43.186637 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 539/1077] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:50:42 2022] PUT /identity/v3/projects/318c7f21f9d14e149f668863f748e89f/users/20e4a18ab77642baa9adb9a4b49fbcc2/roles/63241abe50fa4120be0a77336cc5e7e0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:50:43.248089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fca167-49a5-45cf-94f4-73165b9868cc None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:43.292956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78745a4f-bb2a-438c-9725-4447db0bef7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:43.293629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78745a4f-bb2a-438c-9725-4447db0bef7c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:43.293905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78745a4f-bb2a-438c-9725-4447db0bef7c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:43.294177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78745a4f-bb2a-438c-9725-4447db0bef7c None admin] PATH_INFO: `/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:43.302705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78745a4f-bb2a-438c-9725-4447db0bef7c None admin] RBAC: Authorizing `identity:get_project(project_id=c8b02321bb6148b5bd6b42abaf235cf0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:43.302705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78745a4f-bb2a-438c-9725-4447db0bef7c None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:43.306813 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 539/1078] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:50:43 2022] GET /identity/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0 => generated 311 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:43.311382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96620e5c-8750-40dc-b780-818153ece2b1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:43.413304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:43.473891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96620e5c-8750-40dc-b780-818153ece2b1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:43.521424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92c329-50db-4533-a365-8aa8f86c9a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:43.522405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92c329-50db-4533-a365-8aa8f86c9a10 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:43.522910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92c329-50db-4533-a365-8aa8f86c9a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:43.523368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92c329-50db-4533-a365-8aa8f86c9a10 None admin] PATH_INFO: `/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0/users/8a404cd3000a4255a819541cd727243c/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:43.526188 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92c329-50db-4533-a365-8aa8f86c9a10 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8b02321bb6148b5bd6b42abaf235cf0, user_id=8a404cd3000a4255a819541cd727243c, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:43.527873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92c329-50db-4533-a365-8aa8f86c9a10 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:43.543887 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 540/1079] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:50:43 2022] PUT /identity/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0/users/8a404cd3000a4255a819541cd727243c/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:50:43.799316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ff86-6cd3-4d8d-9391-efc7573b08f1 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:43.800104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ff86-6cd3-4d8d-9391-efc7573b08f1 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:43.800104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ff86-6cd3-4d8d-9391-efc7573b08f1 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:43.801401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 540/1080] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:50:43.807106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec7460-394a-4475-8eb1-2b5e47d5e2fc None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:43.807617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec7460-394a-4475-8eb1-2b5e47d5e2fc None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:43.807617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec7460-394a-4475-8eb1-2b5e47d5e2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:43.826382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d5ec7460-394a-4475-8eb1-2b5e47d5e2fc None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:43.827621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d5ec7460-394a-4475-8eb1-2b5e47d5e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:43.908130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 541/1081] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:44.171437 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6ff86-6cd3-4d8d-9391-efc7573b08f1 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:44.180935 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:44.296673 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6ff86-6cd3-4d8d-9391-efc7573b08f1 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:44.341938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d508e6-a1f0-4bf5-8e78-2cec70660e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:44.342580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d508e6-a1f0-4bf5-8e78-2cec70660e4c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:44.342907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d508e6-a1f0-4bf5-8e78-2cec70660e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:44.343172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d508e6-a1f0-4bf5-8e78-2cec70660e4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:44.417644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d508e6-a1f0-4bf5-8e78-2cec70660e4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:44.419175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d508e6-a1f0-4bf5-8e78-2cec70660e4c None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:44.428896 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:44.537830 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 541/1082] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:50:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 15:50:44.543685 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec7460-394a-4475-8eb1-2b5e47d5e2fc None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:44.609294 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:44.666079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec7460-394a-4475-8eb1-2b5e47d5e2fc None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:44.725512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fc4f9-aaf9-4d54-ab0c-d6e74a57cf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:44.726489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fc4f9-aaf9-4d54-ab0c-d6e74a57cf0f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:44.727053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fc4f9-aaf9-4d54-ab0c-d6e74a57cf0f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:44.727543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fc4f9-aaf9-4d54-ab0c-d6e74a57cf0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:44.744991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fc4f9-aaf9-4d54-ab0c-d6e74a57cf0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:44.746497 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fc4f9-aaf9-4d54-ab0c-d6e74a57cf0f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-8e3fc4f9-aaf9-4d54-ab0c-d6e74a57cf0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:44.762459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:44.764348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:44.766081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:44.766081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:44.766081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:44.770635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 542/1083] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:44.770944 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d508e6-a1f0-4bf5-8e78-2cec70660e4c None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:44.888722 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d508e6-a1f0-4bf5-8e78-2cec70660e4c None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:44.899450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:44.937597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bb0ec-00a9-428a-aba5-dcf5687e6c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:44.938227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bb0ec-00a9-428a-aba5-dcf5687e6c37 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:44.938512 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bb0ec-00a9-428a-aba5-dcf5687e6c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:44.938801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bb0ec-00a9-428a-aba5-dcf5687e6c37 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:44.939452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bb0ec-00a9-428a-aba5-dcf5687e6c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:44.939750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bb0ec-00a9-428a-aba5-dcf5687e6c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:44.941467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bb0ec-00a9-428a-aba5-dcf5687e6c37 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:44.953468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 542/1084] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:45.204999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ba55d-d8c6-4065-8162-a425750c507a None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:45.205534 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ba55d-d8c6-4065-8162-a425750c507a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:45.205835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ba55d-d8c6-4065-8162-a425750c507a None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:45.208230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 543/1085] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:45.214422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4349b-4cdf-4359-b0b4-74301c5cccd0 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:45.214761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4349b-4cdf-4359-b0b4-74301c5cccd0 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:45.215033 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4349b-4cdf-4359-b0b4-74301c5cccd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:45.238537 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-0ff4349b-4cdf-4359-b0b4-74301c5cccd0 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:45.239766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0ff4349b-4cdf-4359-b0b4-74301c5cccd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:45.322019 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 543/1086] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:45.500311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b6e5c-020f-4137-abc8-f71df10d3fe5 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:45.500521 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b6e5c-020f-4137-abc8-f71df10d3fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:45.500758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b6e5c-020f-4137-abc8-f71df10d3fe5 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:45.502289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 544/1087] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:45.507426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131716-83f3-4b85-ad8c-5bbef1be0a26 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:45.507717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131716-83f3-4b85-ad8c-5bbef1be0a26 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:45.507988 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131716-83f3-4b85-ad8c-5bbef1be0a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:45.526379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-ca131716-83f3-4b85-ad8c-5bbef1be0a26 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:45.527615 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ca131716-83f3-4b85-ad8c-5bbef1be0a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:45.585385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b6e5c-020f-4137-abc8-f71df10d3fe5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:45.620929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 544/1088] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:45.712413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b6e5c-020f-4137-abc8-f71df10d3fe5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:45.725549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:45.755154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b038f-da63-4a0f-bfa2-166a97d08eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:45.755743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b038f-da63-4a0f-bfa2-166a97d08eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:45.756013 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b038f-da63-4a0f-bfa2-166a97d08eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:45.756274 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b038f-da63-4a0f-bfa2-166a97d08eb6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:45.769190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b038f-da63-4a0f-bfa2-166a97d08eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-f43b038f-da63-4a0f-bfa2-166a97d08eb6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:50:45.774106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:45.775234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:45.776169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:45.776169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:45.776169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:45.776169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:45.776169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:50:45.776169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:50:45.776169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:50:45.776169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:50:45.776169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:50:45.776169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:50:45.776169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 15:50:45.776169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:45.776169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 545/1089] 10.222.0.77 () {56 vars in 1120 bytes} [Mon Aug 22 15:50:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:45.781756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca131716-83f3-4b85-ad8c-5bbef1be0a26 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:45.811719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:45.892189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca131716-83f3-4b85-ad8c-5bbef1be0a26 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:45.900234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b038f-da63-4a0f-bfa2-166a97d08eb6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:45.932487 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba04920-a167-4a44-9b2b-61f460db660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:45.933213 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba04920-a167-4a44-9b2b-61f460db660e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:45.933546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba04920-a167-4a44-9b2b-61f460db660e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:45.933896 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba04920-a167-4a44-9b2b-61f460db660e None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:45.934819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba04920-a167-4a44-9b2b-61f460db660e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:45.935195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba04920-a167-4a44-9b2b-61f460db660e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:45.936752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba04920-a167-4a44-9b2b-61f460db660e None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:45.946497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 545/1090] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Aug 22 15:50:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:45.952870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba04920-a167-4a44-9b2b-61f460db660e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:46.036013 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b038f-da63-4a0f-bfa2-166a97d08eb6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:46.049512 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:46.062704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba04920-a167-4a44-9b2b-61f460db660e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:46.072184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444cf86-fcc3-48bc-92c5-1e39a940db7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:46.072817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444cf86-fcc3-48bc-92c5-1e39a940db7d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:46.073087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444cf86-fcc3-48bc-92c5-1e39a940db7d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:46.073353 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444cf86-fcc3-48bc-92c5-1e39a940db7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:46.083846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444cf86-fcc3-48bc-92c5-1e39a940db7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-f444cf86-fcc3-48bc-92c5-1e39a940db7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:50:46.088495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:46.089649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:46.090512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:46.090512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:46.090512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:46.090512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:46.090512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:50:46.090512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:50:46.090512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:50:46.090512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:50:46.090512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:50:46.090512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:50:46.090512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:50:46.090512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:50:46.090512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 546/1091] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:50:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:46.096101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444cf86-fcc3-48bc-92c5-1e39a940db7d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:46.104080 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e24a37-dd3e-4d5f-b57d-89f06f056f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:46.104732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e24a37-dd3e-4d5f-b57d-89f06f056f38 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:46.105071 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e24a37-dd3e-4d5f-b57d-89f06f056f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:46.105343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e24a37-dd3e-4d5f-b57d-89f06f056f38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:46.122830 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e24a37-dd3e-4d5f-b57d-89f06f056f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:46.125387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e24a37-dd3e-4d5f-b57d-89f06f056f38 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:46.134270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-c4e24a37-dd3e-4d5f-b57d-89f06f056f38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:46.145405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:46.146468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:46.147447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:46.147447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:46.147447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:46.147897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 546/1092] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:46.153140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e24a37-dd3e-4d5f-b57d-89f06f056f38 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:46.223088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444cf86-fcc3-48bc-92c5-1e39a940db7d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:46.257836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2eb686-1344-4a21-809b-f029b42f99e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:46.258471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eb686-1344-4a21-809b-f029b42f99e6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:46.258762 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eb686-1344-4a21-809b-f029b42f99e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:46.259033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eb686-1344-4a21-809b-f029b42f99e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:46.259771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2eb686-1344-4a21-809b-f029b42f99e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:46.260066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2eb686-1344-4a21-809b-f029b42f99e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:46.261479 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2eb686-1344-4a21-809b-f029b42f99e6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:46.264054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e24a37-dd3e-4d5f-b57d-89f06f056f38 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:46.271731 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 547/1093] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:50:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:46.279263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2eb686-1344-4a21-809b-f029b42f99e6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:46.314866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2f570-5fad-4ff4-9da7-71f4b3b16d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:46.315392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2f570-5fad-4ff4-9da7-71f4b3b16d2e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:46.316010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2f570-5fad-4ff4-9da7-71f4b3b16d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:46.316304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2f570-5fad-4ff4-9da7-71f4b3b16d2e None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:46.316925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2f570-5fad-4ff4-9da7-71f4b3b16d2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:46.317226 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2f570-5fad-4ff4-9da7-71f4b3b16d2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:46.318622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2f570-5fad-4ff4-9da7-71f4b3b16d2e None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:46.328136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:46.339676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 547/1094] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:46.341510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2f570-5fad-4ff4-9da7-71f4b3b16d2e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:46.400557 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:46.409751 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2eb686-1344-4a21-809b-f029b42f99e6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:46.447967 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74616f3f-56ea-4763-a110-2c7e139fd168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:46.448631 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74616f3f-56ea-4763-a110-2c7e139fd168 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:46.448912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74616f3f-56ea-4763-a110-2c7e139fd168 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:46.449185 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74616f3f-56ea-4763-a110-2c7e139fd168 None admin] PATH_INFO: `/v3/users/8a404cd3000a4255a819541cd727243c` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:46.450420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74616f3f-56ea-4763-a110-2c7e139fd168 None admin] RBAC: Authorizing `identity:get_user(user_id=8a404cd3000a4255a819541cd727243c)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:46.451933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74616f3f-56ea-4763-a110-2c7e139fd168 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:46.458536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 548/1095] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:50:46 2022] GET /identity/v3/users/8a404cd3000a4255a819541cd727243c => generated 285 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:46.459769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74616f3f-56ea-4763-a110-2c7e139fd168 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:46.466201 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2f570-5fad-4ff4-9da7-71f4b3b16d2e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:46.505289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33169a41-742c-43d5-8fb8-e72876d78c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:46.505965 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33169a41-742c-43d5-8fb8-e72876d78c5c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:46.506229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33169a41-742c-43d5-8fb8-e72876d78c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:46.506517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33169a41-742c-43d5-8fb8-e72876d78c5c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:46.515022 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33169a41-742c-43d5-8fb8-e72876d78c5c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:46.516514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33169a41-742c-43d5-8fb8-e72876d78c5c None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-33169a41-742c-43d5-8fb8-e72876d78c5c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:50:46.529177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:46.530219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:46.531258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:46.531258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:46.531258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:50:46.531258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:50:46.531258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:50:46.531258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:50:46.531258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:50:46.531258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:50:46.531258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 15:50:46.531258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:46.531258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 548/1096] 10.222.0.77 () {56 vars in 1093 bytes} [Mon Aug 22 15:50:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:46.536847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33169a41-742c-43d5-8fb8-e72876d78c5c None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:46.575385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74616f3f-56ea-4763-a110-2c7e139fd168 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:46.615066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:46.615393 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20cb7f-a9b2-4b67-b15a-87ed201bfa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:46.616552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20cb7f-a9b2-4b67-b15a-87ed201bfa8b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:46.616988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20cb7f-a9b2-4b67-b15a-87ed201bfa8b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:46.617339 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20cb7f-a9b2-4b67-b15a-87ed201bfa8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:46.647328 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:46.657350 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33169a41-742c-43d5-8fb8-e72876d78c5c None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:46.690933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20cb7f-a9b2-4b67-b15a-87ed201bfa8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:46.692431 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20cb7f-a9b2-4b67-b15a-87ed201bfa8b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:46.693073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e88cdd-a1b2-479d-a42d-5cfb21fe5708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:46.693694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e88cdd-a1b2-479d-a42d-5cfb21fe5708 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:46.693966 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e88cdd-a1b2-479d-a42d-5cfb21fe5708 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:46.694227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e88cdd-a1b2-479d-a42d-5cfb21fe5708 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:46.695005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e88cdd-a1b2-479d-a42d-5cfb21fe5708 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:46.695303 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e88cdd-a1b2-479d-a42d-5cfb21fe5708 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:46.696779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e88cdd-a1b2-479d-a42d-5cfb21fe5708 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:46.720104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 549/1097] 10.222.0.77 () {56 vars in 1133 bytes} [Mon Aug 22 15:50:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:46.726079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e88cdd-a1b2-479d-a42d-5cfb21fe5708 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:46.803168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 549/1098] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:50:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 15:50:46.809129 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20cb7f-a9b2-4b67-b15a-87ed201bfa8b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:46.837582 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e88cdd-a1b2-479d-a42d-5cfb21fe5708 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:46.860032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:46.874318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:46.881748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c304a-0c04-4abe-8ce4-fd2f12936309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:46.882707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c304a-0c04-4abe-8ce4-fd2f12936309 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:46.883066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c304a-0c04-4abe-8ce4-fd2f12936309 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:46.883310 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c304a-0c04-4abe-8ce4-fd2f12936309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:46.931533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20cb7f-a9b2-4b67-b15a-87ed201bfa8b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:46.963687 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c304a-0c04-4abe-8ce4-fd2f12936309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:46.965207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c304a-0c04-4abe-8ce4-fd2f12936309 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:46.977666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7404f4-ac51-4281-a1d3-f3928a5316f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:46.978421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7404f4-ac51-4281-a1d3-f3928a5316f9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:46.978725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7404f4-ac51-4281-a1d3-f3928a5316f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:46.978993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7404f4-ac51-4281-a1d3-f3928a5316f9 None admin] PATH_INFO: `/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:46.980181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7404f4-ac51-4281-a1d3-f3928a5316f9 None admin] RBAC: Authorizing `identity:get_project(project_id=c8b02321bb6148b5bd6b42abaf235cf0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:46.981651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7404f4-ac51-4281-a1d3-f3928a5316f9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:46.983370 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 550/1099] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:50:46 2022] GET /identity/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:46.989971 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7404f4-ac51-4281-a1d3-f3928a5316f9 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:47.111920 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7404f4-ac51-4281-a1d3-f3928a5316f9 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:47.123372 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 550/1100] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:50:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:47.129466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c304a-0c04-4abe-8ce4-fd2f12936309 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:47.142709 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:47.150034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:47.152057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ea551-d448-4381-afd5-18dadb6b5fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:47.152947 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ea551-d448-4381-afd5-18dadb6b5fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:47.153308 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ea551-d448-4381-afd5-18dadb6b5fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:47.153658 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ea551-d448-4381-afd5-18dadb6b5fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:47.154484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ea551-d448-4381-afd5-18dadb6b5fc9 None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=c8b02321bb6148b5bd6b42abaf235cf0, user.id=8a404cd3000a4255a819541cd727243c) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:47.154923 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ea551-d448-4381-afd5-18dadb6b5fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:47.156503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ea551-d448-4381-afd5-18dadb6b5fc9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:47.164045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 551/1101] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:50:46 2022] GET /identity/v3/role_assignments?user.id=8a404cd3000a4255a819541cd727243c&scope.project.id=c8b02321bb6148b5bd6b42abaf235cf0&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:50:47.268807 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c304a-0c04-4abe-8ce4-fd2f12936309 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:47.305976 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4fb9d-32de-45cd-a002-8cdf53d2b548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:47.306753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4fb9d-32de-45cd-a002-8cdf53d2b548 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:47.307032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4fb9d-32de-45cd-a002-8cdf53d2b548 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:47.307307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4fb9d-32de-45cd-a002-8cdf53d2b548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:47.319451 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4fb9d-32de-45cd-a002-8cdf53d2b548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:47.320928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4fb9d-32de-45cd-a002-8cdf53d2b548 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-d8c4fb9d-32de-45cd-a002-8cdf53d2b548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:50:47.342501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:47.343754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:50:47.344889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:50:47.344889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:50:47.344889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:47.344889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 551/1102] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:50:47.353699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ea551-d448-4381-afd5-18dadb6b5fc9 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:47.461303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ea551-d448-4381-afd5-18dadb6b5fc9 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:47.496362 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8e03d-1284-4537-9d7e-45d06b64e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:47.497000 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8e03d-1284-4537-9d7e-45d06b64e441 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:47.497277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8e03d-1284-4537-9d7e-45d06b64e441 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:47.497547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8e03d-1284-4537-9d7e-45d06b64e441 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:47.498210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8e03d-1284-4537-9d7e-45d06b64e441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:47.498508 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8e03d-1284-4537-9d7e-45d06b64e441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:47.499928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8e03d-1284-4537-9d7e-45d06b64e441 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:47.513168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 552/1103] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:47.519153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4fb9d-32de-45cd-a002-8cdf53d2b548 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:47.595956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:47.629928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4fb9d-32de-45cd-a002-8cdf53d2b548 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:47.668843 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27264c9-75ed-468f-8923-c018bee93fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:47.669562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27264c9-75ed-468f-8923-c018bee93fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:47.669848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27264c9-75ed-468f-8923-c018bee93fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:47.670112 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27264c9-75ed-468f-8923-c018bee93fb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:47.677573 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27264c9-75ed-468f-8923-c018bee93fb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:47.679076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27264c9-75ed-468f-8923-c018bee93fb3 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-c27264c9-75ed-468f-8923-c018bee93fb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:50:47.691277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:50:47.692387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:50:47.693736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:50:47.693736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:50:47.693736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:50:47.693736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:50:47.693736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:50:47.693736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:50:47.693736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:50:47.693736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:50:47.693736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 552/1104] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:50:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:50:47.698870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8e03d-1284-4537-9d7e-45d06b64e441 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:47.758488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:47.806613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8e03d-1284-4537-9d7e-45d06b64e441 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:47.845423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f838797-037a-4fe5-8d9b-228298fc56cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:47.846061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838797-037a-4fe5-8d9b-228298fc56cd None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:47.846339 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838797-037a-4fe5-8d9b-228298fc56cd None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:47.846621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838797-037a-4fe5-8d9b-228298fc56cd None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:47.848243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f838797-037a-4fe5-8d9b-228298fc56cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:47.848549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f838797-037a-4fe5-8d9b-228298fc56cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:47.850033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f838797-037a-4fe5-8d9b-228298fc56cd None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:47.868134 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 553/1105] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:50:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:47.869439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27264c9-75ed-468f-8923-c018bee93fb3 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:47.976149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27264c9-75ed-468f-8923-c018bee93fb3 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:48.008837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:48.015773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2506e-43ec-4230-9aee-3393be345df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:48.016401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2506e-43ec-4230-9aee-3393be345df2 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:48.016670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2506e-43ec-4230-9aee-3393be345df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:48.016934 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2506e-43ec-4230-9aee-3393be345df2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:48.017654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2506e-43ec-4230-9aee-3393be345df2 None admin] RBAC: Adding query filter params (role.id=63241abe50fa4120be0a77336cc5e7e0, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=20e4a18ab77642baa9adb9a4b49fbcc2) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:48.017967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2506e-43ec-4230-9aee-3393be345df2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:48.019442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2506e-43ec-4230-9aee-3393be345df2 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:48.025602 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 553/1106] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:50:47 2022] GET /identity/v3/role_assignments?user.id=20e4a18ab77642baa9adb9a4b49fbcc2&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=63241abe50fa4120be0a77336cc5e7e0 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:49.147782 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac62ecd-994e-47fe-b6c7-c3a9ee530641 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:49.148384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac62ecd-994e-47fe-b6c7-c3a9ee530641 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:49.148384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac62ecd-994e-47fe-b6c7-c3a9ee530641 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:49.149699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 554/1107] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:49.155609 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35df23-a193-40ac-b60c-d61bc02a12dd None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:49.156410 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35df23-a193-40ac-b60c-d61bc02a12dd None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:49.156410 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35df23-a193-40ac-b60c-d61bc02a12dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:49.177701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-5b35df23-a193-40ac-b60c-d61bc02a12dd None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:49.179088 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5b35df23-a193-40ac-b60c-d61bc02a12dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:49.257112 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 554/1108] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:49.519268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac62ecd-994e-47fe-b6c7-c3a9ee530641 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:49.638362 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac62ecd-994e-47fe-b6c7-c3a9ee530641 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:49.654455 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:49.686019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c4fd2-d47f-4179-b364-0ef7de867bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:49.686673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c4fd2-d47f-4179-b364-0ef7de867bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:49.686955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c4fd2-d47f-4179-b364-0ef7de867bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:49.687225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c4fd2-d47f-4179-b364-0ef7de867bc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:49.688373 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c4fd2-d47f-4179-b364-0ef7de867bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:49.689834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c4fd2-d47f-4179-b364-0ef7de867bc5 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:49.691824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 555/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:50:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:49.697898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35df23-a193-40ac-b60c-d61bc02a12dd None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:49.806366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35df23-a193-40ac-b60c-d61bc02a12dd None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:49.832488 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:49.844930 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be081e-2446-44aa-bbb3-d3e0dd75a78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:49.845545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be081e-2446-44aa-bbb3-d3e0dd75a78a None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:49.845801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be081e-2446-44aa-bbb3-d3e0dd75a78a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:49.846094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be081e-2446-44aa-bbb3-d3e0dd75a78a None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:49.846766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be081e-2446-44aa-bbb3-d3e0dd75a78a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:49.848213 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be081e-2446-44aa-bbb3-d3e0dd75a78a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:49.878902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 555/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:50:49 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:50:51.964057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3792a-8fd4-44be-b0b6-33274eb5055f None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:51.964621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3792a-8fd4-44be-b0b6-33274eb5055f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:51.964621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3792a-8fd4-44be-b0b6-33274eb5055f None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:51.966155 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 556/1111] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:51.972142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a903b-c94d-444a-afc7-bb699065330f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:51.972610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a903b-c94d-444a-afc7-bb699065330f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:51.972686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a903b-c94d-444a-afc7-bb699065330f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:51.991657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-e63a903b-c94d-444a-afc7-bb699065330f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:51.992864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e63a903b-c94d-444a-afc7-bb699065330f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:52.064222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 556/1112] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:50:52.331737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3792a-8fd4-44be-b0b6-33274eb5055f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:52.439763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3792a-8fd4-44be-b0b6-33274eb5055f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:52.475574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db8e2d-9e3b-4bd6-89a2-ac508e4707a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:52.476198 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db8e2d-9e3b-4bd6-89a2-ac508e4707a2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:52.476473 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db8e2d-9e3b-4bd6-89a2-ac508e4707a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:52.476747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db8e2d-9e3b-4bd6-89a2-ac508e4707a2 None admin] PATH_INFO: `/v3/roles/64aca4dbf153454d8abb3af690d90c76` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:52.478287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db8e2d-9e3b-4bd6-89a2-ac508e4707a2 None admin] RBAC: Authorizing `identity:get_role(role_id=64aca4dbf153454d8abb3af690d90c76)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:52.479742 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db8e2d-9e3b-4bd6-89a2-ac508e4707a2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:52.481117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 557/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:50:52 2022] GET /identity/v3/roles/64aca4dbf153454d8abb3af690d90c76 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:52.488023 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a903b-c94d-444a-afc7-bb699065330f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:52.599874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a903b-c94d-444a-afc7-bb699065330f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:52.618091 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:52.646317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922ec85-b34b-4e7c-ad9b-ad8198b5f121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:52.646990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922ec85-b34b-4e7c-ad9b-ad8198b5f121 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:52.647267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922ec85-b34b-4e7c-ad9b-ad8198b5f121 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:52.647533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922ec85-b34b-4e7c-ad9b-ad8198b5f121 None admin] PATH_INFO: `/v3/users/de0dc9cf4e3e469faf933c5d9c1894fc` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:52.661521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922ec85-b34b-4e7c-ad9b-ad8198b5f121 None admin] RBAC: Authorizing `identity:get_user(user_id=de0dc9cf4e3e469faf933c5d9c1894fc)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:52.663017 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922ec85-b34b-4e7c-ad9b-ad8198b5f121 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:52.664658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 557/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:50:52 2022] GET /identity/v3/users/de0dc9cf4e3e469faf933c5d9c1894fc => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:52.670950 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db8e2d-9e3b-4bd6-89a2-ac508e4707a2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:52.726804 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:52.784868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db8e2d-9e3b-4bd6-89a2-ac508e4707a2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:52.820337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c39b6d-fcde-4df3-bdcf-cc970d554649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:52.820936 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c39b6d-fcde-4df3-bdcf-cc970d554649 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:52.821210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c39b6d-fcde-4df3-bdcf-cc970d554649 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:52.821472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c39b6d-fcde-4df3-bdcf-cc970d554649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:52.897448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c39b6d-fcde-4df3-bdcf-cc970d554649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:52.898687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c39b6d-fcde-4df3-bdcf-cc970d554649 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:52.950209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:53.004050 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 558/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:50:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 15:50:53.010277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922ec85-b34b-4e7c-ad9b-ad8198b5f121 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:53.117786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922ec85-b34b-4e7c-ad9b-ad8198b5f121 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:53.157167 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393da4d1-ffab-45b5-b8c9-50ab219bd36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:53.157716 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da4d1-ffab-45b5-b8c9-50ab219bd36d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:53.157992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da4d1-ffab-45b5-b8c9-50ab219bd36d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:53.158261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da4d1-ffab-45b5-b8c9-50ab219bd36d None admin] PATH_INFO: `/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:53.159567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393da4d1-ffab-45b5-b8c9-50ab219bd36d None admin] RBAC: Authorizing `identity:get_project(project_id=c8b02321bb6148b5bd6b42abaf235cf0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:53.161041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393da4d1-ffab-45b5-b8c9-50ab219bd36d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:53.162756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 558/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:50:53 2022] GET /identity/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:53.169433 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c39b6d-fcde-4df3-bdcf-cc970d554649 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:53.276537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c39b6d-fcde-4df3-bdcf-cc970d554649 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:53.317975 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c1c76-1610-402f-9d7d-5b38552940a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:53.318943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c1c76-1610-402f-9d7d-5b38552940a2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:53.319374 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c1c76-1610-402f-9d7d-5b38552940a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:53.319805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c1c76-1610-402f-9d7d-5b38552940a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:53.320988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c1c76-1610-402f-9d7d-5b38552940a2 None admin] RBAC: Adding query filter params (role.id=64aca4dbf153454d8abb3af690d90c76, scope.project.id=c8b02321bb6148b5bd6b42abaf235cf0, user.id=de0dc9cf4e3e469faf933c5d9c1894fc) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:53.321419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c1c76-1610-402f-9d7d-5b38552940a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:53.323749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c1c76-1610-402f-9d7d-5b38552940a2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:53.329812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 559/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:50:53 2022] GET /identity/v3/role_assignments?user.id=de0dc9cf4e3e469faf933c5d9c1894fc&scope.project.id=c8b02321bb6148b5bd6b42abaf235cf0&role.id=64aca4dbf153454d8abb3af690d90c76 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:55.232977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0195cd-2f32-40e3-a484-815d76166cde None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:55.233632 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0195cd-2f32-40e3-a484-815d76166cde None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:55.233632 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0195cd-2f32-40e3-a484-815d76166cde None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:55.234924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 559/1118] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:55.240797 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882f59d-8967-4ccf-a3d5-148ac320c3d8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:55.241385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882f59d-8967-4ccf-a3d5-148ac320c3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:55.241385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882f59d-8967-4ccf-a3d5-148ac320c3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:55.260438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5882f59d-8967-4ccf-a3d5-148ac320c3d8 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:55.261668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5882f59d-8967-4ccf-a3d5-148ac320c3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:55.270066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:55.338489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 560/1119] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:55.603998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0195cd-2f32-40e3-a484-815d76166cde None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:55.645596 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:55.718088 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0195cd-2f32-40e3-a484-815d76166cde None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:55.754905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d32294-773d-41a4-a367-9318f7285a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:55.755556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32294-773d-41a4-a367-9318f7285a8d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:55.755829 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32294-773d-41a4-a367-9318f7285a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:55.756100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32294-773d-41a4-a367-9318f7285a8d None admin] PATH_INFO: `/v3/roles/64aca4dbf153454d8abb3af690d90c76` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:55.757592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d32294-773d-41a4-a367-9318f7285a8d None admin] RBAC: Authorizing `identity:get_role(role_id=64aca4dbf153454d8abb3af690d90c76)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:55.759015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d32294-773d-41a4-a367-9318f7285a8d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:55.760375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 560/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:50:55 2022] GET /identity/v3/roles/64aca4dbf153454d8abb3af690d90c76 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:55.767065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882f59d-8967-4ccf-a3d5-148ac320c3d8 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:55.870684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882f59d-8967-4ccf-a3d5-148ac320c3d8 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:55.905471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279a11-a310-4429-9237-64f45d8da872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:55.906117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279a11-a310-4429-9237-64f45d8da872 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:55.906392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279a11-a310-4429-9237-64f45d8da872 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:55.906686 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279a11-a310-4429-9237-64f45d8da872 None admin] PATH_INFO: `/v3/users/de0dc9cf4e3e469faf933c5d9c1894fc` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:55.907867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3279a11-a310-4429-9237-64f45d8da872 None admin] RBAC: Authorizing `identity:get_user(user_id=de0dc9cf4e3e469faf933c5d9c1894fc)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:55.909322 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3279a11-a310-4429-9237-64f45d8da872 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:55.911027 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 561/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:50:55 2022] GET /identity/v3/users/de0dc9cf4e3e469faf933c5d9c1894fc => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:55.917880 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d32294-773d-41a4-a367-9318f7285a8d None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:56.038388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d32294-773d-41a4-a367-9318f7285a8d None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:56.040676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:56.075771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de997af-0f9c-4a08-b887-20ab10360de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:56.076472 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de997af-0f9c-4a08-b887-20ab10360de4 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:56.076786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de997af-0f9c-4a08-b887-20ab10360de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:56.077090 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de997af-0f9c-4a08-b887-20ab10360de4 None admin] PATH_INFO: `/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:56.078445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de997af-0f9c-4a08-b887-20ab10360de4 None admin] RBAC: Authorizing `identity:get_project(project_id=c8b02321bb6148b5bd6b42abaf235cf0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:56.080028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de997af-0f9c-4a08-b887-20ab10360de4 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:56.081712 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 561/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:50:55 2022] GET /identity/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:56.088406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279a11-a310-4429-9237-64f45d8da872 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:56.102251 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:56.198618 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279a11-a310-4429-9237-64f45d8da872 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:56.236880 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd5bc6-b6f7-4cd8-80b7-4a98706f2afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:56.237560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd5bc6-b6f7-4cd8-80b7-4a98706f2afb None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:56.237834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd5bc6-b6f7-4cd8-80b7-4a98706f2afb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:56.238102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd5bc6-b6f7-4cd8-80b7-4a98706f2afb None admin] PATH_INFO: `/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0/users/de0dc9cf4e3e469faf933c5d9c1894fc/roles/64aca4dbf153454d8abb3af690d90c76` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:56.240483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd5bc6-b6f7-4cd8-80b7-4a98706f2afb None admin] RBAC: Authorizing `identity:create_grant(project_id=c8b02321bb6148b5bd6b42abaf235cf0, user_id=de0dc9cf4e3e469faf933c5d9c1894fc, role_id=64aca4dbf153454d8abb3af690d90c76)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:56.242483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd5bc6-b6f7-4cd8-80b7-4a98706f2afb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:56.261155 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 562/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:50:56 2022] PUT /identity/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0/users/de0dc9cf4e3e469faf933c5d9c1894fc/roles/64aca4dbf153454d8abb3af690d90c76 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:50:58.147315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd321f3-d356-489d-90b3-ba6de86775c7 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:58.148168 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd321f3-d356-489d-90b3-ba6de86775c7 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:58.148168 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd321f3-d356-489d-90b3-ba6de86775c7 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:58.150319 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 562/1124] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:50:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:50:58.156045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fc094-1bea-4006-ad18-e26a7dab5cda None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:58.156472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fc094-1bea-4006-ad18-e26a7dab5cda None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:58.156579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fc094-1bea-4006-ad18-e26a7dab5cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:58.176889 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7e3fc094-1bea-4006-ad18-e26a7dab5cda None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:50:58.178072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7e3fc094-1bea-4006-ad18-e26a7dab5cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:50:58.246361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:58.251567 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 563/1125] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:50:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:50:58.516432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd321f3-d356-489d-90b3-ba6de86775c7 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:58.624225 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd321f3-d356-489d-90b3-ba6de86775c7 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:58.660129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862ae5-ff9f-4c06-a811-aa9b50df7b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:58.660757 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862ae5-ff9f-4c06-a811-aa9b50df7b51 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:58.661035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862ae5-ff9f-4c06-a811-aa9b50df7b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:58.661314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862ae5-ff9f-4c06-a811-aa9b50df7b51 None admin] PATH_INFO: `/v3/roles/64aca4dbf153454d8abb3af690d90c76` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:58.662742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91862ae5-ff9f-4c06-a811-aa9b50df7b51 None admin] RBAC: Authorizing `identity:get_role(role_id=64aca4dbf153454d8abb3af690d90c76)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:58.665044 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91862ae5-ff9f-4c06-a811-aa9b50df7b51 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:58.667629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 563/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:50:58 2022] GET /identity/v3/roles/64aca4dbf153454d8abb3af690d90c76 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:58.674717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fc094-1bea-4006-ad18-e26a7dab5cda None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:58.791577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fc094-1bea-4006-ad18-e26a7dab5cda None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:58.826767 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23443d7-ce7a-49ba-b511-2b5fb4f00ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:58.827395 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23443d7-ce7a-49ba-b511-2b5fb4f00ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:58.827667 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23443d7-ce7a-49ba-b511-2b5fb4f00ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:58.827935 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23443d7-ce7a-49ba-b511-2b5fb4f00ac3 None admin] PATH_INFO: `/v3/users/de0dc9cf4e3e469faf933c5d9c1894fc` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:58.829149 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23443d7-ce7a-49ba-b511-2b5fb4f00ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=de0dc9cf4e3e469faf933c5d9c1894fc)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:58.830628 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23443d7-ce7a-49ba-b511-2b5fb4f00ac3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:58.832254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 564/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:50:58 2022] GET /identity/v3/users/de0dc9cf4e3e469faf933c5d9c1894fc => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:58.840973 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862ae5-ff9f-4c06-a811-aa9b50df7b51 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:58.888731 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:58.963992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862ae5-ff9f-4c06-a811-aa9b50df7b51 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:59.000033 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1a0cb-dfd6-484b-8ae8-7b8561f1b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:59.000650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1a0cb-dfd6-484b-8ae8-7b8561f1b3ff None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:59.000927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1a0cb-dfd6-484b-8ae8-7b8561f1b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:59.001191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1a0cb-dfd6-484b-8ae8-7b8561f1b3ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:59.073557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1a0cb-dfd6-484b-8ae8-7b8561f1b3ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:59.074987 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1a0cb-dfd6-484b-8ae8-7b8561f1b3ff None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:59.117532 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:59.192136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 564/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:50:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:50:59.198986 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23443d7-ce7a-49ba-b511-2b5fb4f00ac3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:59.266193 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:50:59.303034 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23443d7-ce7a-49ba-b511-2b5fb4f00ac3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:59.349863 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205b964-4129-4ac0-9b94-dc1e3febe98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:59.350517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205b964-4129-4ac0-9b94-dc1e3febe98e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:59.350818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205b964-4129-4ac0-9b94-dc1e3febe98e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:59.351087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205b964-4129-4ac0-9b94-dc1e3febe98e None admin] PATH_INFO: `/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:59.352289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205b964-4129-4ac0-9b94-dc1e3febe98e None admin] RBAC: Authorizing `identity:get_project(project_id=c8b02321bb6148b5bd6b42abaf235cf0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:59.353749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205b964-4129-4ac0-9b94-dc1e3febe98e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:59.355482 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 565/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:50:59 2022] GET /identity/v3/projects/c8b02321bb6148b5bd6b42abaf235cf0 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:50:59.362315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1a0cb-dfd6-484b-8ae8-7b8561f1b3ff None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:50:59.473520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1a0cb-dfd6-484b-8ae8-7b8561f1b3ff None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:50:59.511510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d782517-9b49-441b-a9e1-063b2b0131c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:50:59.512111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d782517-9b49-441b-a9e1-063b2b0131c3 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:50:59.512388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d782517-9b49-441b-a9e1-063b2b0131c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:50:59.512659 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d782517-9b49-441b-a9e1-063b2b0131c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:50:59.513380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d782517-9b49-441b-a9e1-063b2b0131c3 None admin] RBAC: Adding query filter params (role.id=64aca4dbf153454d8abb3af690d90c76, scope.project.id=c8b02321bb6148b5bd6b42abaf235cf0, user.id=de0dc9cf4e3e469faf933c5d9c1894fc) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:50:59.513689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d782517-9b49-441b-a9e1-063b2b0131c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:50:59.515166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d782517-9b49-441b-a9e1-063b2b0131c3 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:50:59.521106 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 565/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:50:59 2022] GET /identity/v3/role_assignments?user.id=de0dc9cf4e3e469faf933c5d9c1894fc&scope.project.id=c8b02321bb6148b5bd6b42abaf235cf0&role.id=64aca4dbf153454d8abb3af690d90c76 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:01.432617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1eb67-c6e8-4d10-8b07-31db4df7e107 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:01.434004 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1eb67-c6e8-4d10-8b07-31db4df7e107 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:01.434004 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1eb67-c6e8-4d10-8b07-31db4df7e107 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:01.435498 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 566/1131] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:01.440635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ad40-d81b-43ab-9731-bf447924ded1 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:01.441243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ad40-d81b-43ab-9731-bf447924ded1 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:01.441243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256ad40-d81b-43ab-9731-bf447924ded1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:01.449511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:01.461514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-d256ad40-d81b-43ab-9731-bf447924ded1 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:01.462797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d256ad40-d81b-43ab-9731-bf447924ded1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:01.530177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 566/1132] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:51:01.795934 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1eb67-c6e8-4d10-8b07-31db4df7e107 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:01.911989 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1eb67-c6e8-4d10-8b07-31db4df7e107 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:01.951170 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21adb0a-cb1e-49be-9859-bf40f0d3ad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:01.951797 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21adb0a-cb1e-49be-9859-bf40f0d3ad4d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:01.952070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21adb0a-cb1e-49be-9859-bf40f0d3ad4d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:01.952346 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21adb0a-cb1e-49be-9859-bf40f0d3ad4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:01.953604 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21adb0a-cb1e-49be-9859-bf40f0d3ad4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:01.955088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21adb0a-cb1e-49be-9859-bf40f0d3ad4d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:01.956687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 567/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:51:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:51:01.963148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256ad40-d81b-43ab-9731-bf447924ded1 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:02.072069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256ad40-d81b-43ab-9731-bf447924ded1 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:02.106704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a904fe9-d38e-498d-b6ab-d095416bf74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:02.107320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904fe9-d38e-498d-b6ab-d095416bf74f None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:02.107593 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904fe9-d38e-498d-b6ab-d095416bf74f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:02.107857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904fe9-d38e-498d-b6ab-d095416bf74f None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:02.108506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a904fe9-d38e-498d-b6ab-d095416bf74f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:02.109958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a904fe9-d38e-498d-b6ab-d095416bf74f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:02.114842 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:02.148153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 567/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 22 15:51:01 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:51:04.115054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17c6b5-30c8-4a3a-b9b8-3fe76af7ed6a None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:04.115628 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17c6b5-30c8-4a3a-b9b8-3fe76af7ed6a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:04.115628 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17c6b5-30c8-4a3a-b9b8-3fe76af7ed6a None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:04.116950 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 568/1135] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:04.122593 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744b43f-887f-4b3d-af64-99ff7472a6da None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:04.123085 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744b43f-887f-4b3d-af64-99ff7472a6da None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:04.123178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744b43f-887f-4b3d-af64-99ff7472a6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:04.142058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-2744b43f-887f-4b3d-af64-99ff7472a6da None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:04.143323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-2744b43f-887f-4b3d-af64-99ff7472a6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:04.215977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 568/1136] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:51:04.478302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17c6b5-30c8-4a3a-b9b8-3fe76af7ed6a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:04.483583 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:04.610307 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17c6b5-30c8-4a3a-b9b8-3fe76af7ed6a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:04.647317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0503dc-29a7-4a33-be7e-470457e6714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:04.647959 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0503dc-29a7-4a33-be7e-470457e6714b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:04.648230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0503dc-29a7-4a33-be7e-470457e6714b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:04.648505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0503dc-29a7-4a33-be7e-470457e6714b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:04.649640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0503dc-29a7-4a33-be7e-470457e6714b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:04.651119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0503dc-29a7-4a33-be7e-470457e6714b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:04.652790 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 569/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:51:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:04.660054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744b43f-887f-4b3d-af64-99ff7472a6da None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:04.767561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744b43f-887f-4b3d-af64-99ff7472a6da None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:04.798261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:04.818347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa46f10-4d16-4e90-98df-d1efabf36581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:04.819002 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa46f10-4d16-4e90-98df-d1efabf36581 None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:04.819286 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa46f10-4d16-4e90-98df-d1efabf36581 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:04.819555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa46f10-4d16-4e90-98df-d1efabf36581 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:04.820230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa46f10-4d16-4e90-98df-d1efabf36581 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:04.821687 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa46f10-4d16-4e90-98df-d1efabf36581 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:04.846949 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 569/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:51:04 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:51:06.859450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad6d0-5312-4bca-8a25-981ef8aa6af6 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:06.860102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad6d0-5312-4bca-8a25-981ef8aa6af6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:06.860102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ad6d0-5312-4bca-8a25-981ef8aa6af6 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:06.861342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 570/1139] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:06.867557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a5560-d9ed-488b-a476-6436bff16d5a None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:06.868062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a5560-d9ed-488b-a476-6436bff16d5a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:06.868150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a5560-d9ed-488b-a476-6436bff16d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:06.889059 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-695a5560-d9ed-488b-a476-6436bff16d5a None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:06.890323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-695a5560-d9ed-488b-a476-6436bff16d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:06.965907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 570/1140] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:51:07.227767 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ad6d0-5312-4bca-8a25-981ef8aa6af6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:07.320572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:07.356620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ad6d0-5312-4bca-8a25-981ef8aa6af6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:07.394195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9aaa6-e181-4568-a8f2-4c62e4185cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:07.394858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9aaa6-e181-4568-a8f2-4c62e4185cdb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:07.395135 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9aaa6-e181-4568-a8f2-4c62e4185cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:07.395401 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9aaa6-e181-4568-a8f2-4c62e4185cdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:07.406936 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9aaa6-e181-4568-a8f2-4c62e4185cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ced9aaa6-e181-4568-a8f2-4c62e4185cdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:51:07.411773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:51:07.415119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:51:07.416208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:51:07.416208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:51:07.416208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:51:07.416208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:51:07.416208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:51:07.416208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:51:07.416208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:51:07.416208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:51:07.416208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:51:07.416208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:51:07.416208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:51:07.416208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:51:07.416208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 571/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:51:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:51:07.420825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a5560-d9ed-488b-a476-6436bff16d5a None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:07.530379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a5560-d9ed-488b-a476-6436bff16d5a None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:07.532009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:07.577779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ddd58-6568-46bc-97b7-ac125b138bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:07.578389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ddd58-6568-46bc-97b7-ac125b138bba None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:07.578689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ddd58-6568-46bc-97b7-ac125b138bba None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:07.578959 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ddd58-6568-46bc-97b7-ac125b138bba None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:07.579646 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ddd58-6568-46bc-97b7-ac125b138bba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:51:07.579944 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ddd58-6568-46bc-97b7-ac125b138bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:07.581347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ddd58-6568-46bc-97b7-ac125b138bba None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:07.591639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 571/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:51:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:07.597779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9aaa6-e181-4568-a8f2-4c62e4185cdb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:07.707415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9aaa6-e181-4568-a8f2-4c62e4185cdb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:07.738587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:07.744331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d99d6-eb79-4aed-b050-fee03847fc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:07.744982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d99d6-eb79-4aed-b050-fee03847fc99 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:07.745264 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d99d6-eb79-4aed-b050-fee03847fc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:07.745537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d99d6-eb79-4aed-b050-fee03847fc99 None admin] PATH_INFO: `/v3/users/53820ead500b44e1bf9b2d4be853f6c6` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:07.760165 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d99d6-eb79-4aed-b050-fee03847fc99 None admin] RBAC: Authorizing `identity:get_user(user_id=53820ead500b44e1bf9b2d4be853f6c6)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:07.761717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d99d6-eb79-4aed-b050-fee03847fc99 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:07.763519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 572/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:51:07 2022] GET /identity/v3/users/53820ead500b44e1bf9b2d4be853f6c6 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:07.770213 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ddd58-6568-46bc-97b7-ac125b138bba None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:07.876514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ddd58-6568-46bc-97b7-ac125b138bba None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:07.925451 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647ea93-a224-4cd6-b154-040bc50e118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:07.926068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647ea93-a224-4cd6-b154-040bc50e118c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:07.926340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647ea93-a224-4cd6-b154-040bc50e118c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:07.926644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647ea93-a224-4cd6-b154-040bc50e118c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:07.963342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:08.017240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647ea93-a224-4cd6-b154-040bc50e118c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:08.019646 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647ea93-a224-4cd6-b154-040bc50e118c None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:08.129944 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 572/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:51:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:51:08.136539 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d99d6-eb79-4aed-b050-fee03847fc99 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:08.245137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d99d6-eb79-4aed-b050-fee03847fc99 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:08.280127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba05b36-c468-4a68-b9c7-edb0820c0ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:08.280775 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba05b36-c468-4a68-b9c7-edb0820c0ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:08.281052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba05b36-c468-4a68-b9c7-edb0820c0ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:08.281323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba05b36-c468-4a68-b9c7-edb0820c0ff3 None admin] PATH_INFO: `/v3/projects/073c2222b8f9497db83d702fe31e3b15` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:08.282485 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba05b36-c468-4a68-b9c7-edb0820c0ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=073c2222b8f9497db83d702fe31e3b15)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:08.284012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba05b36-c468-4a68-b9c7-edb0820c0ff3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:08.285673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 573/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:51:08 2022] GET /identity/v3/projects/073c2222b8f9497db83d702fe31e3b15 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:08.293011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647ea93-a224-4cd6-b154-040bc50e118c None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:08.370194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:08.411396 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647ea93-a224-4cd6-b154-040bc50e118c None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:08.448615 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada337c-7172-4d8f-ac1a-05b33075f3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:08.449450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada337c-7172-4d8f-ac1a-05b33075f3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:08.449802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada337c-7172-4d8f-ac1a-05b33075f3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:08.450079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada337c-7172-4d8f-ac1a-05b33075f3f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:08.451053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada337c-7172-4d8f-ac1a-05b33075f3f8 None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=073c2222b8f9497db83d702fe31e3b15, user.id=53820ead500b44e1bf9b2d4be853f6c6) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:51:08.451356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada337c-7172-4d8f-ac1a-05b33075f3f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:08.453073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada337c-7172-4d8f-ac1a-05b33075f3f8 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:08.459433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 573/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:51:08 2022] GET /identity/v3/role_assignments?user.id=53820ead500b44e1bf9b2d4be853f6c6&scope.project.id=073c2222b8f9497db83d702fe31e3b15&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:10.393523 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ed1a1-ccc7-425b-aa61-d49ca92e794f None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:10.394124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ed1a1-ccc7-425b-aa61-d49ca92e794f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:10.394124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ed1a1-ccc7-425b-aa61-d49ca92e794f None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:10.395486 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 574/1147] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:10.401071 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0885-9c21-4dfc-bd27-638c78376c4b None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:10.401654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0885-9c21-4dfc-bd27-638c78376c4b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:10.401654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0885-9c21-4dfc-bd27-638c78376c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:10.421309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-f07c0885-9c21-4dfc-bd27-638c78376c4b None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:10.422552 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f07c0885-9c21-4dfc-bd27-638c78376c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:10.512347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 574/1148] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:51:10.780831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ed1a1-ccc7-425b-aa61-d49ca92e794f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:10.849555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:10.905951 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ed1a1-ccc7-425b-aa61-d49ca92e794f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:10.945859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a95681-0f16-41f5-ad4e-edf66680b7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:10.946508 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a95681-0f16-41f5-ad4e-edf66680b7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:10.946813 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a95681-0f16-41f5-ad4e-edf66680b7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:10.947086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a95681-0f16-41f5-ad4e-edf66680b7a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:10.959320 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a95681-0f16-41f5-ad4e-edf66680b7a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-44a95681-0f16-41f5-ad4e-edf66680b7a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:51:10.964122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:51:10.965249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:51:10.966330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:51:10.966330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:51:10.966330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:51:10.966330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:51:10.966330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:51:10.966330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:51:10.966330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:51:10.966330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:51:10.966330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:51:10.966330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:51:10.966330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:51:10.966330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:51:10.966330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 575/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:51:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:51:10.973580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c0885-9c21-4dfc-bd27-638c78376c4b None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:11.037057 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:11.101554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c0885-9c21-4dfc-bd27-638c78376c4b None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:11.141259 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1261ac6-3d9b-4b79-a696-af18311d0cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:11.141880 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1261ac6-3d9b-4b79-a696-af18311d0cae None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:11.142159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1261ac6-3d9b-4b79-a696-af18311d0cae None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:11.142429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1261ac6-3d9b-4b79-a696-af18311d0cae None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:11.143147 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1261ac6-3d9b-4b79-a696-af18311d0cae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:51:11.143449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1261ac6-3d9b-4b79-a696-af18311d0cae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:11.144877 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1261ac6-3d9b-4b79-a696-af18311d0cae None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:11.154457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 575/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:51:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:11.160583 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a95681-0f16-41f5-ad4e-edf66680b7a4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:11.272239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a95681-0f16-41f5-ad4e-edf66680b7a4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:11.292259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:11.319634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4475257-fac2-4403-a6c9-99d76f7961fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:11.320416 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4475257-fac2-4403-a6c9-99d76f7961fe None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:11.320729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4475257-fac2-4403-a6c9-99d76f7961fe None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:11.321036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4475257-fac2-4403-a6c9-99d76f7961fe None admin] PATH_INFO: `/v3/users/53820ead500b44e1bf9b2d4be853f6c6` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:11.322816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4475257-fac2-4403-a6c9-99d76f7961fe None admin] RBAC: Authorizing `identity:get_user(user_id=53820ead500b44e1bf9b2d4be853f6c6)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:11.325374 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4475257-fac2-4403-a6c9-99d76f7961fe None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:11.328140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 576/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:51:11 2022] GET /identity/v3/users/53820ead500b44e1bf9b2d4be853f6c6 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:51:11.334459 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1261ac6-3d9b-4b79-a696-af18311d0cae None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:11.448518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1261ac6-3d9b-4b79-a696-af18311d0cae None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:11.469948 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:11.485213 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90baf5-5134-41f4-8305-e9c52eed9e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:11.485857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90baf5-5134-41f4-8305-e9c52eed9e30 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:11.486126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90baf5-5134-41f4-8305-e9c52eed9e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:11.486391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90baf5-5134-41f4-8305-e9c52eed9e30 None admin] PATH_INFO: `/v3/projects/073c2222b8f9497db83d702fe31e3b15` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:11.487626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90baf5-5134-41f4-8305-e9c52eed9e30 None admin] RBAC: Authorizing `identity:get_project(project_id=073c2222b8f9497db83d702fe31e3b15)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:11.489086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90baf5-5134-41f4-8305-e9c52eed9e30 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:11.490793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 576/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:51:11 2022] GET /identity/v3/projects/073c2222b8f9497db83d702fe31e3b15 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:11.497094 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4475257-fac2-4403-a6c9-99d76f7961fe None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:11.605803 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4475257-fac2-4403-a6c9-99d76f7961fe None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:11.641655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b394c-06a0-4082-a8ba-599882df021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:11.642331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b394c-06a0-4082-a8ba-599882df021a None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:11.642640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b394c-06a0-4082-a8ba-599882df021a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:11.642903 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b394c-06a0-4082-a8ba-599882df021a None admin] PATH_INFO: `/v3/projects/073c2222b8f9497db83d702fe31e3b15/users/53820ead500b44e1bf9b2d4be853f6c6/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:11.644976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b394c-06a0-4082-a8ba-599882df021a None admin] RBAC: Authorizing `identity:create_grant(project_id=073c2222b8f9497db83d702fe31e3b15, user_id=53820ead500b44e1bf9b2d4be853f6c6, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:11.646447 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b394c-06a0-4082-a8ba-599882df021a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:11.663978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 577/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:51:11 2022] PUT /identity/v3/projects/073c2222b8f9497db83d702fe31e3b15/users/53820ead500b44e1bf9b2d4be853f6c6/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:51:13.555777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c9789-f357-45e7-b587-2247daa4d507 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:13.556360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c9789-f357-45e7-b587-2247daa4d507 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:13.556360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c9789-f357-45e7-b587-2247daa4d507 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:13.557674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 577/1154] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:13.564383 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38387440-19b2-4e3c-96db-58ff29fcc36e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:13.565449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38387440-19b2-4e3c-96db-58ff29fcc36e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:13.565726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38387440-19b2-4e3c-96db-58ff29fcc36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:13.586357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-38387440-19b2-4e3c-96db-58ff29fcc36e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:13.587521 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-38387440-19b2-4e3c-96db-58ff29fcc36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:13.637028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:13.665339 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 578/1155] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:51:13.928980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c9789-f357-45e7-b587-2247daa4d507 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:14.053744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c9789-f357-45e7-b587-2247daa4d507 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:14.090017 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e3770-83ce-400c-8368-025d42348a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:14.090656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e3770-83ce-400c-8368-025d42348a8c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:14.090947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e3770-83ce-400c-8368-025d42348a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:14.091218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e3770-83ce-400c-8368-025d42348a8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:14.102910 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e3770-83ce-400c-8368-025d42348a8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-504e3770-83ce-400c-8368-025d42348a8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:51:14.107560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:51:14.108650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:51:14.109502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:51:14.109502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:51:14.109502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:51:14.109502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:51:14.109502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:51:14.109502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:51:14.109502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:51:14.109502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:51:14.109502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:51:14.109502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:51:14.109502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:51:14.109502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:51:14.109502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 578/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:51:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:51:14.115264 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38387440-19b2-4e3c-96db-58ff29fcc36e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:14.219743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38387440-19b2-4e3c-96db-58ff29fcc36e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:14.253567 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165880b-b918-418b-9d9d-029fea3235b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:14.254182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165880b-b918-418b-9d9d-029fea3235b2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:14.254466 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165880b-b918-418b-9d9d-029fea3235b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:14.254763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165880b-b918-418b-9d9d-029fea3235b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:14.255433 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165880b-b918-418b-9d9d-029fea3235b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:51:14.255741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165880b-b918-418b-9d9d-029fea3235b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:14.257130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165880b-b918-418b-9d9d-029fea3235b2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:14.265955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 579/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:51:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:14.272828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e3770-83ce-400c-8368-025d42348a8c None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:14.343471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:14.401295 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e3770-83ce-400c-8368-025d42348a8c None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:14.444247 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a083a50-51c7-45a9-a6f6-c5925c95e1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:14.444883 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a083a50-51c7-45a9-a6f6-c5925c95e1df None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:14.445162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a083a50-51c7-45a9-a6f6-c5925c95e1df None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:14.445436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a083a50-51c7-45a9-a6f6-c5925c95e1df None admin] PATH_INFO: `/v3/users/53820ead500b44e1bf9b2d4be853f6c6` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:14.446644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a083a50-51c7-45a9-a6f6-c5925c95e1df None admin] RBAC: Authorizing `identity:get_user(user_id=53820ead500b44e1bf9b2d4be853f6c6)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:14.448140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a083a50-51c7-45a9-a6f6-c5925c95e1df None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:14.449782 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 579/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:51:14 2022] GET /identity/v3/users/53820ead500b44e1bf9b2d4be853f6c6 => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:14.456226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165880b-b918-418b-9d9d-029fea3235b2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:14.501441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:14.567017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165880b-b918-418b-9d9d-029fea3235b2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:14.605815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb06bf-cba2-4489-999e-fedb32cd4219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:14.606427 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb06bf-cba2-4489-999e-fedb32cd4219 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:14.606733 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb06bf-cba2-4489-999e-fedb32cd4219 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:14.607011 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb06bf-cba2-4489-999e-fedb32cd4219 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:14.679371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb06bf-cba2-4489-999e-fedb32cd4219 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:14.680842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb06bf-cba2-4489-999e-fedb32cd4219 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:14.720876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:14.783706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 580/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:51:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:51:14.793262 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a083a50-51c7-45a9-a6f6-c5925c95e1df None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:14.911953 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a083a50-51c7-45a9-a6f6-c5925c95e1df None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:14.928312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:14.949738 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66396cc-f36a-4547-8213-d907cb504fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:14.950364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66396cc-f36a-4547-8213-d907cb504fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:14.950672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66396cc-f36a-4547-8213-d907cb504fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:14.950948 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66396cc-f36a-4547-8213-d907cb504fe6 None admin] PATH_INFO: `/v3/projects/073c2222b8f9497db83d702fe31e3b15` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:14.952097 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66396cc-f36a-4547-8213-d907cb504fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=073c2222b8f9497db83d702fe31e3b15)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:14.953551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66396cc-f36a-4547-8213-d907cb504fe6 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:14.955300 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 580/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:51:14 2022] GET /identity/v3/projects/073c2222b8f9497db83d702fe31e3b15 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:14.962562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb06bf-cba2-4489-999e-fedb32cd4219 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:15.075554 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb06bf-cba2-4489-999e-fedb32cd4219 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:15.123917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d54e9-cd35-4805-9309-03d50666f06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:15.124519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d54e9-cd35-4805-9309-03d50666f06a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:15.124795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d54e9-cd35-4805-9309-03d50666f06a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:15.125072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d54e9-cd35-4805-9309-03d50666f06a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:15.125797 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d54e9-cd35-4805-9309-03d50666f06a None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=073c2222b8f9497db83d702fe31e3b15, user.id=53820ead500b44e1bf9b2d4be853f6c6) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:51:15.126083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d54e9-cd35-4805-9309-03d50666f06a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:15.127589 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d54e9-cd35-4805-9309-03d50666f06a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:15.133579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 581/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:51:14 2022] GET /identity/v3/role_assignments?user.id=53820ead500b44e1bf9b2d4be853f6c6&scope.project.id=073c2222b8f9497db83d702fe31e3b15&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:17.065438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6d4e2-982b-48e6-b3a2-3e8d812c6359 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:17.066038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6d4e2-982b-48e6-b3a2-3e8d812c6359 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:17.066038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6d4e2-982b-48e6-b3a2-3e8d812c6359 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:17.067392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 581/1162] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:17.074549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb12ac1-bbb3-4be6-9c4d-36c932145a04 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:17.075323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb12ac1-bbb3-4be6-9c4d-36c932145a04 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:17.075450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb12ac1-bbb3-4be6-9c4d-36c932145a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:17.086046 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:17.100486 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-edb12ac1-bbb3-4be6-9c4d-36c932145a04 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:17.101694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-edb12ac1-bbb3-4be6-9c4d-36c932145a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:17.171526 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 582/1163] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:51:17.434496 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6d4e2-982b-48e6-b3a2-3e8d812c6359 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:17.544498 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6d4e2-982b-48e6-b3a2-3e8d812c6359 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:17.581927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab86b0a-abf7-4776-b862-50b954e026ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:17.582420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab86b0a-abf7-4776-b862-50b954e026ac None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:17.582634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab86b0a-abf7-4776-b862-50b954e026ac None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:17.583048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab86b0a-abf7-4776-b862-50b954e026ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:17.638738 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:17.655233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab86b0a-abf7-4776-b862-50b954e026ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:17.656427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab86b0a-abf7-4776-b862-50b954e026ac None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:17.762518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 582/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:51:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:51:17.771359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb12ac1-bbb3-4be6-9c4d-36c932145a04 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:17.878258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb12ac1-bbb3-4be6-9c4d-36c932145a04 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:17.910896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:17.916865 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c04977-33ea-4809-9872-8bf887b885d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:17.917496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c04977-33ea-4809-9872-8bf887b885d6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:17.917773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c04977-33ea-4809-9872-8bf887b885d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:17.918085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c04977-33ea-4809-9872-8bf887b885d6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:17.925046 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c04977-33ea-4809-9872-8bf887b885d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:17.926524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c04977-33ea-4809-9872-8bf887b885d6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-63c04977-33ea-4809-9872-8bf887b885d6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:51:17.938054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:51:17.939179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:51:17.940277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 583/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 22 15:51:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:51:17.946095 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab86b0a-abf7-4776-b862-50b954e026ac None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:18.032743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:18.050630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab86b0a-abf7-4776-b862-50b954e026ac None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:18.087244 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d38d7-4541-4d31-8f9e-1427c023736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:18.087958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d38d7-4541-4d31-8f9e-1427c023736c None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:18.088099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d38d7-4541-4d31-8f9e-1427c023736c None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:18.088385 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d38d7-4541-4d31-8f9e-1427c023736c None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:18.089034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d38d7-4541-4d31-8f9e-1427c023736c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:51:18.089328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d38d7-4541-4d31-8f9e-1427c023736c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:18.090770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d38d7-4541-4d31-8f9e-1427c023736c None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:18.098560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 583/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Mon Aug 22 15:51:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:19.983205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b6ede-0383-47cb-8c51-86144fe5230f None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:19.984100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b6ede-0383-47cb-8c51-86144fe5230f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:19.984100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b6ede-0383-47cb-8c51-86144fe5230f None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:19.985509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 584/1167] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:19.991335 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c53e3-bc13-42f0-8112-237c1f422a72 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:19.991820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c53e3-bc13-42f0-8112-237c1f422a72 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:19.991923 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c53e3-bc13-42f0-8112-237c1f422a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:20.010570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-852c53e3-bc13-42f0-8112-237c1f422a72 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:20.011825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-852c53e3-bc13-42f0-8112-237c1f422a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:20.081381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 584/1168] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:51:20.344540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b6ede-0383-47cb-8c51-86144fe5230f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:20.458055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b6ede-0383-47cb-8c51-86144fe5230f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:20.505435 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951bed5-15e6-4f76-8056-9bcae19b37f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:20.506040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951bed5-15e6-4f76-8056-9bcae19b37f7 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:20.506315 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951bed5-15e6-4f76-8056-9bcae19b37f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:20.506585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951bed5-15e6-4f76-8056-9bcae19b37f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:20.507271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951bed5-15e6-4f76-8056-9bcae19b37f7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:20.508650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951bed5-15e6-4f76-8056-9bcae19b37f7 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:20.528494 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 585/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Mon Aug 22 15:51:20 2022] POST /identity/v3/domains => generated 267 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:51:22.468294 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8483dd4-7f63-4b9b-a2ca-4af4cb0414d3 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:22.468878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8483dd4-7f63-4b9b-a2ca-4af4cb0414d3 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:22.468878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8483dd4-7f63-4b9b-a2ca-4af4cb0414d3 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:22.470902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 585/1170] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:51:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:22.478427 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98f8aa-eb8c-40c2-8ff4-3a4c586952a7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:22.478915 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98f8aa-eb8c-40c2-8ff4-3a4c586952a7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:22.479014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98f8aa-eb8c-40c2-8ff4-3a4c586952a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:22.499948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9c98f8aa-eb8c-40c2-8ff4-3a4c586952a7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:22.501149 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9c98f8aa-eb8c-40c2-8ff4-3a4c586952a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:22.554296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:22.577397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 586/1171] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:51:22.840195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8483dd4-7f63-4b9b-a2ca-4af4cb0414d3 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:22.930555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:22.955477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8483dd4-7f63-4b9b-a2ca-4af4cb0414d3 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:23.015314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae30144-d3a7-4a02-adfd-47add7e5f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:23.015922 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae30144-d3a7-4a02-adfd-47add7e5f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:23.016196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae30144-d3a7-4a02-adfd-47add7e5f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:23.016468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae30144-d3a7-4a02-adfd-47add7e5f5f6 None admin] PATH_INFO: `/v3/domains/e6c82583cddb4c10881c7f2328fa15b9` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:23.029003 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae30144-d3a7-4a02-adfd-47add7e5f5f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e6c82583cddb4c10881c7f2328fa15b9)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:23.030487 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae30144-d3a7-4a02-adfd-47add7e5f5f6 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:23.032218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 586/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Mon Aug 22 15:51:22 2022] GET /identity/v3/domains/e6c82583cddb4c10881c7f2328fa15b9 => generated 267 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:23.038644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98f8aa-eb8c-40c2-8ff4-3a4c586952a7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:23.144517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98f8aa-eb8c-40c2-8ff4-3a4c586952a7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:23.182699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bd1b5-bb95-4ce0-bf43-763aff2fdffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:23.183307 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bd1b5-bb95-4ce0-bf43-763aff2fdffa None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:23.183580 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bd1b5-bb95-4ce0-bf43-763aff2fdffa None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:23.183844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bd1b5-bb95-4ce0-bf43-763aff2fdffa None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:23.184489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bd1b5-bb95-4ce0-bf43-763aff2fdffa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:23.185925 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bd1b5-bb95-4ce0-bf43-763aff2fdffa None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:23.215552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 587/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 22 15:51:23 2022] POST /identity/v3/projects => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:51:25.238208 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36f0fe-2791-4749-bfe4-4c802f931247 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:25.239188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36f0fe-2791-4749-bfe4-4c802f931247 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:25.239188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36f0fe-2791-4749-bfe4-4c802f931247 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:25.241319 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 587/1174] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:51:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:25.249778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e6f43-cf6c-4c27-bae6-cb06c9dec6b5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:25.250258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e6f43-cf6c-4c27-bae6-cb06c9dec6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:25.250493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e6f43-cf6c-4c27-bae6-cb06c9dec6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:25.279415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-463e6f43-cf6c-4c27-bae6-cb06c9dec6b5 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:25.280640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-463e6f43-cf6c-4c27-bae6-cb06c9dec6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:25.310440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:25.360676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 588/1175] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:51:25.645045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36f0fe-2791-4749-bfe4-4c802f931247 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:25.764161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36f0fe-2791-4749-bfe4-4c802f931247 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:25.799371 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1bf95-5397-41f0-9723-10844b7867b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:25.799989 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1bf95-5397-41f0-9723-10844b7867b5 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:25.800261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1bf95-5397-41f0-9723-10844b7867b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:25.800532 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1bf95-5397-41f0-9723-10844b7867b5 None admin] PATH_INFO: `/v3/domains/e6c82583cddb4c10881c7f2328fa15b9` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:25.801812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1bf95-5397-41f0-9723-10844b7867b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e6c82583cddb4c10881c7f2328fa15b9)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:25.803286 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1bf95-5397-41f0-9723-10844b7867b5 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:25.804859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 588/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Mon Aug 22 15:51:25 2022] GET /identity/v3/domains/e6c82583cddb4c10881c7f2328fa15b9 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:25.811110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e6f43-cf6c-4c27-bae6-cb06c9dec6b5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:25.924756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e6f43-cf6c-4c27-bae6-cb06c9dec6b5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:25.961076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcddf3-a339-4800-b6b3-07799d4a100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:25.961693 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcddf3-a339-4800-b6b3-07799d4a100f None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:25.961973 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcddf3-a339-4800-b6b3-07799d4a100f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:25.962242 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcddf3-a339-4800-b6b3-07799d4a100f None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:25.962930 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcddf3-a339-4800-b6b3-07799d4a100f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:25.964352 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcddf3-a339-4800-b6b3-07799d4a100f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:25.991232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 589/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:51:25 2022] POST /identity/v3/users => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:51:27.912783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4bf7a-97bf-490b-9e38-7035db572c7d None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:27.913691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4bf7a-97bf-490b-9e38-7035db572c7d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:27.913691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4bf7a-97bf-490b-9e38-7035db572c7d None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:27.915866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 589/1178] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:51:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:27.923409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28210a25-0d35-45c8-ba79-f341b531c8e7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:27.923836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28210a25-0d35-45c8-ba79-f341b531c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:27.924096 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28210a25-0d35-45c8-ba79-f341b531c8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:27.953279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-28210a25-0d35-45c8-ba79-f341b531c8e7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:27.954493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-28210a25-0d35-45c8-ba79-f341b531c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:27.971087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:28.028987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 590/1179] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:51:28.292271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4bf7a-97bf-490b-9e38-7035db572c7d None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:28.302368 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:28.404776 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4bf7a-97bf-490b-9e38-7035db572c7d None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:28.458332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9792f-2c4c-418d-9440-0c35b274c624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:28.459188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9792f-2c4c-418d-9440-0c35b274c624 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:28.459518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9792f-2c4c-418d-9440-0c35b274c624 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:28.459843 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9792f-2c4c-418d-9440-0c35b274c624 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:28.475316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9792f-2c4c-418d-9440-0c35b274c624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-79d9792f-2c4c-418d-9440-0c35b274c624 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:51:28.480423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:51:28.481795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:51:28.483196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:51:28.483196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:51:28.483196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:51:28.483196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:51:28.483196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:51:28.483196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:51:28.483196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:51:28.483196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:51:28.483196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:51:28.483196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:51:28.483196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:51:28.483196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:51:28.483196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 590/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:51:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:51:28.490959 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28210a25-0d35-45c8-ba79-f341b531c8e7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:28.619363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28210a25-0d35-45c8-ba79-f341b531c8e7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:28.657646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42791c44-f656-4755-8aac-495b9eeb73ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:28.658638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791c44-f656-4755-8aac-495b9eeb73ba None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:28.659066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791c44-f656-4755-8aac-495b9eeb73ba None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:28.659540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791c44-f656-4755-8aac-495b9eeb73ba None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:28.660654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42791c44-f656-4755-8aac-495b9eeb73ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:51:28.661166 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42791c44-f656-4755-8aac-495b9eeb73ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:28.663612 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42791c44-f656-4755-8aac-495b9eeb73ba None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:28.678418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 591/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:51:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:28.684642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9792f-2c4c-418d-9440-0c35b274c624 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:28.754051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:28.792308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9792f-2c4c-418d-9440-0c35b274c624 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:28.828533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edaa11-1717-4292-b179-e9132018a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:28.829134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edaa11-1717-4292-b179-e9132018a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:28.829439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edaa11-1717-4292-b179-e9132018a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:28.829710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edaa11-1717-4292-b179-e9132018a7c6 None admin] PATH_INFO: `/v3/users/ed1a22ce99b64a2eb4e45ed4cece0a2d` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:28.844171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edaa11-1717-4292-b179-e9132018a7c6 None admin] RBAC: Authorizing `identity:get_user(user_id=ed1a22ce99b64a2eb4e45ed4cece0a2d)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:28.845638 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edaa11-1717-4292-b179-e9132018a7c6 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:28.847363 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 591/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:51:28 2022] GET /identity/v3/users/ed1a22ce99b64a2eb4e45ed4cece0a2d => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:51:28.853681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42791c44-f656-4755-8aac-495b9eeb73ba None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:28.871039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:28.968056 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42791c44-f656-4755-8aac-495b9eeb73ba None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:29.003752 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3a290-d4ca-4956-92a1-be7d93da666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:29.004388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3a290-d4ca-4956-92a1-be7d93da666a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:29.004638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3a290-d4ca-4956-92a1-be7d93da666a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:29.004908 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3a290-d4ca-4956-92a1-be7d93da666a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:29.076364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3a290-d4ca-4956-92a1-be7d93da666a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:29.077858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3a290-d4ca-4956-92a1-be7d93da666a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:29.093038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:29.186243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 592/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:51:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:51:29.192504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edaa11-1717-4292-b179-e9132018a7c6 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:29.315240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edaa11-1717-4292-b179-e9132018a7c6 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:29.343744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:29.358272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297117a5-019d-4dde-b771-68361be36cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:29.358950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297117a5-019d-4dde-b771-68361be36cbc None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:29.359224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297117a5-019d-4dde-b771-68361be36cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:29.359493 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297117a5-019d-4dde-b771-68361be36cbc None admin] PATH_INFO: `/v3/projects/199ad04be0674731ae4e9618a05e6f85` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:29.361153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297117a5-019d-4dde-b771-68361be36cbc None admin] RBAC: Authorizing `identity:get_project(project_id=199ad04be0674731ae4e9618a05e6f85)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:29.362625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297117a5-019d-4dde-b771-68361be36cbc None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:29.364267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 592/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:51:29 2022] GET /identity/v3/projects/199ad04be0674731ae4e9618a05e6f85 => generated 361 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:29.373287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3a290-d4ca-4956-92a1-be7d93da666a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:29.484248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3a290-d4ca-4956-92a1-be7d93da666a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:29.498407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:29.522104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b28191-85b3-4b97-a783-94796b0dc584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:29.522762 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b28191-85b3-4b97-a783-94796b0dc584 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:29.523055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b28191-85b3-4b97-a783-94796b0dc584 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:29.523318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b28191-85b3-4b97-a783-94796b0dc584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:29.524059 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b28191-85b3-4b97-a783-94796b0dc584 None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=199ad04be0674731ae4e9618a05e6f85, user.id=ed1a22ce99b64a2eb4e45ed4cece0a2d) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:51:29.524362 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b28191-85b3-4b97-a783-94796b0dc584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:29.525811 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b28191-85b3-4b97-a783-94796b0dc584 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:29.531734 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 593/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:51:29 2022] GET /identity/v3/role_assignments?user.id=ed1a22ce99b64a2eb4e45ed4cece0a2d&scope.project.id=199ad04be0674731ae4e9618a05e6f85&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:31.414099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d84be-be8c-4ee9-a866-05783e39a907 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:31.414671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d84be-be8c-4ee9-a866-05783e39a907 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:31.414671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d84be-be8c-4ee9-a866-05783e39a907 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:31.416045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 593/1186] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:31.422503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed710b-e1e6-4af7-aba2-cbb2d3ff05c9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:31.423012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed710b-e1e6-4af7-aba2-cbb2d3ff05c9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:31.423105 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed710b-e1e6-4af7-aba2-cbb2d3ff05c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:31.449401 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4fed710b-e1e6-4af7-aba2-cbb2d3ff05c9 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:31.450649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4fed710b-e1e6-4af7-aba2-cbb2d3ff05c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:31.522332 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 594/1187] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:51:31.787569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d84be-be8c-4ee9-a866-05783e39a907 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:31.906728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d84be-be8c-4ee9-a866-05783e39a907 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:31.942079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66dfd8-236a-4ab6-a76e-8263b1c77537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:31.942739 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66dfd8-236a-4ab6-a76e-8263b1c77537 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:31.943020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66dfd8-236a-4ab6-a76e-8263b1c77537 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:31.943293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66dfd8-236a-4ab6-a76e-8263b1c77537 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:31.954021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66dfd8-236a-4ab6-a76e-8263b1c77537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-6a66dfd8-236a-4ab6-a76e-8263b1c77537 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:51:31.958747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:51:31.959848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:51:31.961631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:51:31.961631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:51:31.961631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:51:31.961631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:51:31.961631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:51:31.961631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:51:31.961631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:51:31.961631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:51:31.961631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:51:31.961631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:51:31.961631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:51:31.961631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:51:31.961631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 594/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:51:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:51:31.968725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed710b-e1e6-4af7-aba2-cbb2d3ff05c9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:32.074423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed710b-e1e6-4af7-aba2-cbb2d3ff05c9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:32.081969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:32.109402 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9fdc8-6925-46cc-bef6-bcd4983e92ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:32.110009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9fdc8-6925-46cc-bef6-bcd4983e92ca None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:32.110287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9fdc8-6925-46cc-bef6-bcd4983e92ca None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:32.110555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9fdc8-6925-46cc-bef6-bcd4983e92ca None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:32.111255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9fdc8-6925-46cc-bef6-bcd4983e92ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:51:32.111555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9fdc8-6925-46cc-bef6-bcd4983e92ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:32.112941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9fdc8-6925-46cc-bef6-bcd4983e92ca None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:32.121010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 595/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:51:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:32.127860 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66dfd8-236a-4ab6-a76e-8263b1c77537 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:32.185305 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:32.242421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66dfd8-236a-4ab6-a76e-8263b1c77537 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:32.279123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38d52-f2d6-4606-b075-02eaf3aa3c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:32.279763 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38d52-f2d6-4606-b075-02eaf3aa3c75 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:32.280076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38d52-f2d6-4606-b075-02eaf3aa3c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:32.280349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38d52-f2d6-4606-b075-02eaf3aa3c75 None admin] PATH_INFO: `/v3/users/ed1a22ce99b64a2eb4e45ed4cece0a2d` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:32.281540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38d52-f2d6-4606-b075-02eaf3aa3c75 None admin] RBAC: Authorizing `identity:get_user(user_id=ed1a22ce99b64a2eb4e45ed4cece0a2d)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:32.283035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38d52-f2d6-4606-b075-02eaf3aa3c75 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:32.284676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 595/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:51:32 2022] GET /identity/v3/users/ed1a22ce99b64a2eb4e45ed4cece0a2d => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:32.290765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9fdc8-6925-46cc-bef6-bcd4983e92ca None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:32.409200 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9fdc8-6925-46cc-bef6-bcd4983e92ca None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:32.444839 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42966b-2fbf-47fb-a14a-d4589ea0f936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:32.445514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42966b-2fbf-47fb-a14a-d4589ea0f936 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:32.445753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42966b-2fbf-47fb-a14a-d4589ea0f936 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:32.446025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42966b-2fbf-47fb-a14a-d4589ea0f936 None admin] PATH_INFO: `/v3/projects/199ad04be0674731ae4e9618a05e6f85` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:32.447210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42966b-2fbf-47fb-a14a-d4589ea0f936 None admin] RBAC: Authorizing `identity:get_project(project_id=199ad04be0674731ae4e9618a05e6f85)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:32.448671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42966b-2fbf-47fb-a14a-d4589ea0f936 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:32.450363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 596/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:51:32 2022] GET /identity/v3/projects/199ad04be0674731ae4e9618a05e6f85 => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:32.459765 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38d52-f2d6-4606-b075-02eaf3aa3c75 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:32.599892 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38d52-f2d6-4606-b075-02eaf3aa3c75 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:32.623319 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:32.640521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040187d-d765-42a5-bee1-8779d811c8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:32.641186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040187d-d765-42a5-bee1-8779d811c8d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:32.641460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040187d-d765-42a5-bee1-8779d811c8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:32.641730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040187d-d765-42a5-bee1-8779d811c8d8 None admin] PATH_INFO: `/v3/projects/199ad04be0674731ae4e9618a05e6f85/users/ed1a22ce99b64a2eb4e45ed4cece0a2d/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:32.643874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040187d-d765-42a5-bee1-8779d811c8d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=199ad04be0674731ae4e9618a05e6f85, user_id=ed1a22ce99b64a2eb4e45ed4cece0a2d, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:32.645316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040187d-d765-42a5-bee1-8779d811c8d8 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:32.661317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 596/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:51:32 2022] PUT /identity/v3/projects/199ad04be0674731ae4e9618a05e6f85/users/ed1a22ce99b64a2eb4e45ed4cece0a2d/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:51:34.523301 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c5df9-a371-49e7-a695-826f56ac101e None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:34.524152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c5df9-a371-49e7-a695-826f56ac101e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:34.524152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c5df9-a371-49e7-a695-826f56ac101e None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:34.526340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 597/1193] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:51:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:51:34.536445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adead1-230c-4493-ad88-ef0446910dbc None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:34.536445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adead1-230c-4493-ad88-ef0446910dbc None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:34.536445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adead1-230c-4493-ad88-ef0446910dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:34.557017 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-e8adead1-230c-4493-ad88-ef0446910dbc None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:51:34.558246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e8adead1-230c-4493-ad88-ef0446910dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:51:34.632819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 597/1194] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:51:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:51:34.908109 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c5df9-a371-49e7-a695-826f56ac101e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:34.952658 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:35.018995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c5df9-a371-49e7-a695-826f56ac101e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:35.056996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501fb05-9e1c-4b5b-89d4-5dad5b94daeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:35.057633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501fb05-9e1c-4b5b-89d4-5dad5b94daeb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:35.057910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501fb05-9e1c-4b5b-89d4-5dad5b94daeb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:35.058180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501fb05-9e1c-4b5b-89d4-5dad5b94daeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:35.070823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501fb05-9e1c-4b5b-89d4-5dad5b94daeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-5501fb05-9e1c-4b5b-89d4-5dad5b94daeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:51:35.075858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:51:35.077225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:51:35.078088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:51:35.078088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:51:35.078088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:51:35.078088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:51:35.078088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:51:35.078088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:51:35.078088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:51:35.078088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:51:35.078088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:51:35.078088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:51:35.078088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:51:35.078088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:51:35.078088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 598/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:51:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:51:35.084524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adead1-230c-4493-ad88-ef0446910dbc None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:35.216205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adead1-230c-4493-ad88-ef0446910dbc None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:35.227121 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:35.254036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc72bb-95de-446c-9f77-33dbc4913749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:35.254655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc72bb-95de-446c-9f77-33dbc4913749 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:35.254941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc72bb-95de-446c-9f77-33dbc4913749 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:35.255240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc72bb-95de-446c-9f77-33dbc4913749 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:35.255885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc72bb-95de-446c-9f77-33dbc4913749 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:51:35.256187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc72bb-95de-446c-9f77-33dbc4913749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:35.257577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc72bb-95de-446c-9f77-33dbc4913749 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:35.270498 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 598/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:51:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:35.276713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501fb05-9e1c-4b5b-89d4-5dad5b94daeb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:35.376676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:35.383921 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501fb05-9e1c-4b5b-89d4-5dad5b94daeb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:35.419500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0535da-3e35-4be9-9ff5-cdc1a8684e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:35.420131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0535da-3e35-4be9-9ff5-cdc1a8684e9a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:35.420408 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0535da-3e35-4be9-9ff5-cdc1a8684e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:35.420677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0535da-3e35-4be9-9ff5-cdc1a8684e9a None admin] PATH_INFO: `/v3/users/ed1a22ce99b64a2eb4e45ed4cece0a2d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:35.421902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0535da-3e35-4be9-9ff5-cdc1a8684e9a None admin] RBAC: Authorizing `identity:get_user(user_id=ed1a22ce99b64a2eb4e45ed4cece0a2d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:35.423427 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0535da-3e35-4be9-9ff5-cdc1a8684e9a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:35.425035 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 599/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Mon Aug 22 15:51:35 2022] GET /identity/v3/users/ed1a22ce99b64a2eb4e45ed4cece0a2d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:35.431351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc72bb-95de-446c-9f77-33dbc4913749 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:35.543023 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc72bb-95de-446c-9f77-33dbc4913749 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:35.579710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67331b9f-a517-4300-b723-2e1b43d677cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:35.580340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67331b9f-a517-4300-b723-2e1b43d677cc None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:35.580615 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67331b9f-a517-4300-b723-2e1b43d677cc None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:35.580886 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67331b9f-a517-4300-b723-2e1b43d677cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:35.624019 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:35.655697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67331b9f-a517-4300-b723-2e1b43d677cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:35.657167 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67331b9f-a517-4300-b723-2e1b43d677cc None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:35.759314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 599/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:51:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:51:35.768746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0535da-3e35-4be9-9ff5-cdc1a8684e9a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:35.884900 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0535da-3e35-4be9-9ff5-cdc1a8684e9a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:35.921997 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d21e85-9b1a-4880-8f3c-1ccd93d21297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:35.922678 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21e85-9b1a-4880-8f3c-1ccd93d21297 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:35.922957 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21e85-9b1a-4880-8f3c-1ccd93d21297 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:35.923223 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21e85-9b1a-4880-8f3c-1ccd93d21297 None admin] PATH_INFO: `/v3/projects/199ad04be0674731ae4e9618a05e6f85` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:35.924380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d21e85-9b1a-4880-8f3c-1ccd93d21297 None admin] RBAC: Authorizing `identity:get_project(project_id=199ad04be0674731ae4e9618a05e6f85)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:35.925855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d21e85-9b1a-4880-8f3c-1ccd93d21297 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:35.927607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 600/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Mon Aug 22 15:51:35 2022] GET /identity/v3/projects/199ad04be0674731ae4e9618a05e6f85 => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:35.934438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67331b9f-a517-4300-b723-2e1b43d677cc None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:51:36.023694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:36.057870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67331b9f-a517-4300-b723-2e1b43d677cc None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:51:36.096601 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9668f42-8088-4f33-8150-900fd9176f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:51:36.097219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668f42-8088-4f33-8150-900fd9176f32 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:51:36.097498 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668f42-8088-4f33-8150-900fd9176f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:51:36.097770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9668f42-8088-4f33-8150-900fd9176f32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:51:36.098510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9668f42-8088-4f33-8150-900fd9176f32 None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=199ad04be0674731ae4e9618a05e6f85, user.id=ed1a22ce99b64a2eb4e45ed4cece0a2d) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:51:36.098852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9668f42-8088-4f33-8150-900fd9176f32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:51:36.100348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9668f42-8088-4f33-8150-900fd9176f32 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:51:36.107126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 600/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:51:35 2022] GET /identity/v3/role_assignments?user.id=ed1a22ce99b64a2eb4e45ed4cece0a2d&scope.project.id=199ad04be0674731ae4e9618a05e6f85&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:51:45.917071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=84 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:51:46.104560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=32 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:32.467777 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c3574-470d-492e-bc78-a2f7a9cf7207 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:32.468677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c3574-470d-492e-bc78-a2f7a9cf7207 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:32.468677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c3574-470d-492e-bc78-a2f7a9cf7207 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:32.470311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 601/1201] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:52:32.479192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c71007-aae2-4c68-994b-44f7440b38d8 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:32.480085 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c71007-aae2-4c68-994b-44f7440b38d8 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:32.480085 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c71007-aae2-4c68-994b-44f7440b38d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:32.502226 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-f8c71007-aae2-4c68-994b-44f7440b38d8 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:52:32.503607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f8c71007-aae2-4c68-994b-44f7440b38d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:52:32.625134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 601/1202] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:52:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:52:32.905837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c3574-470d-492e-bc78-a2f7a9cf7207 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:33.062912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c3574-470d-492e-bc78-a2f7a9cf7207 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:33.106933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749add74-eef9-4019-9782-8bf9601c8256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:33.111326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749add74-eef9-4019-9782-8bf9601c8256 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:33.111750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749add74-eef9-4019-9782-8bf9601c8256 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:33.112042 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749add74-eef9-4019-9782-8bf9601c8256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:33.126015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749add74-eef9-4019-9782-8bf9601c8256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:33.127726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749add74-eef9-4019-9782-8bf9601c8256 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-749add74-eef9-4019-9782-8bf9601c8256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:52:33.148596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:33.149849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:52:33.151357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:52:33.151357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:33.151357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:52:33.151357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 602/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:52:33.157055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c71007-aae2-4c68-994b-44f7440b38d8 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:33.288567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c71007-aae2-4c68-994b-44f7440b38d8 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:33.334647 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:33.343352 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc55116-2874-4ce6-9d73-d1130ca028a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:33.344149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc55116-2874-4ce6-9d73-d1130ca028a1 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:33.344266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc55116-2874-4ce6-9d73-d1130ca028a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:33.344562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc55116-2874-4ce6-9d73-d1130ca028a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:33.345225 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc55116-2874-4ce6-9d73-d1130ca028a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:33.345527 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc55116-2874-4ce6-9d73-d1130ca028a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:33.347112 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc55116-2874-4ce6-9d73-d1130ca028a1 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:33.361310 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 602/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:33.367519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749add74-eef9-4019-9782-8bf9601c8256 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:33.436772 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:33.525636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749add74-eef9-4019-9782-8bf9601c8256 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:33.590732 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1586f1-85bf-4bd0-b96f-04ede52196bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:33.591828 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1586f1-85bf-4bd0-b96f-04ede52196bd None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:33.592312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1586f1-85bf-4bd0-b96f-04ede52196bd None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:33.592744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1586f1-85bf-4bd0-b96f-04ede52196bd None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:33.593823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1586f1-85bf-4bd0-b96f-04ede52196bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:33.596305 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1586f1-85bf-4bd0-b96f-04ede52196bd None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:33.632424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 603/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Mon Aug 22 15:52:33 2022] POST /identity/v3/users => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 15:52:35.916497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958cf4e-2f4c-4220-b386-97bcf0eacbc0 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:35.916497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958cf4e-2f4c-4220-b386-97bcf0eacbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:35.916497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958cf4e-2f4c-4220-b386-97bcf0eacbc0 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:35.916497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 603/1206] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:52:35.921764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ae001-be57-408f-8dc0-5268e4b13a57 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:35.923434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ae001-be57-408f-8dc0-5268e4b13a57 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:35.923434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ae001-be57-408f-8dc0-5268e4b13a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:35.946686 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-810ae001-be57-408f-8dc0-5268e4b13a57 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:52:35.948739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-810ae001-be57-408f-8dc0-5268e4b13a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:52:36.035481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 604/1207] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:52:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:52:36.310191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958cf4e-2f4c-4220-b386-97bcf0eacbc0 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:36.460607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958cf4e-2f4c-4220-b386-97bcf0eacbc0 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:36.510568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf357-92f6-4058-a88c-22d1c291b0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:36.511281 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf357-92f6-4058-a88c-22d1c291b0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:36.511559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf357-92f6-4058-a88c-22d1c291b0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:36.511874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf357-92f6-4058-a88c-22d1c291b0a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:36.528334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cf357-92f6-4058-a88c-22d1c291b0a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-937cf357-92f6-4058-a88c-22d1c291b0a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:52:36.533894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:36.536036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:36.536907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:36.536907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:36.536907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:36.536907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:36.536907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:52:36.536907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:52:36.536907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:52:36.536907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:52:36.536907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:52:36.536907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:52:36.536907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:52:36.536907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:52:36.536907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 604/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:52:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:36.541196 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ae001-be57-408f-8dc0-5268e4b13a57 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:36.589222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:36.665457 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ae001-be57-408f-8dc0-5268e4b13a57 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:36.709267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78bd5b-81ca-4377-9813-ba4c2df3c3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:36.709909 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78bd5b-81ca-4377-9813-ba4c2df3c3fb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:36.710225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78bd5b-81ca-4377-9813-ba4c2df3c3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:36.710438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78bd5b-81ca-4377-9813-ba4c2df3c3fb None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:36.711140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78bd5b-81ca-4377-9813-ba4c2df3c3fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:36.711438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78bd5b-81ca-4377-9813-ba4c2df3c3fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:36.712896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78bd5b-81ca-4377-9813-ba4c2df3c3fb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:36.722253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 605/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:52:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:36.728611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf357-92f6-4058-a88c-22d1c291b0a9 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:36.794900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:36.863990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf357-92f6-4058-a88c-22d1c291b0a9 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:36.914080 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941422e-ad66-45da-8cc6-eac340e0f6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:36.915540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941422e-ad66-45da-8cc6-eac340e0f6bc None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:36.916021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941422e-ad66-45da-8cc6-eac340e0f6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:36.916508 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941422e-ad66-45da-8cc6-eac340e0f6bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:36.937263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941422e-ad66-45da-8cc6-eac340e0f6bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:36.940177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941422e-ad66-45da-8cc6-eac340e0f6bc None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-5941422e-ad66-45da-8cc6-eac340e0f6bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:52:36.965940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:36.969358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:52:36.971199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:52:36.971199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:36.971199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:52:36.971199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 605/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:36.975628 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78bd5b-81ca-4377-9813-ba4c2df3c3fb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:37.147883 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78bd5b-81ca-4377-9813-ba4c2df3c3fb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:37.152511 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:37.197121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712001bd-cbc5-463e-b4c5-e83f85deba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:37.197772 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712001bd-cbc5-463e-b4c5-e83f85deba1a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:37.198157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712001bd-cbc5-463e-b4c5-e83f85deba1a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:37.198441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712001bd-cbc5-463e-b4c5-e83f85deba1a None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:37.199139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712001bd-cbc5-463e-b4c5-e83f85deba1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:37.201192 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712001bd-cbc5-463e-b4c5-e83f85deba1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:37.201192 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712001bd-cbc5-463e-b4c5-e83f85deba1a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:37.217018 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 606/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:37.222885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941422e-ad66-45da-8cc6-eac340e0f6bc None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:37.348956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941422e-ad66-45da-8cc6-eac340e0f6bc None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:37.351301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:37.399129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068c244-3954-4b85-b072-9bdd1a527ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:37.399713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c244-3954-4b85-b072-9bdd1a527ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:37.400120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c244-3954-4b85-b072-9bdd1a527ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:37.400530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c244-3954-4b85-b072-9bdd1a527ca1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:37.411304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068c244-3954-4b85-b072-9bdd1a527ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:37.413097 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068c244-3954-4b85-b072-9bdd1a527ca1 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-a068c244-3954-4b85-b072-9bdd1a527ca1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:52:37.427334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:37.429423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:37.431391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:37.431391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:37.431391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:52:37.431391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:52:37.431391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:52:37.431391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:52:37.431391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:52:37.431391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:52:37.431391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:52:37.431391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:52:37.434643 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 606/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:37.435440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712001bd-cbc5-463e-b4c5-e83f85deba1a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:37.579964 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712001bd-cbc5-463e-b4c5-e83f85deba1a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:37.629567 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c805b06-0f42-465e-bafa-34cde2516c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:37.630300 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c805b06-0f42-465e-bafa-34cde2516c58 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:37.630671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c805b06-0f42-465e-bafa-34cde2516c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:37.631926 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c805b06-0f42-465e-bafa-34cde2516c58 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:37.631926 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c805b06-0f42-465e-bafa-34cde2516c58 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:37.632151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c805b06-0f42-465e-bafa-34cde2516c58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:37.633703 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c805b06-0f42-465e-bafa-34cde2516c58 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:37.655486 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 607/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Aug 22 15:52:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:37.661016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068c244-3954-4b85-b072-9bdd1a527ca1 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:37.792007 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068c244-3954-4b85-b072-9bdd1a527ca1 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:37.836448 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de762bef-8370-43be-ac05-ce961549ebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:37.837066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de762bef-8370-43be-ac05-ce961549ebaa None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:37.837405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de762bef-8370-43be-ac05-ce961549ebaa None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:37.837677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de762bef-8370-43be-ac05-ce961549ebaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:37.892944 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:37.946623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de762bef-8370-43be-ac05-ce961549ebaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:37.948240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de762bef-8370-43be-ac05-ce961549ebaa None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:38.075955 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 607/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:52:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:52:38.082211 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c805b06-0f42-465e-bafa-34cde2516c58 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:38.104871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:38.204228 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c805b06-0f42-465e-bafa-34cde2516c58 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:38.243102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c713c67-1cf4-40bf-b9df-e6b0b0b66857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:38.244234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c713c67-1cf4-40bf-b9df-e6b0b0b66857 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:38.244732 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c713c67-1cf4-40bf-b9df-e6b0b0b66857 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:38.245202 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c713c67-1cf4-40bf-b9df-e6b0b0b66857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:38.258548 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c713c67-1cf4-40bf-b9df-e6b0b0b66857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:38.260531 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c713c67-1cf4-40bf-b9df-e6b0b0b66857 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-2c713c67-1cf4-40bf-b9df-e6b0b0b66857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:52:38.284696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:38.285954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:52:38.286969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:52:38.286969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:38.286969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:52:38.290820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 608/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:52:38.292200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de762bef-8370-43be-ac05-ce961549ebaa None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:38.365114 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:38.411459 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de762bef-8370-43be-ac05-ce961549ebaa None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:38.450588 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3605b84-8260-4056-9c8a-e53c60ef77c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:38.451255 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3605b84-8260-4056-9c8a-e53c60ef77c6 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:38.451530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3605b84-8260-4056-9c8a-e53c60ef77c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:38.451800 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3605b84-8260-4056-9c8a-e53c60ef77c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:38.452463 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3605b84-8260-4056-9c8a-e53c60ef77c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:38.452763 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3605b84-8260-4056-9c8a-e53c60ef77c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:38.454202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3605b84-8260-4056-9c8a-e53c60ef77c6 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:38.472855 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 608/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:38.474697 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c713c67-1cf4-40bf-b9df-e6b0b0b66857 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:38.556903 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:38.592306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c713c67-1cf4-40bf-b9df-e6b0b0b66857 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:38.630565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76cddd-03d7-441f-a56b-a3a475814380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:38.631348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76cddd-03d7-441f-a56b-a3a475814380 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:38.631629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76cddd-03d7-441f-a56b-a3a475814380 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:38.631895 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76cddd-03d7-441f-a56b-a3a475814380 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:38.639369 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76cddd-03d7-441f-a56b-a3a475814380 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:38.641064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76cddd-03d7-441f-a56b-a3a475814380 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-da76cddd-03d7-441f-a56b-a3a475814380 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:52:38.653815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:38.655047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:38.656299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:52:38.656299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:52:38.656299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:52:38.656299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:52:38.656299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:52:38.656299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:52:38.656299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:52:38.656299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:52:38.656299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 609/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:52:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:38.661339 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3605b84-8260-4056-9c8a-e53c60ef77c6 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:38.791362 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3605b84-8260-4056-9c8a-e53c60ef77c6 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:38.818741 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:38.834777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58579dcf-18a4-4fb2-9832-d5ad767a4357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:38.835422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579dcf-18a4-4fb2-9832-d5ad767a4357 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:38.835693 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579dcf-18a4-4fb2-9832-d5ad767a4357 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:38.835988 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579dcf-18a4-4fb2-9832-d5ad767a4357 None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:38.836751 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58579dcf-18a4-4fb2-9832-d5ad767a4357 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:38.837065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58579dcf-18a4-4fb2-9832-d5ad767a4357 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:38.838728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58579dcf-18a4-4fb2-9832-d5ad767a4357 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:38.852021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 609/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:52:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:52:38.858066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76cddd-03d7-441f-a56b-a3a475814380 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:38.989844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76cddd-03d7-441f-a56b-a3a475814380 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:39.027990 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:39.037164 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdefca-dce8-4f63-9eca-3c5615e6a27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:39.037859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdefca-dce8-4f63-9eca-3c5615e6a27c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:39.038131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdefca-dce8-4f63-9eca-3c5615e6a27c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:39.038405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdefca-dce8-4f63-9eca-3c5615e6a27c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:39.039255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdefca-dce8-4f63-9eca-3c5615e6a27c None admin] RBAC: Adding query filter params (role.id=2160bd7482684f0295250953180cc1b9, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=4be9a664d10d438382b9e359b26ba86e) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:39.039564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdefca-dce8-4f63-9eca-3c5615e6a27c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:39.041159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdefca-dce8-4f63-9eca-3c5615e6a27c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:39.048010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 610/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:52:38 2022] GET /identity/v3/role_assignments?user.id=4be9a664d10d438382b9e359b26ba86e&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=2160bd7482684f0295250953180cc1b9 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:40.969890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276d96a-41a0-41d4-a714-5b5574f66ab2 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:40.970876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276d96a-41a0-41d4-a714-5b5574f66ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:40.970876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276d96a-41a0-41d4-a714-5b5574f66ab2 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:40.971882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 610/1220] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:52:40.977824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f6db-04e7-4f4c-8cf7-ca4d4eb55789 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:40.978321 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f6db-04e7-4f4c-8cf7-ca4d4eb55789 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:40.978420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f6db-04e7-4f4c-8cf7-ca4d4eb55789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:40.998638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-88c5f6db-04e7-4f4c-8cf7-ca4d4eb55789 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:52:41.000129 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-88c5f6db-04e7-4f4c-8cf7-ca4d4eb55789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:52:41.099474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 611/1221] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:52:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:52:41.376037 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276d96a-41a0-41d4-a714-5b5574f66ab2 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:41.494242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276d96a-41a0-41d4-a714-5b5574f66ab2 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:41.534537 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9779e1-73fc-41ba-9efb-85b2e484e22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:41.536309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9779e1-73fc-41ba-9efb-85b2e484e22e None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:41.536593 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9779e1-73fc-41ba-9efb-85b2e484e22e None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:41.536862 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9779e1-73fc-41ba-9efb-85b2e484e22e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:41.549058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9779e1-73fc-41ba-9efb-85b2e484e22e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-5c9779e1-73fc-41ba-9efb-85b2e484e22e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:52:41.554457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:41.555744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:41.556634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:41.556634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:41.556634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:41.556634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:41.556634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:52:41.556634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:52:41.556634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:52:41.556634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:52:41.556634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:52:41.556634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:52:41.556634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:52:41.556634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:52:41.556634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 611/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:52:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:41.562405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5f6db-04e7-4f4c-8cf7-ca4d4eb55789 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:41.678412 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5f6db-04e7-4f4c-8cf7-ca4d4eb55789 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:41.706937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:41.720904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344bdc-292a-4c2b-bbe9-26a18b958aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:41.721527 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344bdc-292a-4c2b-bbe9-26a18b958aca None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:41.721802 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344bdc-292a-4c2b-bbe9-26a18b958aca None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:41.722171 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0344bdc-292a-4c2b-bbe9-26a18b958aca None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:41.722885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0344bdc-292a-4c2b-bbe9-26a18b958aca None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:41.724104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0344bdc-292a-4c2b-bbe9-26a18b958aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:41.725780 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0344bdc-292a-4c2b-bbe9-26a18b958aca None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:41.735816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 612/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:52:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:41.742487 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9779e1-73fc-41ba-9efb-85b2e484e22e None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:41.801874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:41.873023 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9779e1-73fc-41ba-9efb-85b2e484e22e None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:41.917630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502edb94-0980-448b-be18-1d3a9ae0ac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:41.918436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502edb94-0980-448b-be18-1d3a9ae0ac3d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:41.918804 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502edb94-0980-448b-be18-1d3a9ae0ac3d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:41.919170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502edb94-0980-448b-be18-1d3a9ae0ac3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:41.934640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502edb94-0980-448b-be18-1d3a9ae0ac3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:41.936379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502edb94-0980-448b-be18-1d3a9ae0ac3d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-502edb94-0980-448b-be18-1d3a9ae0ac3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:52:41.954320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:41.955753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:52:41.956689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:52:41.956689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:41.956689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:52:41.956689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 612/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:41.962340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344bdc-292a-4c2b-bbe9-26a18b958aca None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:42.074351 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0344bdc-292a-4c2b-bbe9-26a18b958aca None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:42.111007 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98349f93-9de3-4d66-9e7b-975cee8bebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:42.111619 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98349f93-9de3-4d66-9e7b-975cee8bebaa None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:42.111899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98349f93-9de3-4d66-9e7b-975cee8bebaa None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:42.112173 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98349f93-9de3-4d66-9e7b-975cee8bebaa None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:42.112818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98349f93-9de3-4d66-9e7b-975cee8bebaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:42.113122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98349f93-9de3-4d66-9e7b-975cee8bebaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:42.114507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98349f93-9de3-4d66-9e7b-975cee8bebaa None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:42.128979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 613/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:42.135641 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502edb94-0980-448b-be18-1d3a9ae0ac3d None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:42.236834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:42.244105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502edb94-0980-448b-be18-1d3a9ae0ac3d None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:42.279794 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc6ff7-43b4-46e7-87cd-d21a0bc7cb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:42.280434 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc6ff7-43b4-46e7-87cd-d21a0bc7cb60 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:42.280771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc6ff7-43b4-46e7-87cd-d21a0bc7cb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:42.280985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc6ff7-43b4-46e7-87cd-d21a0bc7cb60 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:42.289000 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc6ff7-43b4-46e7-87cd-d21a0bc7cb60 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:42.290452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc6ff7-43b4-46e7-87cd-d21a0bc7cb60 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-14fc6ff7-43b4-46e7-87cd-d21a0bc7cb60 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:52:42.301621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:42.303015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:42.304004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:42.304004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:42.304004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:52:42.304004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:52:42.304004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:52:42.304004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:52:42.304004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:52:42.304004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:52:42.304004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:52:42.304004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:52:42.304004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 613/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:42.309365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98349f93-9de3-4d66-9e7b-975cee8bebaa None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:42.367243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:42.429163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98349f93-9de3-4d66-9e7b-975cee8bebaa None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:42.468293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15a943-ebf7-4fe1-a72e-922c72d6761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:42.468929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15a943-ebf7-4fe1-a72e-922c72d6761c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:42.469230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15a943-ebf7-4fe1-a72e-922c72d6761c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:42.469483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15a943-ebf7-4fe1-a72e-922c72d6761c None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:42.470261 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15a943-ebf7-4fe1-a72e-922c72d6761c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:42.470552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15a943-ebf7-4fe1-a72e-922c72d6761c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:42.472029 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15a943-ebf7-4fe1-a72e-922c72d6761c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:42.490262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 614/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Aug 22 15:52:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:42.496118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc6ff7-43b4-46e7-87cd-d21a0bc7cb60 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:42.616457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc6ff7-43b4-46e7-87cd-d21a0bc7cb60 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:42.654130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af294a-7238-4c9e-aa6e-acf1a6ac3c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:42.654873 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af294a-7238-4c9e-aa6e-acf1a6ac3c2f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:42.655174 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af294a-7238-4c9e-aa6e-acf1a6ac3c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:42.655564 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af294a-7238-4c9e-aa6e-acf1a6ac3c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:42.669297 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af294a-7238-4c9e-aa6e-acf1a6ac3c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:42.671031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af294a-7238-4c9e-aa6e-acf1a6ac3c2f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-97af294a-7238-4c9e-aa6e-acf1a6ac3c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:52:42.686390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:42.687761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:52:42.688676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:52:42.688676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:42.688676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:52:42.688676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 614/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:42.694359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15a943-ebf7-4fe1-a72e-922c72d6761c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:42.806739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15a943-ebf7-4fe1-a72e-922c72d6761c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:42.809142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:42.845151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1e8df-babd-440b-a41c-85c1041b1f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:42.845933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1e8df-babd-440b-a41c-85c1041b1f04 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:42.846242 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1e8df-babd-440b-a41c-85c1041b1f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:42.846561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1e8df-babd-440b-a41c-85c1041b1f04 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:42.847457 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1e8df-babd-440b-a41c-85c1041b1f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:42.847877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1e8df-babd-440b-a41c-85c1041b1f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:42.849725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1e8df-babd-440b-a41c-85c1041b1f04 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:42.862076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 615/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:52:42.868221 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af294a-7238-4c9e-aa6e-acf1a6ac3c2f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:42.878850 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:42.987128 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af294a-7238-4c9e-aa6e-acf1a6ac3c2f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:43.028920 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b650c-02e2-418e-b211-e70b8f10aae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:43.029689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b650c-02e2-418e-b211-e70b8f10aae9 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:43.029956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b650c-02e2-418e-b211-e70b8f10aae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:43.030330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b650c-02e2-418e-b211-e70b8f10aae9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:43.039141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b650c-02e2-418e-b211-e70b8f10aae9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:43.040787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b650c-02e2-418e-b211-e70b8f10aae9 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-af2b650c-02e2-418e-b211-e70b8f10aae9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:52:43.054028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:43.055639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:43.056709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:52:43.056709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:52:43.056709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:52:43.056709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:52:43.056709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:52:43.056709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:52:43.056709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:52:43.056709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:52:43.056709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 615/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:52:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:43.061672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1e8df-babd-440b-a41c-85c1041b1f04 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:43.176464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1e8df-babd-440b-a41c-85c1041b1f04 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:43.213112 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bcc0c-4fc9-4e5c-8890-118de4283f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:43.213727 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bcc0c-4fc9-4e5c-8890-118de4283f7c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:43.213999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bcc0c-4fc9-4e5c-8890-118de4283f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:43.214268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bcc0c-4fc9-4e5c-8890-118de4283f7c None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:43.214993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bcc0c-4fc9-4e5c-8890-118de4283f7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:43.215292 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bcc0c-4fc9-4e5c-8890-118de4283f7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:43.216823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bcc0c-4fc9-4e5c-8890-118de4283f7c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:43.230860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 616/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:52:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:43.237583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b650c-02e2-418e-b211-e70b8f10aae9 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:43.310139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:43.350048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b650c-02e2-418e-b211-e70b8f10aae9 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:43.386011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798f399-96f1-4338-abf0-831a426f2988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:43.386785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798f399-96f1-4338-abf0-831a426f2988 None admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:43.387064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798f399-96f1-4338-abf0-831a426f2988 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:43.387334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798f399-96f1-4338-abf0-831a426f2988 None admin] PATH_INFO: `/v3/projects/318c7f21f9d14e149f668863f748e89f/users/4be9a664d10d438382b9e359b26ba86e/roles/2160bd7482684f0295250953180cc1b9` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:43.405154 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798f399-96f1-4338-abf0-831a426f2988 None admin] RBAC: Authorizing `identity:create_grant(project_id=318c7f21f9d14e149f668863f748e89f, user_id=4be9a664d10d438382b9e359b26ba86e, role_id=2160bd7482684f0295250953180cc1b9)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:43.406693 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798f399-96f1-4338-abf0-831a426f2988 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:43.419787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 616/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:52:43 2022] PUT /identity/v3/projects/318c7f21f9d14e149f668863f748e89f/users/4be9a664d10d438382b9e359b26ba86e/roles/2160bd7482684f0295250953180cc1b9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 15:52:45.418522 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7f4d4-268a-4e7d-92c5-b7ef56139a84 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:45.419226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7f4d4-268a-4e7d-92c5-b7ef56139a84 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:45.419226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7f4d4-268a-4e7d-92c5-b7ef56139a84 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:45.420420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 617/1233] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:52:45.427082 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c3f68-def0-403b-964c-3fb077d586f7 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:45.427667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c3f68-def0-403b-964c-3fb077d586f7 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:45.427667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c3f68-def0-403b-964c-3fb077d586f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:45.448088 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-5b3c3f68-def0-403b-964c-3fb077d586f7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:52:45.449325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5b3c3f68-def0-403b-964c-3fb077d586f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:52:45.528530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 617/1234] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:52:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:52:45.805162 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7f4d4-268a-4e7d-92c5-b7ef56139a84 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:45.833888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:45.925209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7f4d4-268a-4e7d-92c5-b7ef56139a84 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:45.971925 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b441a-c413-4ff4-a0d9-366ac997a053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:45.972579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b441a-c413-4ff4-a0d9-366ac997a053 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:45.972849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b441a-c413-4ff4-a0d9-366ac997a053 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:45.973112 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b441a-c413-4ff4-a0d9-366ac997a053 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:45.984550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b441a-c413-4ff4-a0d9-366ac997a053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-0f4b441a-c413-4ff4-a0d9-366ac997a053 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:52:45.989542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:45.990663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:45.991565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:45.991565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:45.991565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:45.991565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:45.991565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:52:45.991565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:52:45.991565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:52:45.991565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:52:45.991565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:52:45.991565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:52:45.991565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 15:52:45.991565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:52:45.991565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 618/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Mon Aug 22 15:52:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:45.997393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c3f68-def0-403b-964c-3fb077d586f7 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:46.054272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:46.112296 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c3f68-def0-403b-964c-3fb077d586f7 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:46.150270 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a0322-b233-488f-86bc-f40c74ae6e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:46.150974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a0322-b233-488f-86bc-f40c74ae6e5b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:46.151277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a0322-b233-488f-86bc-f40c74ae6e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:46.151453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a0322-b233-488f-86bc-f40c74ae6e5b None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:46.152130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a0322-b233-488f-86bc-f40c74ae6e5b None admin] RBAC: Adding query filter params (name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:46.152430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a0322-b233-488f-86bc-f40c74ae6e5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:46.153820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a0322-b233-488f-86bc-f40c74ae6e5b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:46.162051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 618/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Mon Aug 22 15:52:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:52:46.168371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b441a-c413-4ff4-a0d9-366ac997a053 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:46.256099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:46.273448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b441a-c413-4ff4-a0d9-366ac997a053 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:46.312477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614eb09-afb6-41d9-9c0c-37565904bd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:46.313108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614eb09-afb6-41d9-9c0c-37565904bd35 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:46.313376 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614eb09-afb6-41d9-9c0c-37565904bd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:46.313656 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614eb09-afb6-41d9-9c0c-37565904bd35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:46.324285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614eb09-afb6-41d9-9c0c-37565904bd35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:46.325855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614eb09-afb6-41d9-9c0c-37565904bd35 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-9614eb09-afb6-41d9-9c0c-37565904bd35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:52:46.341142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:46.342423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:52:46.343404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:52:46.343404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:46.343404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:52:46.343404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 619/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:46.348831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a0322-b233-488f-86bc-f40c74ae6e5b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:46.459264 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a0322-b233-488f-86bc-f40c74ae6e5b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:46.469069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:46.496305 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa07f5-de76-4e73-b81d-ba5499ecbe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:46.496927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa07f5-de76-4e73-b81d-ba5499ecbe2b None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:46.497209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa07f5-de76-4e73-b81d-ba5499ecbe2b None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:46.497481 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa07f5-de76-4e73-b81d-ba5499ecbe2b None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:46.498133 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa07f5-de76-4e73-b81d-ba5499ecbe2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:46.498444 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa07f5-de76-4e73-b81d-ba5499ecbe2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:46.499925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa07f5-de76-4e73-b81d-ba5499ecbe2b None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:46.512262 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 619/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:52:46.518290 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614eb09-afb6-41d9-9c0c-37565904bd35 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:46.631947 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614eb09-afb6-41d9-9c0c-37565904bd35 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:46.687078 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cb0de-7396-4390-95e6-11597e2272ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:46.688156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cb0de-7396-4390-95e6-11597e2272ab None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:46.688651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cb0de-7396-4390-95e6-11597e2272ab None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:46.689124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cb0de-7396-4390-95e6-11597e2272ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:46.694090 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:46.700253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cb0de-7396-4390-95e6-11597e2272ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:46.702139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cb0de-7396-4390-95e6-11597e2272ab None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-780cb0de-7396-4390-95e6-11597e2272ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:52:46.714739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:46.715966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:46.716954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:46.716954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:46.716954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:52:46.716954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:52:46.716954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:52:46.716954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:52:46.716954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:52:46.716954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:52:46.716954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:52:46.716954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:52:46.716954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 620/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:46.721922 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa07f5-de76-4e73-b81d-ba5499ecbe2b None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:46.839505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa07f5-de76-4e73-b81d-ba5499ecbe2b None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:46.878267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353ecfc-cd54-4bfe-8bf0-830ca348f8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:46.878910 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353ecfc-cd54-4bfe-8bf0-830ca348f8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:46.879188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353ecfc-cd54-4bfe-8bf0-830ca348f8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:46.879460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353ecfc-cd54-4bfe-8bf0-830ca348f8a9 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:46.880202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353ecfc-cd54-4bfe-8bf0-830ca348f8a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:46.880508 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353ecfc-cd54-4bfe-8bf0-830ca348f8a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:46.881963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353ecfc-cd54-4bfe-8bf0-830ca348f8a9 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:46.902680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 620/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Aug 22 15:52:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:46.909288 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cb0de-7396-4390-95e6-11597e2272ab None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:47.027840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cb0de-7396-4390-95e6-11597e2272ab None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:47.066917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae3bfa-2b2e-4312-8bad-976a9a11548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:47.067543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae3bfa-2b2e-4312-8bad-976a9a11548d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:47.067819 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae3bfa-2b2e-4312-8bad-976a9a11548d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:47.068082 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae3bfa-2b2e-4312-8bad-976a9a11548d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:47.132607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:47.140121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae3bfa-2b2e-4312-8bad-976a9a11548d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:47.141610 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae3bfa-2b2e-4312-8bad-976a9a11548d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:47.244430 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 621/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:52:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 15:52:47.251206 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353ecfc-cd54-4bfe-8bf0-830ca348f8a9 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:47.282856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:47.365341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353ecfc-cd54-4bfe-8bf0-830ca348f8a9 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:47.403876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca5e43-c432-4108-a31f-6bb5fd90c446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:47.404515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca5e43-c432-4108-a31f-6bb5fd90c446 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:47.404829 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca5e43-c432-4108-a31f-6bb5fd90c446 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:47.405177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca5e43-c432-4108-a31f-6bb5fd90c446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:47.416005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca5e43-c432-4108-a31f-6bb5fd90c446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:47.417514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca5e43-c432-4108-a31f-6bb5fd90c446 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-32ca5e43-c432-4108-a31f-6bb5fd90c446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:52:47.432853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:47.434111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:52:47.435362 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:52:47.435362 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:47.435362 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:52:47.435362 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 621/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:47.440093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae3bfa-2b2e-4312-8bad-976a9a11548d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:47.560706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:47.566861 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae3bfa-2b2e-4312-8bad-976a9a11548d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:47.610746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66954b-d44e-4d35-b94e-5edef8b45cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:47.611377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66954b-d44e-4d35-b94e-5edef8b45cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:47.611690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66954b-d44e-4d35-b94e-5edef8b45cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:47.612084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66954b-d44e-4d35-b94e-5edef8b45cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:47.612743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66954b-d44e-4d35-b94e-5edef8b45cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:47.613048 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66954b-d44e-4d35-b94e-5edef8b45cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:47.614445 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66954b-d44e-4d35-b94e-5edef8b45cf4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:47.626971 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 622/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:47.633600 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca5e43-c432-4108-a31f-6bb5fd90c446 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:47.722489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:47.746940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca5e43-c432-4108-a31f-6bb5fd90c446 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:47.785399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21d2b6-1537-466f-bd21-087098dd0875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:47.786051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21d2b6-1537-466f-bd21-087098dd0875 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:47.786330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21d2b6-1537-466f-bd21-087098dd0875 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:47.786627 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21d2b6-1537-466f-bd21-087098dd0875 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:47.794516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21d2b6-1537-466f-bd21-087098dd0875 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:47.796155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21d2b6-1537-466f-bd21-087098dd0875 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-fa21d2b6-1537-466f-bd21-087098dd0875 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:52:47.809651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:47.810847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:47.812111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:52:47.812111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:52:47.812111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:52:47.812111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:52:47.812111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:52:47.812111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:52:47.812111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:52:47.812111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:52:47.812111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 622/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:52:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:47.817705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66954b-d44e-4d35-b94e-5edef8b45cf4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:47.951537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66954b-d44e-4d35-b94e-5edef8b45cf4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:47.992942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf7ca8-3ea2-4f2d-b18e-afc6db58e26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:47.993737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf7ca8-3ea2-4f2d-b18e-afc6db58e26b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:47.994015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf7ca8-3ea2-4f2d-b18e-afc6db58e26b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:47.994365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf7ca8-3ea2-4f2d-b18e-afc6db58e26b None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:47.995196 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf7ca8-3ea2-4f2d-b18e-afc6db58e26b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:47.995546 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf7ca8-3ea2-4f2d-b18e-afc6db58e26b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:47.997236 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf7ca8-3ea2-4f2d-b18e-afc6db58e26b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:48.011972 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 623/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:52:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:52:48.018385 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21d2b6-1537-466f-bd21-087098dd0875 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:48.126105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21d2b6-1537-466f-bd21-087098dd0875 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:48.160045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87617510-f3a9-4b69-91a5-d294bc0e921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:48.160656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87617510-f3a9-4b69-91a5-d294bc0e921a None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:48.160944 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87617510-f3a9-4b69-91a5-d294bc0e921a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:48.161192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87617510-f3a9-4b69-91a5-d294bc0e921a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:48.161917 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87617510-f3a9-4b69-91a5-d294bc0e921a None admin] RBAC: Adding query filter params (role.id=2160bd7482684f0295250953180cc1b9, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=4be9a664d10d438382b9e359b26ba86e) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:48.162220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87617510-f3a9-4b69-91a5-d294bc0e921a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:48.163692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87617510-f3a9-4b69-91a5-d294bc0e921a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:48.169493 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 623/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:52:48 2022] GET /identity/v3/role_assignments?user.id=4be9a664d10d438382b9e359b26ba86e&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=2160bd7482684f0295250953180cc1b9 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:50.222652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2481673-e34d-449b-99de-0f8cfd171892 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:50.222652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2481673-e34d-449b-99de-0f8cfd171892 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:50.222652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2481673-e34d-449b-99de-0f8cfd171892 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:50.223540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 624/1247] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:52:50.229690 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c335ad-8d66-47bd-aa83-786345faae2a None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:50.230201 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c335ad-8d66-47bd-aa83-786345faae2a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:50.230295 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c335ad-8d66-47bd-aa83-786345faae2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:50.236795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:50.251618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c3c335ad-8d66-47bd-aa83-786345faae2a None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:52:50.253645 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c3c335ad-8d66-47bd-aa83-786345faae2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:52:50.340476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 624/1248] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:52:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:52:50.611901 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2481673-e34d-449b-99de-0f8cfd171892 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:50.631966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:50.735271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2481673-e34d-449b-99de-0f8cfd171892 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:50.774626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fd7fd-8f6e-426c-9b1e-eda179d2a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:50.775276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fd7fd-8f6e-426c-9b1e-eda179d2a8aa None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:50.775553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fd7fd-8f6e-426c-9b1e-eda179d2a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:50.775828 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fd7fd-8f6e-426c-9b1e-eda179d2a8aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:50.790029 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fd7fd-8f6e-426c-9b1e-eda179d2a8aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ba6fd7fd-8f6e-426c-9b1e-eda179d2a8aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:52:50.796256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:50.797453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:50.798655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:50.798655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:50.798655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:50.798655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:50.798655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:52:50.798655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:52:50.798655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:52:50.798655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:52:50.798655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:52:50.798655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:52:50.798655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:52:50.798655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:52:50.798655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 625/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:52:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:50.804125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c335ad-8d66-47bd-aa83-786345faae2a None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:50.920638 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c335ad-8d66-47bd-aa83-786345faae2a None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:50.956793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:50.962703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410549a-bcee-4095-b089-859fcc0ff49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:50.963556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410549a-bcee-4095-b089-859fcc0ff49f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:50.964026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410549a-bcee-4095-b089-859fcc0ff49f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:50.964679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410549a-bcee-4095-b089-859fcc0ff49f None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:50.965370 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410549a-bcee-4095-b089-859fcc0ff49f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:50.965663 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410549a-bcee-4095-b089-859fcc0ff49f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:50.967192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410549a-bcee-4095-b089-859fcc0ff49f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:50.977871 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 625/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:52:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:50.984529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fd7fd-8f6e-426c-9b1e-eda179d2a8aa None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:51.065980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:51.091210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fd7fd-8f6e-426c-9b1e-eda179d2a8aa None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:51.125411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e73f57-73db-420b-9965-1499dd92689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:51.126043 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e73f57-73db-420b-9965-1499dd92689e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:51.126318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e73f57-73db-420b-9965-1499dd92689e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:51.126583 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e73f57-73db-420b-9965-1499dd92689e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:51.136988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e73f57-73db-420b-9965-1499dd92689e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:51.138413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e73f57-73db-420b-9965-1499dd92689e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-89e73f57-73db-420b-9965-1499dd92689e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:52:51.153713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:51.155181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:52:51.156392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:52:51.156392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:51.156392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:52:51.158079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 626/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:51.167534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410549a-bcee-4095-b089-859fcc0ff49f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:51.283345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410549a-bcee-4095-b089-859fcc0ff49f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:51.325487 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aedf41-24b6-4550-acf2-2b409bdfd282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:51.326269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aedf41-24b6-4550-acf2-2b409bdfd282 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:51.326683 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aedf41-24b6-4550-acf2-2b409bdfd282 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:51.326904 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aedf41-24b6-4550-acf2-2b409bdfd282 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:51.327620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aedf41-24b6-4550-acf2-2b409bdfd282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:51.327931 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aedf41-24b6-4550-acf2-2b409bdfd282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:51.329685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aedf41-24b6-4550-acf2-2b409bdfd282 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:51.349305 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 626/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:51.355765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e73f57-73db-420b-9965-1499dd92689e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:51.478450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e73f57-73db-420b-9965-1499dd92689e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:51.508988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:51.518161 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00cd4c-be95-4894-bf0d-61c2a35577d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:51.518863 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00cd4c-be95-4894-bf0d-61c2a35577d7 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:51.519145 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00cd4c-be95-4894-bf0d-61c2a35577d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:51.519418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00cd4c-be95-4894-bf0d-61c2a35577d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:51.529501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00cd4c-be95-4894-bf0d-61c2a35577d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:51.531033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00cd4c-be95-4894-bf0d-61c2a35577d7 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-1b00cd4c-be95-4894-bf0d-61c2a35577d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:52:51.544117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:51.545415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:51.546411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:51.546411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:51.546411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:52:51.546411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:52:51.546411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:52:51.546411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:52:51.546411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:52:51.546411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:52:51.546411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:52:51.546411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:52:51.546411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 627/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:51.553689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aedf41-24b6-4550-acf2-2b409bdfd282 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:51.623259 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:51.689331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aedf41-24b6-4550-acf2-2b409bdfd282 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:51.737315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130d7fd-30ca-4751-a04b-07282fddfca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:51.738171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130d7fd-30ca-4751-a04b-07282fddfca5 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:51.738506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130d7fd-30ca-4751-a04b-07282fddfca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:51.738872 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130d7fd-30ca-4751-a04b-07282fddfca5 None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:51.739982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130d7fd-30ca-4751-a04b-07282fddfca5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:51.740319 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130d7fd-30ca-4751-a04b-07282fddfca5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:51.742469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130d7fd-30ca-4751-a04b-07282fddfca5 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:51.765828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 627/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Aug 22 15:52:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:52:51.772579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00cd4c-be95-4894-bf0d-61c2a35577d7 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:51.892244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00cd4c-be95-4894-bf0d-61c2a35577d7 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:51.936397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785fba9-435e-4fc1-8b72-d349058a1d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:51.937106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785fba9-435e-4fc1-8b72-d349058a1d21 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:51.937383 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785fba9-435e-4fc1-8b72-d349058a1d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:51.937660 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785fba9-435e-4fc1-8b72-d349058a1d21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:52.006661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:52.021829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785fba9-435e-4fc1-8b72-d349058a1d21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:52.023374 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785fba9-435e-4fc1-8b72-d349058a1d21 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:52.146078 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 628/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:52:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 15:52:52.151881 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130d7fd-30ca-4751-a04b-07282fddfca5 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:52.258277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130d7fd-30ca-4751-a04b-07282fddfca5 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:52.274137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:52.301069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e180aac-e8ee-48e8-adbe-3ff247db5449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:52.301758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e180aac-e8ee-48e8-adbe-3ff247db5449 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:52.302033 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e180aac-e8ee-48e8-adbe-3ff247db5449 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:52.302237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e180aac-e8ee-48e8-adbe-3ff247db5449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:52.314924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e180aac-e8ee-48e8-adbe-3ff247db5449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:52.316935 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e180aac-e8ee-48e8-adbe-3ff247db5449 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-2e180aac-e8ee-48e8-adbe-3ff247db5449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:52:52.334556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:52.335914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:52:52.336822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:52:52.336822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:52.336822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:52:52.336822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 628/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:52.341888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785fba9-435e-4fc1-8b72-d349058a1d21 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:52.440924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:52.455485 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785fba9-435e-4fc1-8b72-d349058a1d21 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:52.494490 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb549c5f-0fff-4222-a032-b25714fc7adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:52.495130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb549c5f-0fff-4222-a032-b25714fc7adf None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:52.495404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb549c5f-0fff-4222-a032-b25714fc7adf None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:52.495668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb549c5f-0fff-4222-a032-b25714fc7adf None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:52.496316 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb549c5f-0fff-4222-a032-b25714fc7adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:52.496614 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb549c5f-0fff-4222-a032-b25714fc7adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:52.498108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb549c5f-0fff-4222-a032-b25714fc7adf None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:52.510709 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 629/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:52:52.516957 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e180aac-e8ee-48e8-adbe-3ff247db5449 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:52.637873 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e180aac-e8ee-48e8-adbe-3ff247db5449 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:52.678822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7918-9262-47b8-a7b3-7ec3ca523886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:52.679539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7918-9262-47b8-a7b3-7ec3ca523886 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:52.679818 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7918-9262-47b8-a7b3-7ec3ca523886 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:52.680092 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7918-9262-47b8-a7b3-7ec3ca523886 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:52.688863 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff7918-9262-47b8-a7b3-7ec3ca523886 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:52.690581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff7918-9262-47b8-a7b3-7ec3ca523886 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-beff7918-9262-47b8-a7b3-7ec3ca523886 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:52:52.705393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:52.711193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:52.712306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:52:52.712306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:52:52.712306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:52:52.712306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:52:52.712306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:52:52.712306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:52:52.712306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:52:52.712306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:52:52.712306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 629/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:52.714004 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb549c5f-0fff-4222-a032-b25714fc7adf None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:52.829902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb549c5f-0fff-4222-a032-b25714fc7adf None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:52.869976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa51ea-9692-45e2-b53a-31cdedfe77e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:52.870705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa51ea-9692-45e2-b53a-31cdedfe77e5 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:52.871015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa51ea-9692-45e2-b53a-31cdedfe77e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:52.871310 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa51ea-9692-45e2-b53a-31cdedfe77e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:52.872162 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa51ea-9692-45e2-b53a-31cdedfe77e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:52.872507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa51ea-9692-45e2-b53a-31cdedfe77e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:52.874129 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa51ea-9692-45e2-b53a-31cdedfe77e5 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:52.887482 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 630/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:52.894267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7918-9262-47b8-a7b3-7ec3ca523886 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:52.926435 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:53.015758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7918-9262-47b8-a7b3-7ec3ca523886 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:53.053755 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a34309-5937-4d7c-9650-9692e037bdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:53.054475 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a34309-5937-4d7c-9650-9692e037bdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:53.054804 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a34309-5937-4d7c-9650-9692e037bdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:53.055073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a34309-5937-4d7c-9650-9692e037bdc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:53.055790 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a34309-5937-4d7c-9650-9692e037bdc5 None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=4be9a664d10d438382b9e359b26ba86e) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:53.056096 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a34309-5937-4d7c-9650-9692e037bdc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:53.057725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a34309-5937-4d7c-9650-9692e037bdc5 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:53.064149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 630/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:52:52 2022] GET /identity/v3/role_assignments?user.id=4be9a664d10d438382b9e359b26ba86e&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:55.037785 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3518bf-db5e-4943-ad36-ba9bacbd56ba None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:55.038523 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3518bf-db5e-4943-ad36-ba9bacbd56ba None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:55.038523 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3518bf-db5e-4943-ad36-ba9bacbd56ba None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:55.039814 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 631/1261] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:52:55.046399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8939ed-d3f2-4bb7-b2a0-dfe6b53a59b5 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:55.046997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8939ed-d3f2-4bb7-b2a0-dfe6b53a59b5 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:55.046997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8939ed-d3f2-4bb7-b2a0-dfe6b53a59b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:55.067401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-dd8939ed-d3f2-4bb7-b2a0-dfe6b53a59b5 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:52:55.068683 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-dd8939ed-d3f2-4bb7-b2a0-dfe6b53a59b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:52:55.148630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 631/1262] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:52:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 15:52:55.416240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3518bf-db5e-4943-ad36-ba9bacbd56ba None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:55.428380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:55.546033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3518bf-db5e-4943-ad36-ba9bacbd56ba None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:55.612700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a91295-3a7a-45b5-9720-e2a75b81a305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:55.613694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a91295-3a7a-45b5-9720-e2a75b81a305 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:55.614180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a91295-3a7a-45b5-9720-e2a75b81a305 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:55.614682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a91295-3a7a-45b5-9720-e2a75b81a305 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:55.633566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a91295-3a7a-45b5-9720-e2a75b81a305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-36a91295-3a7a-45b5-9720-e2a75b81a305 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:52:55.643178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:55.644993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:55.646842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:55.646842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:55.646842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:55.646842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:55.646842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:52:55.646842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:52:55.646842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:52:55.646842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:52:55.646842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:52:55.646842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:52:55.646842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:52:55.646842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:52:55.646842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 632/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:52:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:55.652759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8939ed-d3f2-4bb7-b2a0-dfe6b53a59b5 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:55.673738 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:55.762798 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8939ed-d3f2-4bb7-b2a0-dfe6b53a59b5 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:55.806051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65607b09-dbe3-429a-937d-cd44da44f3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:55.806992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65607b09-dbe3-429a-937d-cd44da44f3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:55.807423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65607b09-dbe3-429a-937d-cd44da44f3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:55.807817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65607b09-dbe3-429a-937d-cd44da44f3d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:55.808865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65607b09-dbe3-429a-937d-cd44da44f3d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:55.809309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65607b09-dbe3-429a-937d-cd44da44f3d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:55.811573 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65607b09-dbe3-429a-937d-cd44da44f3d0 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:55.820799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 632/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:52:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:55.827042 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a91295-3a7a-45b5-9720-e2a75b81a305 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:55.909926 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:55.956995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a91295-3a7a-45b5-9720-e2a75b81a305 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:56.003501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629fb5f-4d08-456e-aa29-ceaffcf8d0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:56.004126 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629fb5f-4d08-456e-aa29-ceaffcf8d0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:56.004398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629fb5f-4d08-456e-aa29-ceaffcf8d0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:56.004757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629fb5f-4d08-456e-aa29-ceaffcf8d0b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:56.026424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629fb5f-4d08-456e-aa29-ceaffcf8d0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:56.028356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629fb5f-4d08-456e-aa29-ceaffcf8d0b2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-a629fb5f-4d08-456e-aa29-ceaffcf8d0b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:52:56.045039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:56.047028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:52:56.048009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:52:56.048009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:56.048009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:52:56.048009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 633/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:56.052772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65607b09-dbe3-429a-937d-cd44da44f3d0 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:56.153135 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:56.175316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65607b09-dbe3-429a-937d-cd44da44f3d0 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:56.210395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8f78e-f4a8-4cd2-9b9f-565f8be2c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:56.211036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8f78e-f4a8-4cd2-9b9f-565f8be2c61a None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:56.211315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8f78e-f4a8-4cd2-9b9f-565f8be2c61a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:56.211587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8f78e-f4a8-4cd2-9b9f-565f8be2c61a None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:56.212227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8f78e-f4a8-4cd2-9b9f-565f8be2c61a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:56.212555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8f78e-f4a8-4cd2-9b9f-565f8be2c61a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:56.213935 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8f78e-f4a8-4cd2-9b9f-565f8be2c61a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:56.227511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 633/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:56.233299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629fb5f-4d08-456e-aa29-ceaffcf8d0b2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:56.339989 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629fb5f-4d08-456e-aa29-ceaffcf8d0b2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:56.362395 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:56.379781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd984f0-538f-4875-9e51-0da8d77ba005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:56.380433 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd984f0-538f-4875-9e51-0da8d77ba005 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:56.380708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd984f0-538f-4875-9e51-0da8d77ba005 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:56.380976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd984f0-538f-4875-9e51-0da8d77ba005 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:56.389654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd984f0-538f-4875-9e51-0da8d77ba005 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:56.391163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd984f0-538f-4875-9e51-0da8d77ba005 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-dcd984f0-538f-4875-9e51-0da8d77ba005 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:52:56.403243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:56.404578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:56.405842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:56.405842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:56.405842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:52:56.405842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:52:56.405842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:52:56.405842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:52:56.405842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:52:56.405842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:52:56.405842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:52:56.405842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:52:56.405842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 634/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 15:52:56.412911 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8f78e-f4a8-4cd2-9b9f-565f8be2c61a None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:56.534641 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8f78e-f4a8-4cd2-9b9f-565f8be2c61a None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:56.574679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6177e7b-79d6-4dd1-921a-4c6f4635501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:56.575304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6177e7b-79d6-4dd1-921a-4c6f4635501d None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:56.575580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6177e7b-79d6-4dd1-921a-4c6f4635501d None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:56.575927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6177e7b-79d6-4dd1-921a-4c6f4635501d None admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:56.576691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6177e7b-79d6-4dd1-921a-4c6f4635501d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:56.577257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6177e7b-79d6-4dd1-921a-4c6f4635501d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:56.578836 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6177e7b-79d6-4dd1-921a-4c6f4635501d None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:56.589875 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:56.600787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 634/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Aug 22 15:52:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:56.607142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd984f0-538f-4875-9e51-0da8d77ba005 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:56.723986 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd984f0-538f-4875-9e51-0da8d77ba005 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:56.786494 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d5a93-d114-4891-ab8a-a2f065a29ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:56.787500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d5a93-d114-4891-ab8a-a2f065a29ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:56.787966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d5a93-d114-4891-ab8a-a2f065a29ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:56.788417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d5a93-d114-4891-ab8a-a2f065a29ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:56.808485 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d5a93-d114-4891-ab8a-a2f065a29ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:56.811068 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d5a93-d114-4891-ab8a-a2f065a29ee0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-167d5a93-d114-4891-ab8a-a2f065a29ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:52:56.836312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:56.837540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:52:56.838820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:52:56.838820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:52:56.838820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:52:56.838820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 635/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:56.844678 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6177e7b-79d6-4dd1-921a-4c6f4635501d None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:56.972308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6177e7b-79d6-4dd1-921a-4c6f4635501d None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:57.039773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6677ab7-fc20-4dba-a7ce-6d8fc36044f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:57.040672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6677ab7-fc20-4dba-a7ce-6d8fc36044f4 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:57.041142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6677ab7-fc20-4dba-a7ce-6d8fc36044f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:57.041620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6677ab7-fc20-4dba-a7ce-6d8fc36044f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:57.042829 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6677ab7-fc20-4dba-a7ce-6d8fc36044f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:57.043362 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6677ab7-fc20-4dba-a7ce-6d8fc36044f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:57.045964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6677ab7-fc20-4dba-a7ce-6d8fc36044f4 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:57.067704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 635/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:57.073633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d5a93-d114-4891-ab8a-a2f065a29ee0 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:57.108022 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:57.185918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d5a93-d114-4891-ab8a-a2f065a29ee0 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:57.224290 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b1f03-9d84-4a77-9c18-6d62bacfcbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:57.224931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b1f03-9d84-4a77-9c18-6d62bacfcbea None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:57.225206 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b1f03-9d84-4a77-9c18-6d62bacfcbea None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:57.225475 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b1f03-9d84-4a77-9c18-6d62bacfcbea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:57.232950 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b1f03-9d84-4a77-9c18-6d62bacfcbea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:57.234417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b1f03-9d84-4a77-9c18-6d62bacfcbea None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-712b1f03-9d84-4a77-9c18-6d62bacfcbea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:52:57.246907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:52:57.248033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:52:57.249391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:52:57.249391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:52:57.249391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:52:57.249391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:52:57.249391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:52:57.249391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:52:57.249391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:52:57.249391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:52:57.249391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 636/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:52:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:52:57.254223 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6677ab7-fc20-4dba-a7ce-6d8fc36044f4 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:57.315035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:57.358791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6677ab7-fc20-4dba-a7ce-6d8fc36044f4 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:57.393420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e53254-45d7-474f-abb6-5994552bafcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:57.394054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53254-45d7-474f-abb6-5994552bafcc None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:57.394334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53254-45d7-474f-abb6-5994552bafcc None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:57.394639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e53254-45d7-474f-abb6-5994552bafcc None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:57.395338 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e53254-45d7-474f-abb6-5994552bafcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:52:57.395643 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e53254-45d7-474f-abb6-5994552bafcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:57.397098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e53254-45d7-474f-abb6-5994552bafcc None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:57.410265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 636/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:52:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:52:57.416685 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b1f03-9d84-4a77-9c18-6d62bacfcbea None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:57.515163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:52:57.524682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b1f03-9d84-4a77-9c18-6d62bacfcbea None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:57.561293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d76ce4-1ae5-48ae-92e6-c926f5e80b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:52:57.561972 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d76ce4-1ae5-48ae-92e6-c926f5e80b6e None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:57.562250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d76ce4-1ae5-48ae-92e6-c926f5e80b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:57.562522 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d76ce4-1ae5-48ae-92e6-c926f5e80b6e None admin] PATH_INFO: `/v3/projects/318c7f21f9d14e149f668863f748e89f/users/4be9a664d10d438382b9e359b26ba86e/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:57.564601 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d76ce4-1ae5-48ae-92e6-c926f5e80b6e None admin] RBAC: Authorizing `identity:create_grant(project_id=318c7f21f9d14e149f668863f748e89f, user_id=4be9a664d10d438382b9e359b26ba86e, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:52:57.566444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d76ce4-1ae5-48ae-92e6-c926f5e80b6e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:52:57.581514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 637/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Mon Aug 22 15:52:57 2022] PUT /identity/v3/projects/318c7f21f9d14e149f668863f748e89f/users/4be9a664d10d438382b9e359b26ba86e/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:52:59.472377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d809c8-88ed-43a7-9e01-8174ddf2b3ab None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:59.472916 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d809c8-88ed-43a7-9e01-8174ddf2b3ab None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:59.472916 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d809c8-88ed-43a7-9e01-8174ddf2b3ab None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:59.474265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 637/1274] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:52:59.479942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472a40-aff6-4bec-b6e7-2aada9fb606e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:52:59.480476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472a40-aff6-4bec-b6e7-2aada9fb606e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:52:59.480476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472a40-aff6-4bec-b6e7-2aada9fb606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:52:59.500734 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e6472a40-aff6-4bec-b6e7-2aada9fb606e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:52:59.501991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e6472a40-aff6-4bec-b6e7-2aada9fb606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:52:59.574751 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 638/1275] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:52:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:52:59.839639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d809c8-88ed-43a7-9e01-8174ddf2b3ab None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:52:59.956567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d809c8-88ed-43a7-9e01-8174ddf2b3ab None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:52:59.977719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:00.000983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade0274-8e26-45cd-88a2-5800c679cdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:00.001621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade0274-8e26-45cd-88a2-5800c679cdea None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:00.001875 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade0274-8e26-45cd-88a2-5800c679cdea None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:00.002264 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade0274-8e26-45cd-88a2-5800c679cdea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:00.014028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade0274-8e26-45cd-88a2-5800c679cdea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-2ade0274-8e26-45cd-88a2-5800c679cdea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 15:53:00.019020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:53:00.020626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:53:00.021995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:53:00.021995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:53:00.021995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:53:00.021995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:53:00.021995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 15:53:00.021995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 15:53:00.021995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 15:53:00.021995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 15:53:00.021995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 15:53:00.021995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 15:53:00.021995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 15:53:00.021995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:53:00.021995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 638/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Mon Aug 22 15:52:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:53:00.026404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6472a40-aff6-4bec-b6e7-2aada9fb606e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:00.115940 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:00.136360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6472a40-aff6-4bec-b6e7-2aada9fb606e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:00.181109 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32de288-68bb-4712-8eae-dcb15f6afa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:00.182047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de288-68bb-4712-8eae-dcb15f6afa38 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:00.182409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de288-68bb-4712-8eae-dcb15f6afa38 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:00.182867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de288-68bb-4712-8eae-dcb15f6afa38 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:00.183944 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32de288-68bb-4712-8eae-dcb15f6afa38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:53:00.184439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32de288-68bb-4712-8eae-dcb15f6afa38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:00.186392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32de288-68bb-4712-8eae-dcb15f6afa38 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:00.199087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 639/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Mon Aug 22 15:53:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:53:00.205616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade0274-8e26-45cd-88a2-5800c679cdea None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:00.331220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade0274-8e26-45cd-88a2-5800c679cdea None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:00.369895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7999fc-b958-419d-bb41-65389f264e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:00.370449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7999fc-b958-419d-bb41-65389f264e03 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:00.370757 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7999fc-b958-419d-bb41-65389f264e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:00.371029 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7999fc-b958-419d-bb41-65389f264e03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:00.381599 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7999fc-b958-419d-bb41-65389f264e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:00.383124 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7999fc-b958-419d-bb41-65389f264e03 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-1a7999fc-b958-419d-bb41-65389f264e03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:53:00.397857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:53:00.398994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:53:00.400182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:53:00.400182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:53:00.400182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:53:00.400182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 639/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:53:00.407848 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32de288-68bb-4712-8eae-dcb15f6afa38 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:00.521957 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32de288-68bb-4712-8eae-dcb15f6afa38 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:00.556171 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098dcbb-603a-4757-bda2-b3091e0ae50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:00.556793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098dcbb-603a-4757-bda2-b3091e0ae50d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:00.557069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098dcbb-603a-4757-bda2-b3091e0ae50d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:00.557345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098dcbb-603a-4757-bda2-b3091e0ae50d None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:00.558018 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098dcbb-603a-4757-bda2-b3091e0ae50d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:53:00.558317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098dcbb-603a-4757-bda2-b3091e0ae50d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:00.559861 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098dcbb-603a-4757-bda2-b3091e0ae50d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:00.572808 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 640/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:53:00.579444 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7999fc-b958-419d-bb41-65389f264e03 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:00.613306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:00.703221 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7999fc-b958-419d-bb41-65389f264e03 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:00.738587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34454d13-ede9-402d-b798-4f0638dc3201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:00.739242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34454d13-ede9-402d-b798-4f0638dc3201 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:00.739528 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34454d13-ede9-402d-b798-4f0638dc3201 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:00.739783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34454d13-ede9-402d-b798-4f0638dc3201 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:00.748603 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34454d13-ede9-402d-b798-4f0638dc3201 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:00.750069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34454d13-ede9-402d-b798-4f0638dc3201 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-34454d13-ede9-402d-b798-4f0638dc3201 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 15:53:00.761766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:53:00.763021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:53:00.764181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:53:00.764181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:53:00.764181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 15:53:00.764181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 15:53:00.764181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 15:53:00.764181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 15:53:00.764181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 15:53:00.764181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 15:53:00.764181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 15:53:00.764181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:53:00.764181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 640/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:53:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:53:00.769127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098dcbb-603a-4757-bda2-b3091e0ae50d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:00.773130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:00.883002 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098dcbb-603a-4757-bda2-b3091e0ae50d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:00.921501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025cde9-ecb5-41c4-8d2d-9e12d5ddb58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:00.922116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025cde9-ecb5-41c4-8d2d-9e12d5ddb58b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:00.922393 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025cde9-ecb5-41c4-8d2d-9e12d5ddb58b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:00.922774 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025cde9-ecb5-41c4-8d2d-9e12d5ddb58b None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:00.923439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025cde9-ecb5-41c4-8d2d-9e12d5ddb58b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:53:00.923740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025cde9-ecb5-41c4-8d2d-9e12d5ddb58b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:00.925181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025cde9-ecb5-41c4-8d2d-9e12d5ddb58b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:00.952921 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 641/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Mon Aug 22 15:53:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:53:00.959918 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34454d13-ede9-402d-b798-4f0638dc3201 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:01.062119 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:01.073715 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34454d13-ede9-402d-b798-4f0638dc3201 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:01.122340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d4f97-870b-4819-889d-28fd2f7d8a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:01.122980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d4f97-870b-4819-889d-28fd2f7d8a1f None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:01.123254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d4f97-870b-4819-889d-28fd2f7d8a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:01.123517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d4f97-870b-4819-889d-28fd2f7d8a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:01.194944 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d4f97-870b-4819-889d-28fd2f7d8a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:01.196429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d4f97-870b-4819-889d-28fd2f7d8a1f None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:01.293860 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:01.306335 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 641/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Mon Aug 22 15:53:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 15:53:01.312357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025cde9-ecb5-41c4-8d2d-9e12d5ddb58b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:01.397423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:01.444561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025cde9-ecb5-41c4-8d2d-9e12d5ddb58b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:01.482816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fb4ed-27a4-412a-bcdb-2f677f704154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:01.483442 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fb4ed-27a4-412a-bcdb-2f677f704154 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:01.483717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fb4ed-27a4-412a-bcdb-2f677f704154 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:01.483989 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fb4ed-27a4-412a-bcdb-2f677f704154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:01.495448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fb4ed-27a4-412a-bcdb-2f677f704154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:01.496918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146fb4ed-27a4-412a-bcdb-2f677f704154 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-146fb4ed-27a4-412a-bcdb-2f677f704154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 15:53:01.512651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:53:01.513729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 15:53:01.515153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 15:53:01.515153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 15:53:01.515153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:53:01.515153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 642/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:53:01.522839 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d4f97-870b-4819-889d-28fd2f7d8a1f None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:01.629081 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d4f97-870b-4819-889d-28fd2f7d8a1f None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:01.669497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e59f3-d453-4a55-9d0c-34f580b97c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:01.670103 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e59f3-d453-4a55-9d0c-34f580b97c23 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:01.670387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e59f3-d453-4a55-9d0c-34f580b97c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:01.670666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e59f3-d453-4a55-9d0c-34f580b97c23 None admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:01.671347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e59f3-d453-4a55-9d0c-34f580b97c23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:53:01.671643 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e59f3-d453-4a55-9d0c-34f580b97c23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:01.673031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e59f3-d453-4a55-9d0c-34f580b97c23 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:01.686138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 642/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Mon Aug 22 15:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:53:01.695342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fb4ed-27a4-412a-bcdb-2f677f704154 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:01.805373 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146fb4ed-27a4-412a-bcdb-2f677f704154 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:01.819420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:01.842996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea72757-6561-4836-b3d6-f1c7080cdfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:01.843622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72757-6561-4836-b3d6-f1c7080cdfbe None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:01.843868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72757-6561-4836-b3d6-f1c7080cdfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:01.844166 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72757-6561-4836-b3d6-f1c7080cdfbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:01.851701 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea72757-6561-4836-b3d6-f1c7080cdfbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:01.853160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea72757-6561-4836-b3d6-f1c7080cdfbe None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-9ea72757-6561-4836-b3d6-f1c7080cdfbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 15:53:01.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:53:01.867221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:53:01.868160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 15:53:01.868160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 15:53:01.868160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 15:53:01.868160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 15:53:01.868160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 15:53:01.868160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 15:53:01.868160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 15:53:01.868160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 22 15:53:01.868160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 643/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Mon Aug 22 15:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:53:01.873469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e59f3-d453-4a55-9d0c-34f580b97c23 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:01.933603 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:01.990138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e59f3-d453-4a55-9d0c-34f580b97c23 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:02.026365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b112be-1c22-4f14-bd66-45cba7bd75ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:02.027005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b112be-1c22-4f14-bd66-45cba7bd75ac None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:02.027281 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b112be-1c22-4f14-bd66-45cba7bd75ac None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:02.027555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b112be-1c22-4f14-bd66-45cba7bd75ac None admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:02.028225 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b112be-1c22-4f14-bd66-45cba7bd75ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:53:02.028663 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b112be-1c22-4f14-bd66-45cba7bd75ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:02.030192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b112be-1c22-4f14-bd66-45cba7bd75ac None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:02.043811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 643/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Mon Aug 22 15:53:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:53:02.050481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea72757-6561-4836-b3d6-f1c7080cdfbe None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:02.163959 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea72757-6561-4836-b3d6-f1c7080cdfbe None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:02.200302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3696231-7125-41ca-adbb-e36de0ec0339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:02.200829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3696231-7125-41ca-adbb-e36de0ec0339 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:02.201105 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3696231-7125-41ca-adbb-e36de0ec0339 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:02.201377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3696231-7125-41ca-adbb-e36de0ec0339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:02.202100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3696231-7125-41ca-adbb-e36de0ec0339 None admin] RBAC: Adding query filter params (role.id=41aa3bb5f36a426dbbe80a309d9e5ab7, scope.project.id=318c7f21f9d14e149f668863f748e89f, user.id=4be9a664d10d438382b9e359b26ba86e) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:53:02.202408 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3696231-7125-41ca-adbb-e36de0ec0339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:02.203877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3696231-7125-41ca-adbb-e36de0ec0339 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:02.210337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 644/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Mon Aug 22 15:53:02 2022] GET /identity/v3/role_assignments?user.id=4be9a664d10d438382b9e359b26ba86e&scope.project.id=318c7f21f9d14e149f668863f748e89f&role.id=41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 15:53:04.132503 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4011f5e-e868-47fd-ba30-328af5304404 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:04.133117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4011f5e-e868-47fd-ba30-328af5304404 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:04.133117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4011f5e-e868-47fd-ba30-328af5304404 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:04.134399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 644/1288] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:53:04.140917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d165a7-6ec6-40e4-b0c2-5bf3ebce9c1c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:04.141483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d165a7-6ec6-40e4-b0c2-5bf3ebce9c1c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:04.141662 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d165a7-6ec6-40e4-b0c2-5bf3ebce9c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:04.164288 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-19d165a7-6ec6-40e4-b0c2-5bf3ebce9c1c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:53:04.165524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-19d165a7-6ec6-40e4-b0c2-5bf3ebce9c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:04.199649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:04.242970 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 645/1289] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:53:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:53:04.506904 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4011f5e-e868-47fd-ba30-328af5304404 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:04.635377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4011f5e-e868-47fd-ba30-328af5304404 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:04.647479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:04.674225 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deda4a4-8956-4909-91c4-ac6665399a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:04.675043 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deda4a4-8956-4909-91c4-ac6665399a0a None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:04.675326 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deda4a4-8956-4909-91c4-ac6665399a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:04.675595 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deda4a4-8956-4909-91c4-ac6665399a0a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:04.676170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deda4a4-8956-4909-91c4-ac6665399a0a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:04.677559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deda4a4-8956-4909-91c4-ac6665399a0a None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-9deda4a4-8956-4909-91c4-ac6665399a0a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:53:04.686954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:53:04.688360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:53:04.689245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 645/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 22 15:53:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:53:04.694923 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d165a7-6ec6-40e4-b0c2-5bf3ebce9c1c None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:04.797578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d165a7-6ec6-40e4-b0c2-5bf3ebce9c1c None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:04.835902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de86321-fd3f-4154-9300-77cba112d646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:04.836541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de86321-fd3f-4154-9300-77cba112d646 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:04.836800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de86321-fd3f-4154-9300-77cba112d646 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:04.837084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de86321-fd3f-4154-9300-77cba112d646 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:04.837724 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de86321-fd3f-4154-9300-77cba112d646 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:53:04.838025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de86321-fd3f-4154-9300-77cba112d646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:04.839459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de86321-fd3f-4154-9300-77cba112d646 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:04.845368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 646/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Mon Aug 22 15:53:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:53:04.851472 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deda4a4-8956-4909-91c4-ac6665399a0a None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:04.969380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deda4a4-8956-4909-91c4-ac6665399a0a None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:05.016684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbec47-7097-437b-a248-928bb3e990f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:05.017318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbec47-7097-437b-a248-928bb3e990f7 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:05.017601 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbec47-7097-437b-a248-928bb3e990f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:05.017867 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbec47-7097-437b-a248-928bb3e990f7 None admin] PATH_INFO: `/v3/services` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:05.018710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbec47-7097-437b-a248-928bb3e990f7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:53:05.018992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbec47-7097-437b-a248-928bb3e990f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:05.020418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbec47-7097-437b-a248-928bb3e990f7 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:05.025773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 646/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Mon Aug 22 15:53:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:53:06.957630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed5444-42ea-4b90-b74f-ca7e2c1afd75 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:06.958230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed5444-42ea-4b90-b74f-ca7e2c1afd75 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:06.958230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed5444-42ea-4b90-b74f-ca7e2c1afd75 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:06.959563 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 647/1293] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:53:06.965113 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe4ac-5dbe-41d8-8e41-a7e54dff66bf None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:06.965607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe4ac-5dbe-41d8-8e41-a7e54dff66bf None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:06.965713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe4ac-5dbe-41d8-8e41-a7e54dff66bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:06.984697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c10fe4ac-5dbe-41d8-8e41-a7e54dff66bf None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:53:06.985918 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c10fe4ac-5dbe-41d8-8e41-a7e54dff66bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:07.018107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:07.058144 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 647/1294] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:53:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:53:07.324556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed5444-42ea-4b90-b74f-ca7e2c1afd75 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:07.359162 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:07.437029 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed5444-42ea-4b90-b74f-ca7e2c1afd75 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:07.474241 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63302b-b84d-443b-97d3-3e360e6c762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:07.474898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63302b-b84d-443b-97d3-3e360e6c762f None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:07.475178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63302b-b84d-443b-97d3-3e360e6c762f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:07.475452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63302b-b84d-443b-97d3-3e360e6c762f None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:07.476118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63302b-b84d-443b-97d3-3e360e6c762f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:07.477523 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63302b-b84d-443b-97d3-3e360e6c762f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:07.497141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 648/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Mon Aug 22 15:53:07 2022] POST /identity/v3/services => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:53:09.442331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3b732-2734-47e3-8e8a-5a37ffc2706a None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:09.442989 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3b732-2734-47e3-8e8a-5a37ffc2706a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:09.442989 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3b732-2734-47e3-8e8a-5a37ffc2706a None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:09.444434 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 648/1296] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:53:09.450864 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408d53f-2795-4362-b32c-6cea1fed7c7f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:09.451433 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408d53f-2795-4362-b32c-6cea1fed7c7f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:09.451433 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408d53f-2795-4362-b32c-6cea1fed7c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:09.471234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0408d53f-2795-4362-b32c-6cea1fed7c7f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:53:09.472467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0408d53f-2795-4362-b32c-6cea1fed7c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:09.558424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 649/1297] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:53:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:53:09.825062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3b732-2734-47e3-8e8a-5a37ffc2706a None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:09.951669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3b732-2734-47e3-8e8a-5a37ffc2706a None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:09.996919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8224f99-412a-414e-8925-7e086e3815c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:09.997858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8224f99-412a-414e-8925-7e086e3815c4 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:09.998134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8224f99-412a-414e-8925-7e086e3815c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:09.998488 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8224f99-412a-414e-8925-7e086e3815c4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:09.999127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8224f99-412a-414e-8925-7e086e3815c4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:10.000617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8224f99-412a-414e-8925-7e086e3815c4 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-f8224f99-412a-414e-8925-7e086e3815c4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:53:10.010126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:53:10.011669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:53:10.012709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 649/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 22 15:53:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:53:10.017980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408d53f-2795-4362-b32c-6cea1fed7c7f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:10.039724 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:10.126181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408d53f-2795-4362-b32c-6cea1fed7c7f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:10.168861 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911b705-08a0-4bca-ac99-cd83d4a039ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:10.169486 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911b705-08a0-4bca-ac99-cd83d4a039ca None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:10.169769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911b705-08a0-4bca-ac99-cd83d4a039ca None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:10.170041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911b705-08a0-4bca-ac99-cd83d4a039ca None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:10.170715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911b705-08a0-4bca-ac99-cd83d4a039ca None admin] RBAC: Adding query filter params (name=placement) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:53:10.171018 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911b705-08a0-4bca-ac99-cd83d4a039ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:10.172407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911b705-08a0-4bca-ac99-cd83d4a039ca None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:10.178732 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 650/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Mon Aug 22 15:53:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:53:10.185256 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8224f99-412a-414e-8925-7e086e3815c4 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:10.217386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:10.301810 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8224f99-412a-414e-8925-7e086e3815c4 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:10.341354 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb64870-3daa-40bf-af27-9f0616bc3314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:10.341971 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb64870-3daa-40bf-af27-9f0616bc3314 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:10.342273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb64870-3daa-40bf-af27-9f0616bc3314 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:10.342553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb64870-3daa-40bf-af27-9f0616bc3314 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:10.343295 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb64870-3daa-40bf-af27-9f0616bc3314 None admin] RBAC: Adding query filter params (interface=public, service_id=e5a13fde5c7c477798245ba70cc7be16, region_id=RegionOne) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:53:10.343606 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb64870-3daa-40bf-af27-9f0616bc3314 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:10.345057 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb64870-3daa-40bf-af27-9f0616bc3314 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:10.350882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 650/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Mon Aug 22 15:53:10 2022] GET /identity/v3/endpoints?service_id=e5a13fde5c7c477798245ba70cc7be16&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:53:10.357113 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911b705-08a0-4bca-ac99-cd83d4a039ca None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:10.464986 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:10.485458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911b705-08a0-4bca-ac99-cd83d4a039ca None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:10.523589 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f844a43-52a8-4ed5-b7ac-5733c99883b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:10.524187 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f844a43-52a8-4ed5-b7ac-5733c99883b8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:10.524460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f844a43-52a8-4ed5-b7ac-5733c99883b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:10.524730 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f844a43-52a8-4ed5-b7ac-5733c99883b8 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:10.525329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f844a43-52a8-4ed5-b7ac-5733c99883b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:10.526724 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f844a43-52a8-4ed5-b7ac-5733c99883b8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:10.533827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 651/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Mon Aug 22 15:53:10 2022] GET /identity/v3/services => generated 2191 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:53:12.430311 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9ddc-db89-4fe7-92ce-2dbdb7995d72 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:12.431307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9ddc-db89-4fe7-92ce-2dbdb7995d72 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:12.431307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9ddc-db89-4fe7-92ce-2dbdb7995d72 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:12.433421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 651/1302] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:53:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:53:12.439738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf6739-3aea-4c08-909a-3d631859ced0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:12.440865 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf6739-3aea-4c08-909a-3d631859ced0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:12.441008 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf6739-3aea-4c08-909a-3d631859ced0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:12.466099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1dcf6739-3aea-4c08-909a-3d631859ced0 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:53:12.467541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1dcf6739-3aea-4c08-909a-3d631859ced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:53:12.561675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 652/1303] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:53:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 15:53:12.827536 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e9ddc-db89-4fe7-92ce-2dbdb7995d72 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:12.933039 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:12.941002 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e9ddc-db89-4fe7-92ce-2dbdb7995d72 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:12.977269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeec939-5104-46cd-9bfd-f02154e91cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:12.977915 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeec939-5104-46cd-9bfd-f02154e91cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:12.978191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeec939-5104-46cd-9bfd-f02154e91cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:12.978461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeec939-5104-46cd-9bfd-f02154e91cd7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:12.979096 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeec939-5104-46cd-9bfd-f02154e91cd7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:12.980509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeec939-5104-46cd-9bfd-f02154e91cd7 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application [None req-aaeec939-5104-46cd-9bfd-f02154e91cd7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 15:53:12.989671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 15:53:12.990968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application with Lock( Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self._enter() Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application return self.creator() Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application created_value = creator( Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: ERROR keystone.server.flask.application Aug 22 15:53:12.992072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 652/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Mon Aug 22 15:53:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 15:53:12.997333 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf6739-3aea-4c08-909a-3d631859ced0 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:13.082495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:13.107624 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf6739-3aea-4c08-909a-3d631859ced0 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:13.146028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b979235-10dc-4cc4-9a0d-a66cc9f60365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:13.146641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b979235-10dc-4cc4-9a0d-a66cc9f60365 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:13.146931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b979235-10dc-4cc4-9a0d-a66cc9f60365 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:13.147206 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b979235-10dc-4cc4-9a0d-a66cc9f60365 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:13.147834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b979235-10dc-4cc4-9a0d-a66cc9f60365 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:53:13.148130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b979235-10dc-4cc4-9a0d-a66cc9f60365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:13.149512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b979235-10dc-4cc4-9a0d-a66cc9f60365 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:13.155071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 653/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Mon Aug 22 15:53:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:53:13.164048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeec939-5104-46cd-9bfd-f02154e91cd7 None admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:53:13.271745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeec939-5104-46cd-9bfd-f02154e91cd7 None admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:53:13.307384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe7d1c-7581-47a0-abe3-bdc9f74d15f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:53:13.307987 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7d1c-7581-47a0-abe3-bdc9f74d15f5 None admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:53:13.308259 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7d1c-7581-47a0-abe3-bdc9f74d15f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:53:13.308522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7d1c-7581-47a0-abe3-bdc9f74d15f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:53:13.309237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe7d1c-7581-47a0-abe3-bdc9f74d15f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:53:13.310635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe7d1c-7581-47a0-abe3-bdc9f74d15f5 None admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:53:13.333900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 653/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 15:53:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:53:23.151842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=30 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:53:23.329451 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:19.839601 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e2d0b-c28f-4ec1-9ae9-59b0cdcd5cf6 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:19.840732 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e2d0b-c28f-4ec1-9ae9-59b0cdcd5cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:19.841226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e2d0b-c28f-4ec1-9ae9-59b0cdcd5cf6 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:19.847533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 654/1307] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:54:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:54:19.848995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6cd79-7f5f-4227-aa1d-6f1292770241 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:19.849547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6cd79-7f5f-4227-aa1d-6f1292770241 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:19.849547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6cd79-7f5f-4227-aa1d-6f1292770241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:19.942842 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-54a6cd79-7f5f-4227-aa1d-6f1292770241 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:54:19.944127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-54a6cd79-7f5f-4227-aa1d-6f1292770241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:20.094420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 654/1308] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:54:20.565654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c0ab9-22fc-44be-8c73-fde940bf8456 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:20.566388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c0ab9-22fc-44be-8c73-fde940bf8456 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:20.566899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c0ab9-22fc-44be-8c73-fde940bf8456 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:20.568629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 655/1309] 10.222.0.77 () {54 vars in 965 bytes} [Mon Aug 22 15:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:54:20.576076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ea564-16ff-4169-a065-961bf338b7af None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:20.576758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ea564-16ff-4169-a065-961bf338b7af None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:20.577230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ea564-16ff-4169-a065-961bf338b7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:20.688897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-d19ea564-16ff-4169-a065-961bf338b7af None None] MFA Rules not processed for user `104abc0b38524a2f95ffe96c5872362c`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:54:20.690861 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d19ea564-16ff-4169-a065-961bf338b7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:20.718462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:20.804436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 655/1310] 10.222.0.77 () {58 vars in 1062 bytes} [Mon Aug 22 15:54:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:54:20.818289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c0ab9-22fc-44be-8c73-fde940bf8456 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:54:20.820985 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5c8c0ab9-22fc-44be-8c73-fde940bf8456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:21.002683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c0ab9-22fc-44be-8c73-fde940bf8456 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:54:21.106948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5401f6-f758-4bb5-b6d2-0e9fb1683c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:54:21.107577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5401f6-f758-4bb5-b6d2-0e9fb1683c41 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:21.107835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5401f6-f758-4bb5-b6d2-0e9fb1683c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:21.108098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5401f6-f758-4bb5-b6d2-0e9fb1683c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:21.109821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8f5401f6-f758-4bb5-b6d2-0e9fb1683c41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:21.198770 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:21.282806 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5401f6-f758-4bb5-b6d2-0e9fb1683c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:54:21.285467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5401f6-f758-4bb5-b6d2-0e9fb1683c41 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:54:21.312913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 656/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:54:23.773061 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1846492-403e-48d3-be50-93df923a9de8 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:23.773061 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1846492-403e-48d3-be50-93df923a9de8 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:23.773061 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1846492-403e-48d3-be50-93df923a9de8 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:23.774238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 656/1312] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:54:23.780061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09431084-b4e7-4190-9269-f1b4f5f206a9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:23.780516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09431084-b4e7-4190-9269-f1b4f5f206a9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:23.780601 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09431084-b4e7-4190-9269-f1b4f5f206a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:23.869826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-09431084-b4e7-4190-9269-f1b4f5f206a9 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:54:23.871115 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-09431084-b4e7-4190-9269-f1b4f5f206a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:23.976453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 657/1313] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:54:24.270724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5eca1-ec81-492e-b4ce-dbc5b8c45801 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:24.270979 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5eca1-ec81-492e-b4ce-dbc5b8c45801 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:24.271266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5eca1-ec81-492e-b4ce-dbc5b8c45801 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:24.272674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 657/1314] 10.222.0.77 () {54 vars in 965 bytes} [Mon Aug 22 15:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:54:24.279071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807900-8667-41c6-8fd6-07b18c268366 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:24.279351 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807900-8667-41c6-8fd6-07b18c268366 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:24.279621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807900-8667-41c6-8fd6-07b18c268366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:24.292353 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:24.372575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4d807900-8667-41c6-8fd6-07b18c268366 None None] MFA Rules not processed for user `104abc0b38524a2f95ffe96c5872362c`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:54:24.373847 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4d807900-8667-41c6-8fd6-07b18c268366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:24.454460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 658/1315] 10.222.0.77 () {58 vars in 1062 bytes} [Mon Aug 22 15:54:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:54:24.465579 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5eca1-ec81-492e-b4ce-dbc5b8c45801 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:54:24.467279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-11e5eca1-ec81-492e-b4ce-dbc5b8c45801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:24.593249 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5eca1-ec81-492e-b4ce-dbc5b8c45801 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:54:24.670095 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:24.672676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25d233-4be7-4197-acb2-0aaa11753b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:54:24.673305 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25d233-4be7-4197-acb2-0aaa11753b03 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:24.673634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25d233-4be7-4197-acb2-0aaa11753b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:24.673914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25d233-4be7-4197-acb2-0aaa11753b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:24.676371 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8c25d233-4be7-4197-acb2-0aaa11753b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:24.798686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25d233-4be7-4197-acb2-0aaa11753b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:54:24.800191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25d233-4be7-4197-acb2-0aaa11753b03 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:54:24.824147 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 658/1316] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:54:27.297357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7fa4-97d1-489c-ae56-bc4d10e88d4c None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:27.298562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7fa4-97d1-489c-ae56-bc4d10e88d4c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:27.298562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7fa4-97d1-489c-ae56-bc4d10e88d4c None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:27.299639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 659/1317] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:54:27.306489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dbd22-ec88-4653-b780-33790f0a22f8 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:27.307301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dbd22-ec88-4653-b780-33790f0a22f8 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:27.307301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391dbd22-ec88-4653-b780-33790f0a22f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:27.378653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-391dbd22-ec88-4653-b780-33790f0a22f8 None None] MFA Rules not processed for user `7844dee1bb874523a45debbded632cde`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:54:27.379903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-391dbd22-ec88-4653-b780-33790f0a22f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:27.442423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:27.493039 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 659/1318] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:54:27 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:54:27.779556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda7fa4-97d1-489c-ae56-bc4d10e88d4c None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:54:27.781134 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7eda7fa4-97d1-489c-ae56-bc4d10e88d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:27.893066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda7fa4-97d1-489c-ae56-bc4d10e88d4c None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:54:27.895998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:27.981275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3e83f-b0a7-4255-bc2c-194686aa1ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:54:27.981796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3e83f-b0a7-4255-bc2c-194686aa1ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:27.982075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3e83f-b0a7-4255-bc2c-194686aa1ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:27.982337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3e83f-b0a7-4255-bc2c-194686aa1ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:27.984001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7aa3e83f-b0a7-4255-bc2c-194686aa1ec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:28.101028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3e83f-b0a7-4255-bc2c-194686aa1ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:54:28.102489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3e83f-b0a7-4255-bc2c-194686aa1ec1 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:54:28.121478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 660/1319] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:54:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:54:30.784418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91da25-8472-404b-bbbf-399eea152c6f None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:30.784995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91da25-8472-404b-bbbf-399eea152c6f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:30.784995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91da25-8472-404b-bbbf-399eea152c6f None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:30.786314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 660/1320] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:54:30.792919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d0993-0428-4043-90e1-8227cc82b440 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:30.793385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d0993-0428-4043-90e1-8227cc82b440 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:30.793485 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d0993-0428-4043-90e1-8227cc82b440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:30.839588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:30.871820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d75d0993-0428-4043-90e1-8227cc82b440 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:54:30.873060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d75d0993-0428-4043-90e1-8227cc82b440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:30.977200 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 661/1321] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:54:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:54:31.260748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91da25-8472-404b-bbbf-399eea152c6f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:54:31.262320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1f91da25-8472-404b-bbbf-399eea152c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:31.379353 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91da25-8472-404b-bbbf-399eea152c6f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:54:31.456051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590c1de-3bfe-4c3e-8312-8bd2d3b5b350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:54:31.456673 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590c1de-3bfe-4c3e-8312-8bd2d3b5b350 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:31.456930 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590c1de-3bfe-4c3e-8312-8bd2d3b5b350 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:31.457196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590c1de-3bfe-4c3e-8312-8bd2d3b5b350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:31.458821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3590c1de-3bfe-4c3e-8312-8bd2d3b5b350 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:31.466382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:31.599170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590c1de-3bfe-4c3e-8312-8bd2d3b5b350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:54:31.601137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590c1de-3bfe-4c3e-8312-8bd2d3b5b350 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:54:31.623658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 661/1322] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:54:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:54:34.281976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f74f5f-090f-49d5-a92f-b862f3196185 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:34.282729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f74f5f-090f-49d5-a92f-b862f3196185 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:34.282729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f74f5f-090f-49d5-a92f-b862f3196185 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:34.283984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 662/1323] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:54:34.289720 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e34a-bed5-4c94-97e8-2e1a94c121cd None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:34.290160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e34a-bed5-4c94-97e8-2e1a94c121cd None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:34.290273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e34a-bed5-4c94-97e8-2e1a94c121cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:34.362263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-7e89e34a-bed5-4c94-97e8-2e1a94c121cd None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:54:34.363519 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7e89e34a-bed5-4c94-97e8-2e1a94c121cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:34.426308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:34.482085 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 662/1324] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:54:34.766049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f74f5f-090f-49d5-a92f-b862f3196185 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:54:34.767895 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-69f74f5f-090f-49d5-a92f-b862f3196185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:34.892714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f74f5f-090f-49d5-a92f-b862f3196185 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:54:34.905839 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:34.975921 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d6db7-d6f8-4727-8ae3-37628435c638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:54:34.976549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d6db7-d6f8-4727-8ae3-37628435c638 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:34.976825 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d6db7-d6f8-4727-8ae3-37628435c638 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:34.977095 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d6db7-d6f8-4727-8ae3-37628435c638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:34.978786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-003d6db7-d6f8-4727-8ae3-37628435c638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:35.094030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d6db7-d6f8-4727-8ae3-37628435c638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:54:35.095474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d6db7-d6f8-4727-8ae3-37628435c638 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:54:35.114068 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 663/1325] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:54:37.089244 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c8bf5-fe8a-41b5-9af6-723c9b11f69c None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:37.089796 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c8bf5-fe8a-41b5-9af6-723c9b11f69c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:37.089796 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c8bf5-fe8a-41b5-9af6-723c9b11f69c None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:37.091023 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 663/1326] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:54:37.096896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e0b61-5c03-4bdd-b7ea-fe7a9f4f9e89 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:37.097335 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e0b61-5c03-4bdd-b7ea-fe7a9f4f9e89 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:37.097591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e0b61-5c03-4bdd-b7ea-fe7a9f4f9e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:37.149204 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:37.169473 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f17e0b61-5c03-4bdd-b7ea-fe7a9f4f9e89 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:54:37.170721 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f17e0b61-5c03-4bdd-b7ea-fe7a9f4f9e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:37.275987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 664/1327] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:54:37.555631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c8bf5-fe8a-41b5-9af6-723c9b11f69c None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:54:37.557747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-404c8bf5-fe8a-41b5-9af6-723c9b11f69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:37.665641 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c8bf5-fe8a-41b5-9af6-723c9b11f69c None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:54:37.757510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c3ba2-b02c-4aa6-b895-de8168a78972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:54:37.758130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c3ba2-b02c-4aa6-b895-de8168a78972 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:37.758413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c3ba2-b02c-4aa6-b895-de8168a78972 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:37.758739 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c3ba2-b02c-4aa6-b895-de8168a78972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:37.760323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-299c3ba2-b02c-4aa6-b895-de8168a78972 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:37.778107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:37.874583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c3ba2-b02c-4aa6-b895-de8168a78972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:54:37.876112 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c3ba2-b02c-4aa6-b895-de8168a78972 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:54:37.895003 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 664/1328] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:54:39.874091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae29e2-da29-490d-aaca-eda79631f78b None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:39.875390 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae29e2-da29-490d-aaca-eda79631f78b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:39.875390 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae29e2-da29-490d-aaca-eda79631f78b None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:39.876397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 665/1329] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:54:39.882904 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34138e54-2994-443c-95cf-63abfbde3662 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:39.883460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34138e54-2994-443c-95cf-63abfbde3662 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:39.883460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34138e54-2994-443c-95cf-63abfbde3662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:39.985369 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-34138e54-2994-443c-95cf-63abfbde3662 None None] MFA Rules not processed for user `7844dee1bb874523a45debbded632cde`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:54:39.986731 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-34138e54-2994-443c-95cf-63abfbde3662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:40.060457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:40.096783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 665/1330] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:54:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:54:40.373352 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae29e2-da29-490d-aaca-eda79631f78b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:54:40.375112 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-02ae29e2-da29-490d-aaca-eda79631f78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:40.497766 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae29e2-da29-490d-aaca-eda79631f78b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:54:40.519552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:40.600932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fa6f6-caa3-4c4b-b3a0-3f188d0437bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:54:40.601457 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa6f6-caa3-4c4b-b3a0-3f188d0437bb service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:40.601734 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa6f6-caa3-4c4b-b3a0-3f188d0437bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:40.602005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa6f6-caa3-4c4b-b3a0-3f188d0437bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:40.603625 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-315fa6f6-caa3-4c4b-b3a0-3f188d0437bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:40.720916 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fa6f6-caa3-4c4b-b3a0-3f188d0437bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:54:40.722295 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fa6f6-caa3-4c4b-b3a0-3f188d0437bb service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:54:40.748069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 666/1331] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:54:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:54:42.913793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2383ee-0de8-4da7-bd36-d3ae1aeaf538 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:42.914363 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2383ee-0de8-4da7-bd36-d3ae1aeaf538 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:42.914363 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2383ee-0de8-4da7-bd36-d3ae1aeaf538 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:42.915763 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 666/1332] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:54:42.921183 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fff1ba-bfba-41e3-b69a-a9de833a8bb9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:42.921617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fff1ba-bfba-41e3-b69a-a9de833a8bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:42.921733 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fff1ba-bfba-41e3-b69a-a9de833a8bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:42.990537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:42.993913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-81fff1ba-bfba-41e3-b69a-a9de833a8bb9 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:54:42.995716 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-81fff1ba-bfba-41e3-b69a-a9de833a8bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:43.103737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 667/1333] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:54:43.381697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2383ee-0de8-4da7-bd36-d3ae1aeaf538 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:54:43.383311 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0a2383ee-0de8-4da7-bd36-d3ae1aeaf538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:43.512677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2383ee-0de8-4da7-bd36-d3ae1aeaf538 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:54:43.592771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84684788-a885-4dad-9b34-209dc825d738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:54:43.593371 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84684788-a885-4dad-9b34-209dc825d738 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:43.593647 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84684788-a885-4dad-9b34-209dc825d738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:43.593916 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84684788-a885-4dad-9b34-209dc825d738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:43.595581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-84684788-a885-4dad-9b34-209dc825d738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:43.623443 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:43.722907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84684788-a885-4dad-9b34-209dc825d738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:54:43.724367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84684788-a885-4dad-9b34-209dc825d738 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:54:43.743716 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 667/1334] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:54:45.667075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48990e-441b-48d0-ad58-432827810f65 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:45.667922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48990e-441b-48d0-ad58-432827810f65 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:45.667922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48990e-441b-48d0-ad58-432827810f65 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:45.670043 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 668/1335] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:54:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:54:45.679136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423dc9d-e20d-424e-825e-055157195ea6 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:45.679679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423dc9d-e20d-424e-825e-055157195ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:45.679808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423dc9d-e20d-424e-825e-055157195ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:45.765793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-5423dc9d-e20d-424e-825e-055157195ea6 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:54:45.767381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5423dc9d-e20d-424e-825e-055157195ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:45.856686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:45.883170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 668/1336] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:54:46.172929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48990e-441b-48d0-ad58-432827810f65 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:54:46.175464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-eb48990e-441b-48d0-ad58-432827810f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:46.290651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48990e-441b-48d0-ad58-432827810f65 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:54:46.323410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:46.376744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c6e93-debe-41e6-8cec-09bed54de2d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:54:46.377357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c6e93-debe-41e6-8cec-09bed54de2d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:46.377627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c6e93-debe-41e6-8cec-09bed54de2d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:46.377891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c6e93-debe-41e6-8cec-09bed54de2d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:46.379540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-522c6e93-debe-41e6-8cec-09bed54de2d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:46.515777 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c6e93-debe-41e6-8cec-09bed54de2d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:54:46.517279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c6e93-debe-41e6-8cec-09bed54de2d1 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:54:46.537989 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 669/1337] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:54:48.793400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c61b0-6681-42fc-86e5-ac0dc26d3c5e None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:48.794238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c61b0-6681-42fc-86e5-ac0dc26d3c5e None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:48.794238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c61b0-6681-42fc-86e5-ac0dc26d3c5e None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:48.796385 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 669/1338] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:54:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:54:48.802961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e3c19-cc32-491a-a0f1-263f27cabbfc None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:48.803566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e3c19-cc32-491a-a0f1-263f27cabbfc None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:48.803566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e3c19-cc32-491a-a0f1-263f27cabbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:48.876560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-307e3c19-cc32-491a-a0f1-263f27cabbfc None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:54:48.877765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-307e3c19-cc32-491a-a0f1-263f27cabbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:48.886297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:48.988158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 670/1339] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:54:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:54:49.274476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c61b0-6681-42fc-86e5-ac0dc26d3c5e None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:54:49.277046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-443c61b0-6681-42fc-86e5-ac0dc26d3c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:49.395330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c61b0-6681-42fc-86e5-ac0dc26d3c5e None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:54:49.475494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d855c-dc16-4634-814f-ac9c6e58f76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:54:49.476101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d855c-dc16-4634-814f-ac9c6e58f76a service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:49.476373 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d855c-dc16-4634-814f-ac9c6e58f76a service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:49.476641 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d855c-dc16-4634-814f-ac9c6e58f76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:49.478265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-cd6d855c-dc16-4634-814f-ac9c6e58f76a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:49.518327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:49.600078 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d855c-dc16-4634-814f-ac9c6e58f76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:54:49.601514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d855c-dc16-4634-814f-ac9c6e58f76a service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:54:49.620449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 670/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:54:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:54:53.547642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3221b7-72a8-41c2-a311-103681eb26bf None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:53.548259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3221b7-72a8-41c2-a311-103681eb26bf None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:53.548259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3221b7-72a8-41c2-a311-103681eb26bf None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:53.549606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 671/1341] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:54:53.555500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee30af4-6767-4c9e-95da-8347d945dc91 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:53.556011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee30af4-6767-4c9e-95da-8347d945dc91 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:53.556011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee30af4-6767-4c9e-95da-8347d945dc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:53.623415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-8ee30af4-6767-4c9e-95da-8347d945dc91 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:54:53.624613 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8ee30af4-6767-4c9e-95da-8347d945dc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:53.709551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:53.722972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 671/1342] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:54:54.005160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3221b7-72a8-41c2-a311-103681eb26bf None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:54:54.006857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0e3221b7-72a8-41c2-a311-103681eb26bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:54.116943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3221b7-72a8-41c2-a311-103681eb26bf None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:54:54.157580 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:54.197885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedcc99-faa0-403d-b6ed-a7d495468b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:54:54.198509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedcc99-faa0-403d-b6ed-a7d495468b43 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:54.198817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedcc99-faa0-403d-b6ed-a7d495468b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:54.199089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedcc99-faa0-403d-b6ed-a7d495468b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:54.200751 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cbedcc99-faa0-403d-b6ed-a7d495468b43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:54.320876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedcc99-faa0-403d-b6ed-a7d495468b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:54:54.322268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedcc99-faa0-403d-b6ed-a7d495468b43 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:54:54.342180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 672/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:54:56.914577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd4f9e-9d90-4c73-91b2-11006c98b2fd None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:56.915237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd4f9e-9d90-4c73-91b2-11006c98b2fd None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:56.915237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd4f9e-9d90-4c73-91b2-11006c98b2fd None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:56.916542 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 672/1344] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:54:56.922117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f40a6-c00b-4106-bd4b-1c7d6db8c318 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:56.922539 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f40a6-c00b-4106-bd4b-1c7d6db8c318 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:56.922669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f40a6-c00b-4106-bd4b-1c7d6db8c318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:56.996530 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6d3f40a6-c00b-4106-bd4b-1c7d6db8c318 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:54:56.997740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6d3f40a6-c00b-4106-bd4b-1c7d6db8c318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:57.016772 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:57.098132 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 673/1345] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:54:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:54:57.373299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd4f9e-9d90-4c73-91b2-11006c98b2fd None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:54:57.375098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-49bd4f9e-9d90-4c73-91b2-11006c98b2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:57.485109 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd4f9e-9d90-4c73-91b2-11006c98b2fd None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:54:57.569501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e7ca6-3551-443d-9032-5ab2b1c0896b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:54:57.570148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e7ca6-3551-443d-9032-5ab2b1c0896b service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:54:57.570422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e7ca6-3551-443d-9032-5ab2b1c0896b service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:54:57.570723 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e7ca6-3551-443d-9032-5ab2b1c0896b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:54:57.572352 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3f7e7ca6-3551-443d-9032-5ab2b1c0896b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:54:57.619283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:54:57.691398 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e7ca6-3551-443d-9032-5ab2b1c0896b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:54:57.692974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e7ca6-3551-443d-9032-5ab2b1c0896b service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:54:57.712906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 673/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:54:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:01.692340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318b38d-c3f6-4f1e-87e2-2f45a5d298cc None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:01.692789 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318b38d-c3f6-4f1e-87e2-2f45a5d298cc None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:01.692885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318b38d-c3f6-4f1e-87e2-2f45a5d298cc None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:01.694422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 674/1347] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:01.704290 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bc3af-4466-4c93-b7b4-8edba53fa333 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:01.704290 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bc3af-4466-4c93-b7b4-8edba53fa333 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:01.704290 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bc3af-4466-4c93-b7b4-8edba53fa333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:01.809745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-4d7bc3af-4466-4c93-b7b4-8edba53fa333 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:01.811381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4d7bc3af-4466-4c93-b7b4-8edba53fa333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:01.945676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:01.950957 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 674/1348] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:02.235080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318b38d-c3f6-4f1e-87e2-2f45a5d298cc None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:02.236953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5318b38d-c3f6-4f1e-87e2-2f45a5d298cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:02.367545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318b38d-c3f6-4f1e-87e2-2f45a5d298cc None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:02.419450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:02.451111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee6251-b792-4521-9973-db8a1273c5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:02.451929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee6251-b792-4521-9973-db8a1273c5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:02.452225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee6251-b792-4521-9973-db8a1273c5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:02.452501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee6251-b792-4521-9973-db8a1273c5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:02.454346 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c7ee6251-b792-4521-9973-db8a1273c5a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:02.569704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee6251-b792-4521-9973-db8a1273c5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:02.571275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee6251-b792-4521-9973-db8a1273c5a1 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:02.589885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 675/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:07.568290 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fd3a5-9137-4680-ab01-bc42c7fccd58 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:07.568756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fd3a5-9137-4680-ab01-bc42c7fccd58 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:07.568870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fd3a5-9137-4680-ab01-bc42c7fccd58 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:07.570389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 675/1350] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 22 15:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:07.575701 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ab147-88fc-4093-8ab1-a12eb0bde1a1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:07.576096 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ab147-88fc-4093-8ab1-a12eb0bde1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:07.576271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ab147-88fc-4093-8ab1-a12eb0bde1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:07.707871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-219ab147-88fc-4093-8ab1-a12eb0bde1a1 None None] MFA Rules not processed for user `4be9a664d10d438382b9e359b26ba86e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:07.709134 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-219ab147-88fc-4093-8ab1-a12eb0bde1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:07.741173 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:07.859905 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 676/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 22 15:55:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:12.000801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcbe8c-ab12-458c-abce-90f21bc69623 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:12.001338 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcbe8c-ab12-458c-abce-90f21bc69623 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:12.001338 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcbe8c-ab12-458c-abce-90f21bc69623 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:12.002974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 676/1352] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 22 15:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:12.008944 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981b221-528d-488c-9a30-f5414c6dd5ad None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:12.009866 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981b221-528d-488c-9a30-f5414c6dd5ad None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:12.010201 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981b221-528d-488c-9a30-f5414c6dd5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:12.088467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6981b221-528d-488c-9a30-f5414c6dd5ad None None] MFA Rules not processed for user `4be9a664d10d438382b9e359b26ba86e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:12.089686 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6981b221-528d-488c-9a30-f5414c6dd5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:12.166952 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:12.207014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 677/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 22 15:55:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:13.685451 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49437870-23f9-447c-94b3-e17a19c3a49b None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:13.686018 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49437870-23f9-447c-94b3-e17a19c3a49b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:13.686018 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49437870-23f9-447c-94b3-e17a19c3a49b None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:13.687397 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 677/1354] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 22 15:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:13.693756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe19e0-03b0-4583-82c6-0d082c2130b7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:13.694252 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe19e0-03b0-4583-82c6-0d082c2130b7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:13.694349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe19e0-03b0-4583-82c6-0d082c2130b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:13.777712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-dabe19e0-03b0-4583-82c6-0d082c2130b7 None None] MFA Rules not processed for user `4be9a664d10d438382b9e359b26ba86e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:13.778971 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-dabe19e0-03b0-4583-82c6-0d082c2130b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:13.891735 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 678/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 22 15:55:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:17.186210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9c0f9-b0cf-4092-b66d-03fc36df4915 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:17.186921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9c0f9-b0cf-4092-b66d-03fc36df4915 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:17.186921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9c0f9-b0cf-4092-b66d-03fc36df4915 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:17.188225 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 678/1356] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:17.194265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25567-cb7f-407b-b9de-57f1a1167985 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:17.194794 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25567-cb7f-407b-b9de-57f1a1167985 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:17.194892 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25567-cb7f-407b-b9de-57f1a1167985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:17.239896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:17.281449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8cb25567-cb7f-407b-b9de-57f1a1167985 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:17.282775 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8cb25567-cb7f-407b-b9de-57f1a1167985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:17.448158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 679/1357] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:17.812723 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db799a7-7585-4dc0-ae1d-2282547d7983 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:17.813323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db799a7-7585-4dc0-ae1d-2282547d7983 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:17.816615 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db799a7-7585-4dc0-ae1d-2282547d7983 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:17.829309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 679/1358] 10.222.0.77 () {54 vars in 962 bytes} [Mon Aug 22 15:55:17 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:17.838627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679239b-b32c-4b89-a628-4304c0edff58 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:17.839154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679239b-b32c-4b89-a628-4304c0edff58 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:17.839613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679239b-b32c-4b89-a628-4304c0edff58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:17.965636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6679239b-b32c-4b89-a628-4304c0edff58 None None] MFA Rules not processed for user `20e4a18ab77642baa9adb9a4b49fbcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:17.966817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6679239b-b32c-4b89-a628-4304c0edff58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:18.027341 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:18.131834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 680/1359] 10.222.0.77 () {58 vars in 1059 bytes} [Mon Aug 22 15:55:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:18.139644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db799a7-7585-4dc0-ae1d-2282547d7983 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:18.144852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8db799a7-7585-4dc0-ae1d-2282547d7983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:18.318949 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db799a7-7585-4dc0-ae1d-2282547d7983 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:18.403818 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:18.448220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdcbe0-7f28-4111-ab84-a659d3a9ab0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:18.448885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdcbe0-7f28-4111-ab84-a659d3a9ab0e service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:18.449159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdcbe0-7f28-4111-ab84-a659d3a9ab0e service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:18.449428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdcbe0-7f28-4111-ab84-a659d3a9ab0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:18.451234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-73cdcbe0-7f28-4111-ab84-a659d3a9ab0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:18.545460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdcbe0-7f28-4111-ab84-a659d3a9ab0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:18.547313 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdcbe0-7f28-4111-ab84-a659d3a9ab0e service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:18.571458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 680/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:55:20.893535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305e0d2-efe7-4625-bb48-2b5deff46c26 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:20.894125 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305e0d2-efe7-4625-bb48-2b5deff46c26 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:20.894125 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305e0d2-efe7-4625-bb48-2b5deff46c26 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:20.895819 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 681/1361] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:55:20.901406 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabf461-c0ef-42d3-82d5-8bb08b04af90 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:20.902402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabf461-c0ef-42d3-82d5-8bb08b04af90 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:20.902714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabf461-c0ef-42d3-82d5-8bb08b04af90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:20.980678 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-2aabf461-c0ef-42d3-82d5-8bb08b04af90 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:20.981896 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-2aabf461-c0ef-42d3-82d5-8bb08b04af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:21.027546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:21.100001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 681/1362] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:21.423253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305e0d2-efe7-4625-bb48-2b5deff46c26 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:21.424775 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0305e0d2-efe7-4625-bb48-2b5deff46c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:21.591205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305e0d2-efe7-4625-bb48-2b5deff46c26 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:21.602219 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:21.745823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eacdf6-af50-4a78-8885-ef06348ea0dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:21.746487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eacdf6-af50-4a78-8885-ef06348ea0dd service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:21.746852 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eacdf6-af50-4a78-8885-ef06348ea0dd service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:21.747209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eacdf6-af50-4a78-8885-ef06348ea0dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:21.748957 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a2eacdf6-af50-4a78-8885-ef06348ea0dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:21.864405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eacdf6-af50-4a78-8885-ef06348ea0dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:21.866179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eacdf6-af50-4a78-8885-ef06348ea0dd service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:21.888542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 682/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:24.115360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea00a17-9f02-4181-81e7-3c69f785dbe5 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:24.115718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea00a17-9f02-4181-81e7-3c69f785dbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:24.115897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea00a17-9f02-4181-81e7-3c69f785dbe5 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:24.118507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 682/1364] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:24.124231 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006d463-7d0b-4d32-b02d-9152e55adba7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:24.124732 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006d463-7d0b-4d32-b02d-9152e55adba7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:24.124814 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006d463-7d0b-4d32-b02d-9152e55adba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:24.141673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:24.199631 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d006d463-7d0b-4d32-b02d-9152e55adba7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:24.201101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d006d463-7d0b-4d32-b02d-9152e55adba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:24.322680 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 683/1365] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:24.610225 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02de77a-a55b-4f0f-be4c-8fa081d70eb0 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:24.610528 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02de77a-a55b-4f0f-be4c-8fa081d70eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:24.610831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02de77a-a55b-4f0f-be4c-8fa081d70eb0 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:24.612450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 683/1366] 10.222.0.77 () {54 vars in 962 bytes} [Mon Aug 22 15:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:24.618140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714423a-3446-4750-8b6e-f5094d7c245b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:24.618784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714423a-3446-4750-8b6e-f5094d7c245b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:24.619069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714423a-3446-4750-8b6e-f5094d7c245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:24.701358 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d714423a-3446-4750-8b6e-f5094d7c245b None None] MFA Rules not processed for user `20e4a18ab77642baa9adb9a4b49fbcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:24.702760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d714423a-3446-4750-8b6e-f5094d7c245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:24.741066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:24.843299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 684/1367] 10.222.0.77 () {58 vars in 1059 bytes} [Mon Aug 22 15:55:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:24.852196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02de77a-a55b-4f0f-be4c-8fa081d70eb0 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:24.854455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e02de77a-a55b-4f0f-be4c-8fa081d70eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:25.019724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02de77a-a55b-4f0f-be4c-8fa081d70eb0 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:25.041332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:25.143656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa872d9-b4f3-42d6-8440-12162ee88fce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:25.144340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa872d9-b4f3-42d6-8440-12162ee88fce service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:25.144429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa872d9-b4f3-42d6-8440-12162ee88fce service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:25.144687 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa872d9-b4f3-42d6-8440-12162ee88fce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:25.146286 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9fa872d9-b4f3-42d6-8440-12162ee88fce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:25.240122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa872d9-b4f3-42d6-8440-12162ee88fce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:25.242363 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa872d9-b4f3-42d6-8440-12162ee88fce service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:25.261425 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 684/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:25.690025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974865fe-b31b-4593-aa4b-1b51b261b765 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:25.690632 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974865fe-b31b-4593-aa4b-1b51b261b765 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:25.690632 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974865fe-b31b-4593-aa4b-1b51b261b765 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:25.691985 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 685/1369] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:25.697572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d78b7-bd1e-45c8-ac03-701c61b4b9fd None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:25.697934 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d78b7-bd1e-45c8-ac03-701c61b4b9fd None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:25.698209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d78b7-bd1e-45c8-ac03-701c61b4b9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:25.732676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:25.770835 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-3c7d78b7-bd1e-45c8-ac03-701c61b4b9fd None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:25.772077 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3c7d78b7-bd1e-45c8-ac03-701c61b4b9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:25.884900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 685/1370] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:26.468001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4bcbd-dbe0-46bf-8b73-d46a9e7cd235 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:26.468001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4bcbd-dbe0-46bf-8b73-d46a9e7cd235 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:26.468001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4bcbd-dbe0-46bf-8b73-d46a9e7cd235 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:26.470556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 686/1371] 10.222.0.77 () {54 vars in 964 bytes} [Mon Aug 22 15:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:26.474546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbdb57-98f0-4a24-8efa-66c764ad3368 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:26.475136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbdb57-98f0-4a24-8efa-66c764ad3368 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:26.475293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbdb57-98f0-4a24-8efa-66c764ad3368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:26.558533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-5edbdb57-98f0-4a24-8efa-66c764ad3368 None None] MFA Rules not processed for user `80b255bd61e3445ab154f01fea9a95b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:26.559821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5edbdb57-98f0-4a24-8efa-66c764ad3368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:26.612072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:26.646238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 686/1372] 10.222.0.77 () {58 vars in 1061 bytes} [Mon Aug 22 15:55:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:55:26.654364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4bcbd-dbe0-46bf-8b73-d46a9e7cd235 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:26.656051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-05d4bcbd-dbe0-46bf-8b73-d46a9e7cd235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:26.765739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4bcbd-dbe0-46bf-8b73-d46a9e7cd235 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:26.810117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:26.854298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e212c5f-9def-4167-936a-b5a95f16a3f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:26.855105 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e212c5f-9def-4167-936a-b5a95f16a3f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:26.855482 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e212c5f-9def-4167-936a-b5a95f16a3f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:26.855849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e212c5f-9def-4167-936a-b5a95f16a3f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:26.857818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2e212c5f-9def-4167-936a-b5a95f16a3f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:26.998145 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e212c5f-9def-4167-936a-b5a95f16a3f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:27.000390 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e212c5f-9def-4167-936a-b5a95f16a3f4 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:27.029568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 687/1373] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:27.226424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f53b4-2530-4a2a-813a-e4a1f60b64b6 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:27.226756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f53b4-2530-4a2a-813a-e4a1f60b64b6 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:27.227035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f53b4-2530-4a2a-813a-e4a1f60b64b6 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:27.228414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 687/1374] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:27.233937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0d0fa-b28d-4809-8fce-766eca02ba5a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:27.234224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0d0fa-b28d-4809-8fce-766eca02ba5a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:27.234499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0d0fa-b28d-4809-8fce-766eca02ba5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:27.305655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c0b0d0fa-b28d-4809-8fce-766eca02ba5a None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:27.306934 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c0b0d0fa-b28d-4809-8fce-766eca02ba5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:27.332125 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:27.407940 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 688/1375] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:27.691538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f53b4-2530-4a2a-813a-e4a1f60b64b6 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:27.693283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-533f53b4-2530-4a2a-813a-e4a1f60b64b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:27.853411 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f53b4-2530-4a2a-813a-e4a1f60b64b6 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:27.908221 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:27.979326 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ff07e-562c-4ae8-83ca-c459483bb4ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:27.980106 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ff07e-562c-4ae8-83ca-c459483bb4ed service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:27.980411 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ff07e-562c-4ae8-83ca-c459483bb4ed service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:27.980714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ff07e-562c-4ae8-83ca-c459483bb4ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:27.982362 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bf4ff07e-562c-4ae8-83ca-c459483bb4ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:28.074127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ff07e-562c-4ae8-83ca-c459483bb4ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:28.075822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ff07e-562c-4ae8-83ca-c459483bb4ed service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:28.094141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 688/1376] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:30.065758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6265e93-bf6f-47f1-9839-2ce1538d9ecc None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:30.066233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6265e93-bf6f-47f1-9839-2ce1538d9ecc None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:30.066365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6265e93-bf6f-47f1-9839-2ce1538d9ecc None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:30.067716 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 689/1377] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:30.073248 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc116ea3-8519-4072-9a29-3465c8606aab None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:30.073699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc116ea3-8519-4072-9a29-3465c8606aab None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:30.073809 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc116ea3-8519-4072-9a29-3465c8606aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:30.166259 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-cc116ea3-8519-4072-9a29-3465c8606aab None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:30.167532 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-cc116ea3-8519-4072-9a29-3465c8606aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:30.175735 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:30.267713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 689/1378] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:30.568250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6265e93-bf6f-47f1-9839-2ce1538d9ecc None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:30.569878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a6265e93-bf6f-47f1-9839-2ce1538d9ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:30.740817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6265e93-bf6f-47f1-9839-2ce1538d9ecc None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:30.745017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:30.874401 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f41713-7734-40ce-92f6-21717b24c455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:30.875067 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f41713-7734-40ce-92f6-21717b24c455 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:30.875345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f41713-7734-40ce-92f6-21717b24c455 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:30.875616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f41713-7734-40ce-92f6-21717b24c455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:30.877443 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-84f41713-7734-40ce-92f6-21717b24c455 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:30.993329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f41713-7734-40ce-92f6-21717b24c455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:30.995177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f41713-7734-40ce-92f6-21717b24c455 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:31.017462 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 690/1379] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:32.984754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e1f74-a318-459a-ac9f-8611bd645032 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:32.985470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e1f74-a318-459a-ac9f-8611bd645032 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:32.985470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e1f74-a318-459a-ac9f-8611bd645032 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:32.987342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 690/1380] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:32.992519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedbcbd-022c-41a7-a9b8-441565a8192d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:32.993070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedbcbd-022c-41a7-a9b8-441565a8192d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:32.993070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedbcbd-022c-41a7-a9b8-441565a8192d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:33.005979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:33.080131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3eedbcbd-022c-41a7-a9b8-441565a8192d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:33.081409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3eedbcbd-022c-41a7-a9b8-441565a8192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:33.206653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 691/1381] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:33.520523 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e1f74-a318-459a-ac9f-8611bd645032 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:33.523045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-941e1f74-a318-459a-ac9f-8611bd645032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:33.711562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:33.726205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e1f74-a318-459a-ac9f-8611bd645032 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:33.904375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a765d8-7f52-42b8-b338-f157f9f9337b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:33.904999 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a765d8-7f52-42b8-b338-f157f9f9337b service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:33.905277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a765d8-7f52-42b8-b338-f157f9f9337b service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:33.905542 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a765d8-7f52-42b8-b338-f157f9f9337b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:33.907545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-83a765d8-7f52-42b8-b338-f157f9f9337b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:34.031765 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a765d8-7f52-42b8-b338-f157f9f9337b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:34.033384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a765d8-7f52-42b8-b338-f157f9f9337b service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:34.046481 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:34.058175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 691/1382] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:36.103033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de7517-9277-4b3c-a42b-b8ccfee2dc84 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:36.103692 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de7517-9277-4b3c-a42b-b8ccfee2dc84 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:36.103692 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de7517-9277-4b3c-a42b-b8ccfee2dc84 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:36.105021 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 692/1383] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:55:36.114402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e79db-cbce-425b-b83a-92d951dc9a9b None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:36.115017 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e79db-cbce-425b-b83a-92d951dc9a9b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:36.115017 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e79db-cbce-425b-b83a-92d951dc9a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:36.229882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c14e79db-cbce-425b-b83a-92d951dc9a9b None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:36.232782 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c14e79db-cbce-425b-b83a-92d951dc9a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:36.390234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 692/1384] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:36.745603 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de7517-9277-4b3c-a42b-b8ccfee2dc84 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:36.747250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e9de7517-9277-4b3c-a42b-b8ccfee2dc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:36.838845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:36.925744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de7517-9277-4b3c-a42b-b8ccfee2dc84 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:37.068844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b110623-54fb-4fd2-b037-09ef0677f19d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:37.069515 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b110623-54fb-4fd2-b037-09ef0677f19d service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:37.069891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b110623-54fb-4fd2-b037-09ef0677f19d service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:37.070456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b110623-54fb-4fd2-b037-09ef0677f19d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:37.072570 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8b110623-54fb-4fd2-b037-09ef0677f19d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:37.138846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:37.187281 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b110623-54fb-4fd2-b037-09ef0677f19d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:37.188981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b110623-54fb-4fd2-b037-09ef0677f19d service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:37.209382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 693/1385] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:39.269477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc4e22-8a25-40ec-b10a-ef1e073e2075 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:39.270032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc4e22-8a25-40ec-b10a-ef1e073e2075 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:39.270129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc4e22-8a25-40ec-b10a-ef1e073e2075 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:39.272610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 693/1386] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:39.278640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269d858-343e-44f1-b480-430a134694c0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:39.279512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269d858-343e-44f1-b480-430a134694c0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:39.279998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269d858-343e-44f1-b480-430a134694c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:39.364611 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7269d858-343e-44f1-b480-430a134694c0 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:39.365897 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7269d858-343e-44f1-b480-430a134694c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:39.480561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 694/1387] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:55:39.798905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc4e22-8a25-40ec-b10a-ef1e073e2075 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:39.800894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-20cc4e22-8a25-40ec-b10a-ef1e073e2075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:39.894943 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:40.001641 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc4e22-8a25-40ec-b10a-ef1e073e2075 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:40.167851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161d780-483a-4d94-8009-3b7728ed8951 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:40.168661 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161d780-483a-4d94-8009-3b7728ed8951 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:40.169040 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161d780-483a-4d94-8009-3b7728ed8951 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:40.169498 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161d780-483a-4d94-8009-3b7728ed8951 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:40.172120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-b161d780-483a-4d94-8009-3b7728ed8951 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:40.241462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:40.320543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161d780-483a-4d94-8009-3b7728ed8951 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:40.322308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161d780-483a-4d94-8009-3b7728ed8951 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:40.344230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 694/1388] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:42.424299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0cf89-d2b7-4645-ad07-bb886cf73077 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:42.424844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0cf89-d2b7-4645-ad07-bb886cf73077 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:42.424964 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0cf89-d2b7-4645-ad07-bb886cf73077 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:42.426422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 695/1389] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:42.432122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fa5b8-065a-4753-b293-a6441a765fb8 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:42.432582 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fa5b8-065a-4753-b293-a6441a765fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:42.432692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fa5b8-065a-4753-b293-a6441a765fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:42.501905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-824fa5b8-065a-4753-b293-a6441a765fb8 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:42.503262 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-824fa5b8-065a-4753-b293-a6441a765fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:42.605598 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 695/1390] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:42.623538 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56471e6d-5464-437b-bc8c-d83ea30f6f11 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:42.623824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56471e6d-5464-437b-bc8c-d83ea30f6f11 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:42.624098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56471e6d-5464-437b-bc8c-d83ea30f6f11 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:42.625454 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 696/1391] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:42.631004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd377811-ac46-4a11-b7ff-35050eed722c None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:42.631231 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd377811-ac46-4a11-b7ff-35050eed722c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:42.631504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd377811-ac46-4a11-b7ff-35050eed722c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:42.647775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:42.709217 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-fd377811-ac46-4a11-b7ff-35050eed722c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:42.710470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-fd377811-ac46-4a11-b7ff-35050eed722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:42.818528 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 696/1392] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:42.888700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56471e6d-5464-437b-bc8c-d83ea30f6f11 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:42.890251 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-56471e6d-5464-437b-bc8c-d83ea30f6f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:42.924469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:43.045816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56471e6d-5464-437b-bc8c-d83ea30f6f11 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:43.117675 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c6890-8362-4907-9e83-0f03f1c5d2bb None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:43.117990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c6890-8362-4907-9e83-0f03f1c5d2bb None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:43.118258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c6890-8362-4907-9e83-0f03f1c5d2bb None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:43.120066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 697/1393] 10.222.0.77 () {54 vars in 967 bytes} [Mon Aug 22 15:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:43.124759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba3583-5cca-4e19-9a6b-fe2bd88fb4cd None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:43.125036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba3583-5cca-4e19-9a6b-fe2bd88fb4cd None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:43.125305 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba3583-5cca-4e19-9a6b-fe2bd88fb4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:43.158632 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:43.176082 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3720be-100a-4fec-b241-731d38120a6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:43.176717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3720be-100a-4fec-b241-731d38120a6f service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:43.176996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3720be-100a-4fec-b241-731d38120a6f service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:43.177267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3720be-100a-4fec-b241-731d38120a6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:43.179071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8b3720be-100a-4fec-b241-731d38120a6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:43.215768 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-92ba3583-5cca-4e19-9a6b-fe2bd88fb4cd None None] MFA Rules not processed for user `3f7c46f4dc084a948bd09ca9b86c2748`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:43.217013 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-92ba3583-5cca-4e19-9a6b-fe2bd88fb4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:43.257148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:43.279292 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3720be-100a-4fec-b241-731d38120a6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:43.281232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3720be-100a-4fec-b241-731d38120a6f service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:43.303840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 697/1394] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:43.305878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 698/1395] 10.222.0.77 () {58 vars in 1064 bytes} [Mon Aug 22 15:55:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:43.313400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3720be-100a-4fec-b241-731d38120a6f service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:43.314690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8b3720be-100a-4fec-b241-731d38120a6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:43.406884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3720be-100a-4fec-b241-731d38120a6f service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:43.459500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:43.499229 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a85a3-3975-4b2f-abdc-8744c8ffe76f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7c46f4dc084a948bd09ca9b86c2748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:43.499889 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a85a3-3975-4b2f-abdc-8744c8ffe76f service glance] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:43.500167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a85a3-3975-4b2f-abdc-8744c8ffe76f service glance] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:43.500441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a85a3-3975-4b2f-abdc-8744c8ffe76f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:43.502254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6a1a85a3-3975-4b2f-abdc-8744c8ffe76f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:43.650503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a85a3-3975-4b2f-abdc-8744c8ffe76f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:43.652014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a85a3-3975-4b2f-abdc-8744c8ffe76f service glance] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:43.674343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 698/1396] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:44.445063 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411abce0-86b5-451a-8799-ada86871f877 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:44.445570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411abce0-86b5-451a-8799-ada86871f877 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:44.445694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411abce0-86b5-451a-8799-ada86871f877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:44.516077 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-411abce0-86b5-451a-8799-ada86871f877 None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:44.517308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-411abce0-86b5-451a-8799-ada86871f877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:44.609839 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 699/1397] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 15:55:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:44.651872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f24c85-79fa-4fe4-a1e6-c05e514c0b1f None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:44.652377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f24c85-79fa-4fe4-a1e6-c05e514c0b1f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:44.652377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f24c85-79fa-4fe4-a1e6-c05e514c0b1f None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:44.653758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 699/1398] 10.222.0.77 () {54 vars in 943 bytes} [Mon Aug 22 15:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:44.660666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618efabb-75c1-460b-a8a5-2ee6cdb0ffb3 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:44.660949 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618efabb-75c1-460b-a8a5-2ee6cdb0ffb3 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:44.661249 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618efabb-75c1-460b-a8a5-2ee6cdb0ffb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:44.722143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:44.742125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-618efabb-75c1-460b-a8a5-2ee6cdb0ffb3 None None] MFA Rules not processed for user `7d8a49035be2479b87c797bf53c9919b`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:44.743386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-618efabb-75c1-460b-a8a5-2ee6cdb0ffb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:44.862161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 700/1399] 10.222.0.77 () {58 vars in 1040 bytes} [Mon Aug 22 15:55:44 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:44.871608 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f24c85-79fa-4fe4-a1e6-c05e514c0b1f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:44.873215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a6f24c85-79fa-4fe4-a1e6-c05e514c0b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:44.962545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:45.029937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f24c85-79fa-4fe4-a1e6-c05e514c0b1f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:45.139783 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85098d06-af2d-41a5-ba3b-06543438761b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:45.140337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85098d06-af2d-41a5-ba3b-06543438761b service swift] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:45.140584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85098d06-af2d-41a5-ba3b-06543438761b service swift] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:45.140860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85098d06-af2d-41a5-ba3b-06543438761b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:45.142532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-85098d06-af2d-41a5-ba3b-06543438761b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:45.203699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:45.231370 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85098d06-af2d-41a5-ba3b-06543438761b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:45.233048 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85098d06-af2d-41a5-ba3b-06543438761b service swift] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:45.241991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 700/1400] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 15:55:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 15:55:45.309299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a299-da0c-4d9c-a357-dc17ee86a685 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:45.309745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a299-da0c-4d9c-a357-dc17ee86a685 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:45.310139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a299-da0c-4d9c-a357-dc17ee86a685 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:45.311801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 701/1401] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:55:45.318487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7845b-7fb9-4619-b3ec-89d8efa0756f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:45.318925 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7845b-7fb9-4619-b3ec-89d8efa0756f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:45.319394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7845b-7fb9-4619-b3ec-89d8efa0756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:45.404122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8fa7845b-7fb9-4619-b3ec-89d8efa0756f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:45.405374 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8fa7845b-7fb9-4619-b3ec-89d8efa0756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:45.517351 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 701/1402] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:45.811833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05a299-da0c-4d9c-a357-dc17ee86a685 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:45.813394 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ff05a299-da0c-4d9c-a357-dc17ee86a685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:45.951031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:46.004872 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05a299-da0c-4d9c-a357-dc17ee86a685 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:46.147005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f6fc2-cdbd-4fe3-be34-ab4599d7bfe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:46.147538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f6fc2-cdbd-4fe3-be34-ab4599d7bfe5 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:46.147817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f6fc2-cdbd-4fe3-be34-ab4599d7bfe5 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:46.148261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f6fc2-cdbd-4fe3-be34-ab4599d7bfe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:46.149951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-874f6fc2-cdbd-4fe3-be34-ab4599d7bfe5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:46.246545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:46.268249 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f6fc2-cdbd-4fe3-be34-ab4599d7bfe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:46.270222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f6fc2-cdbd-4fe3-be34-ab4599d7bfe5 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:46.303452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 702/1403] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:48.438522 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36399c6-b607-44b2-ad8d-98429cc50646 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:48.439494 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36399c6-b607-44b2-ad8d-98429cc50646 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:48.439494 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36399c6-b607-44b2-ad8d-98429cc50646 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:48.445823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 702/1404] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:55:48.450285 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5616f8-606d-44a2-9e7a-777f8de76858 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:48.450285 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5616f8-606d-44a2-9e7a-777f8de76858 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:48.450285 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5616f8-606d-44a2-9e7a-777f8de76858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:48.531823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-ad5616f8-606d-44a2-9e7a-777f8de76858 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:48.533766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ad5616f8-606d-44a2-9e7a-777f8de76858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:48.674722 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 703/1405] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:48.989643 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36399c6-b607-44b2-ad8d-98429cc50646 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:48.992550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d36399c6-b607-44b2-ad8d-98429cc50646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:49.091984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:49.255009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36399c6-b607-44b2-ad8d-98429cc50646 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:49.453556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab906379-04c3-4af7-a6ea-27352fad865a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:49.454616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab906379-04c3-4af7-a6ea-27352fad865a service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:49.455159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab906379-04c3-4af7-a6ea-27352fad865a service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:49.455650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab906379-04c3-4af7-a6ea-27352fad865a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:49.458904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ab906379-04c3-4af7-a6ea-27352fad865a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:49.481579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:49.587057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab906379-04c3-4af7-a6ea-27352fad865a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:49.588723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab906379-04c3-4af7-a6ea-27352fad865a service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:49.609149 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 703/1406] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:55:51.614382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a92f2-9867-4bad-b997-0094133e65a6 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:51.614960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a92f2-9867-4bad-b997-0094133e65a6 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:51.614960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a92f2-9867-4bad-b997-0094133e65a6 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:51.616221 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 704/1407] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:55:51.622131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31417c0b-ebf7-4d0c-8c22-d1ab658f0ea3 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:51.622668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31417c0b-ebf7-4d0c-8c22-d1ab658f0ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:51.622771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31417c0b-ebf7-4d0c-8c22-d1ab658f0ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:51.722325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-31417c0b-ebf7-4d0c-8c22-d1ab658f0ea3 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:55:51.724620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-31417c0b-ebf7-4d0c-8c22-d1ab658f0ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:51.885262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:51.900827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 704/1408] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:55:52.195811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a92f2-9867-4bad-b997-0094133e65a6 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:55:52.198775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-684a92f2-9867-4bad-b997-0094133e65a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:52.277588 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:52.418979 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a92f2-9867-4bad-b997-0094133e65a6 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:55:52.588732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e70210-7e80-49aa-ad35-877e59ab564b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:55:52.589266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70210-7e80-49aa-ad35-877e59ab564b service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:55:52.589542 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70210-7e80-49aa-ad35-877e59ab564b service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:55:52.589808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70210-7e80-49aa-ad35-877e59ab564b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:55:52.591542 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-12e70210-7e80-49aa-ad35-877e59ab564b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:55:52.601315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:55:52.693571 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e70210-7e80-49aa-ad35-877e59ab564b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:55:52.695271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e70210-7e80-49aa-ad35-877e59ab564b service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:55:52.716246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 705/1409] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:01.898558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:02.713165 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=41 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:07.787276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c64856-ac7b-4885-91ad-2fc751ddd71a None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:07.787883 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c64856-ac7b-4885-91ad-2fc751ddd71a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:07.788200 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c64856-ac7b-4885-91ad-2fc751ddd71a None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:07.790664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 705/1410] 10.222.0.77 () {54 vars in 918 bytes} [Mon Aug 22 15:56:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:07.796947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdb53f-58f6-4e98-b719-cf742da837be None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:07.797541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdb53f-58f6-4e98-b719-cf742da837be None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:07.797541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdb53f-58f6-4e98-b719-cf742da837be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:07.888192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-7ecdb53f-58f6-4e98-b719-cf742da837be None None] MFA Rules not processed for user `4be9a664d10d438382b9e359b26ba86e`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:07.889787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7ecdb53f-58f6-4e98-b719-cf742da837be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:08.023372 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 706/1411] 10.222.0.77 () {58 vars in 1015 bytes} [Mon Aug 22 15:56:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:08.038940 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7bdcd-d32b-41d9-9b18-347886ec906f None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:08.039218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7bdcd-d32b-41d9-9b18-347886ec906f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:08.039377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7bdcd-d32b-41d9-9b18-347886ec906f None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:08.040781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 706/1412] 10.222.0.77 () {54 vars in 918 bytes} [Mon Aug 22 15:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:08.048640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3660b8-72e0-44f8-9375-3f806e27aaf6 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:08.048924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3660b8-72e0-44f8-9375-3f806e27aaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:08.049205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3660b8-72e0-44f8-9375-3f806e27aaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:08.140873 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:08.145600 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-7a3660b8-72e0-44f8-9375-3f806e27aaf6 None None] MFA Rules not processed for user `20e4a18ab77642baa9adb9a4b49fbcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:08.147725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7a3660b8-72e0-44f8-9375-3f806e27aaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:08.296200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 707/1413] 10.222.0.77 () {58 vars in 1015 bytes} [Mon Aug 22 15:56:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:10.976874 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020665a-6c09-4be6-992c-b82a689d72f7 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:10.977550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020665a-6c09-4be6-992c-b82a689d72f7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:10.977550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020665a-6c09-4be6-992c-b82a689d72f7 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:10.978743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:10.984611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb54c2-a32c-4a65-9f04-67c5122bb168 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:10.985096 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb54c2-a32c-4a65-9f04-67c5122bb168 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:10.985201 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb54c2-a32c-4a65-9f04-67c5122bb168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:11.070141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-90bb54c2-a32c-4a65-9f04-67c5122bb168 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:11.071461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-90bb54c2-a32c-4a65-9f04-67c5122bb168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:11.136181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:11.182796 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:11.477089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020665a-6c09-4be6-992c-b82a689d72f7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:11.479097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6020665a-6c09-4be6-992c-b82a689d72f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:11.659756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020665a-6c09-4be6-992c-b82a689d72f7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:11.757951 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:11.807291 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06106478-3792-4285-8977-6cff99c29f0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:11.807912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106478-3792-4285-8977-6cff99c29f0f service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:11.808190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106478-3792-4285-8977-6cff99c29f0f service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:11.808467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06106478-3792-4285-8977-6cff99c29f0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:11.810137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-06106478-3792-4285-8977-6cff99c29f0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:11.920126 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06106478-3792-4285-8977-6cff99c29f0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:11.921794 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06106478-3792-4285-8977-6cff99c29f0f service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:11.945043 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 708/1416] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:12.867803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e57d5b-590f-458f-90de-05a6c0635837 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:12.868377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e57d5b-590f-458f-90de-05a6c0635837 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:12.868377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e57d5b-590f-458f-90de-05a6c0635837 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:12.869811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:12.875584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45619a2-f608-45f5-b957-0202c6a7016c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:12.876208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45619a2-f608-45f5-b957-0202c6a7016c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:12.876208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45619a2-f608-45f5-b957-0202c6a7016c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:12.965244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a45619a2-f608-45f5-b957-0202c6a7016c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:12.966493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a45619a2-f608-45f5-b957-0202c6a7016c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:13.001399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:13.087756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:13.239034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e57d5b-590f-458f-90de-05a6c0635837 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:13.240742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-63e57d5b-590f-458f-90de-05a6c0635837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:13.408418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e57d5b-590f-458f-90de-05a6c0635837 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:13.451051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:13.535554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cfc0f-8e11-4afd-9932-aec140c5834b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:13.536090 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cfc0f-8e11-4afd-9932-aec140c5834b service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:13.536364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cfc0f-8e11-4afd-9932-aec140c5834b service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:13.536628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cfc0f-8e11-4afd-9932-aec140c5834b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:13.538295 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-aa5cfc0f-8e11-4afd-9932-aec140c5834b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:13.659342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cfc0f-8e11-4afd-9932-aec140c5834b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:13.661596 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cfc0f-8e11-4afd-9932-aec140c5834b service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:13.686410 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 710/1419] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:56:14.584375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd69be0-6146-4868-97e0-e6e7523dcd80 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:14.584968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd69be0-6146-4868-97e0-e6e7523dcd80 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:14.584968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd69be0-6146-4868-97e0-e6e7523dcd80 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:14.586176 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:14.591831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd07f3a-d519-4ba0-861f-110bf6b38c56 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:14.592245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd07f3a-d519-4ba0-861f-110bf6b38c56 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:14.592374 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd07f3a-d519-4ba0-861f-110bf6b38c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:14.649737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:14.674888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-7dd07f3a-d519-4ba0-861f-110bf6b38c56 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:14.676129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7dd07f3a-d519-4ba0-861f-110bf6b38c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:14.796144 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:14.948500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd69be0-6146-4868-97e0-e6e7523dcd80 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:14.950061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8fd69be0-6146-4868-97e0-e6e7523dcd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:15.128431 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd69be0-6146-4868-97e0-e6e7523dcd80 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:15.141814 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:15.255197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece800e-f1ca-49ae-956e-cd24d260dace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:15.255692 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece800e-f1ca-49ae-956e-cd24d260dace service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:15.256001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece800e-f1ca-49ae-956e-cd24d260dace service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:15.256244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece800e-f1ca-49ae-956e-cd24d260dace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:15.257915 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-eece800e-f1ca-49ae-956e-cd24d260dace service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:15.360969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece800e-f1ca-49ae-956e-cd24d260dace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:15.362683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece800e-f1ca-49ae-956e-cd24d260dace service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:15.382087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 711/1422] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:16.272667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0554d4-8cd1-46dd-a66c-36bf398ad265 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:16.273315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0554d4-8cd1-46dd-a66c-36bf398ad265 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:16.273315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0554d4-8cd1-46dd-a66c-36bf398ad265 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:16.274570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:16.280493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c126-b478-4684-a296-8d32fdaec4aa None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:16.281033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c126-b478-4684-a296-8d32fdaec4aa None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:16.281128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c126-b478-4684-a296-8d32fdaec4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:16.304872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:16.372208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1703c126-b478-4684-a296-8d32fdaec4aa None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:16.373438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1703c126-b478-4684-a296-8d32fdaec4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:16.499205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:16.808048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0554d4-8cd1-46dd-a66c-36bf398ad265 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:16.809636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-fb0554d4-8cd1-46dd-a66c-36bf398ad265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:16.939469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:16.987924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0554d4-8cd1-46dd-a66c-36bf398ad265 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:17.123108 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e261c-6ddc-436f-b459-bb3387a30175 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:17.123606 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e261c-6ddc-436f-b459-bb3387a30175 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:17.123922 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e261c-6ddc-436f-b459-bb3387a30175 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:17.124182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e261c-6ddc-436f-b459-bb3387a30175 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:17.125824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-812e261c-6ddc-436f-b459-bb3387a30175 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:17.215281 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:17.233739 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e261c-6ddc-436f-b459-bb3387a30175 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:17.235466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e261c-6ddc-436f-b459-bb3387a30175 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:17.255439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 713/1425] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:18.150071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01f48-8a01-4b95-ac31-6e20044acf1d None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:18.151064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01f48-8a01-4b95-ac31-6e20044acf1d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:18.151064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01f48-8a01-4b95-ac31-6e20044acf1d None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:18.153311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:56:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:18.163340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6026fcb-86d2-40dc-a3b3-90c3446646eb None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:18.164241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6026fcb-86d2-40dc-a3b3-90c3446646eb None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:18.164241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6026fcb-86d2-40dc-a3b3-90c3446646eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:18.259195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-a6026fcb-86d2-40dc-a3b3-90c3446646eb None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:18.260611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a6026fcb-86d2-40dc-a3b3-90c3446646eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:18.364716 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:18.529995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f01f48-8a01-4b95-ac31-6e20044acf1d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:18.532421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-68f01f48-8a01-4b95-ac31-6e20044acf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:18.639558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:18.714673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f01f48-8a01-4b95-ac31-6e20044acf1d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:18.844901 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19bce3-b688-44a1-bd4c-8e6b295a9d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:18.845520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19bce3-b688-44a1-bd4c-8e6b295a9d69 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:18.845836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19bce3-b688-44a1-bd4c-8e6b295a9d69 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:18.846100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19bce3-b688-44a1-bd4c-8e6b295a9d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:18.847824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3b19bce3-b688-44a1-bd4c-8e6b295a9d69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:18.900132 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:18.946339 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19bce3-b688-44a1-bd4c-8e6b295a9d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:18.948087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19bce3-b688-44a1-bd4c-8e6b295a9d69 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:18.968583 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 714/1428] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:19.797526 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea39ae-8ee8-458b-aa44-f57ea8a0cdab None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:19.798032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea39ae-8ee8-458b-aa44-f57ea8a0cdab None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:19.798032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea39ae-8ee8-458b-aa44-f57ea8a0cdab None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:19.799326 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:19.805047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fbcfa-d36a-4995-b44d-ec9d0718c8a9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:19.805794 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fbcfa-d36a-4995-b44d-ec9d0718c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:19.805794 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fbcfa-d36a-4995-b44d-ec9d0718c8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:19.893779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-385fbcfa-d36a-4995-b44d-ec9d0718c8a9 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:19.895127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-385fbcfa-d36a-4995-b44d-ec9d0718c8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:20.013005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:20.162996 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea39ae-8ee8-458b-aa44-f57ea8a0cdab None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:20.164384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-54ea39ae-8ee8-458b-aa44-f57ea8a0cdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:20.219689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:20.328705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea39ae-8ee8-458b-aa44-f57ea8a0cdab None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:20.475394 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46603fcc-54b7-445d-8c0d-f7cb0cd349dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:20.476312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46603fcc-54b7-445d-8c0d-f7cb0cd349dd service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:20.476637 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46603fcc-54b7-445d-8c0d-f7cb0cd349dd service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:20.476978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46603fcc-54b7-445d-8c0d-f7cb0cd349dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:20.479346 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-46603fcc-54b7-445d-8c0d-f7cb0cd349dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:20.488737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:20.594896 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46603fcc-54b7-445d-8c0d-f7cb0cd349dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:20.596573 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46603fcc-54b7-445d-8c0d-f7cb0cd349dd service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:20.615277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 716/1431] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:21.431152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cea20a-1dd7-4029-b98d-f9a0beef1ef5 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:21.431696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cea20a-1dd7-4029-b98d-f9a0beef1ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:21.431696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cea20a-1dd7-4029-b98d-f9a0beef1ef5 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:21.432948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:21.438974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857fda-ae2c-4df7-8eb9-8924a1336e58 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:21.440066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857fda-ae2c-4df7-8eb9-8924a1336e58 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:21.440066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857fda-ae2c-4df7-8eb9-8924a1336e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:21.532303 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1b857fda-ae2c-4df7-8eb9-8924a1336e58 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:21.533581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1b857fda-ae2c-4df7-8eb9-8924a1336e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:21.614028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:21.645027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:21.800296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cea20a-1dd7-4029-b98d-f9a0beef1ef5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:21.801861 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a9cea20a-1dd7-4029-b98d-f9a0beef1ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:21.820903 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:21.957282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cea20a-1dd7-4029-b98d-f9a0beef1ef5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:22.057440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:22.086078 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f13076-4fc4-4843-a645-8429c75c317e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:22.086732 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13076-4fc4-4843-a645-8429c75c317e service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:22.087010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13076-4fc4-4843-a645-8429c75c317e service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:22.087268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f13076-4fc4-4843-a645-8429c75c317e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:22.088941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d5f13076-4fc4-4843-a645-8429c75c317e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:22.194936 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f13076-4fc4-4843-a645-8429c75c317e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:22.196582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f13076-4fc4-4843-a645-8429c75c317e service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:22.215664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 717/1434] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:23.037678 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d6bab-a0c1-454b-80ee-d0eaf0af83a8 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:23.038287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d6bab-a0c1-454b-80ee-d0eaf0af83a8 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:23.038287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d6bab-a0c1-454b-80ee-d0eaf0af83a8 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:23.040354 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:56:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:23.048976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644764d-a14a-495c-89ad-ba8e32b6cce8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:23.049787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644764d-a14a-495c-89ad-ba8e32b6cce8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:23.049966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644764d-a14a-495c-89ad-ba8e32b6cce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:23.134145 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6644764d-a14a-495c-89ad-ba8e32b6cce8 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:23.135385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6644764d-a14a-495c-89ad-ba8e32b6cce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:23.180506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:23.238146 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:23.395109 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d6bab-a0c1-454b-80ee-d0eaf0af83a8 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:23.396649 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f76d6bab-a0c1-454b-80ee-d0eaf0af83a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:23.554472 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d6bab-a0c1-454b-80ee-d0eaf0af83a8 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:23.613578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:23.676073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84e52c-9926-44a2-a832-719f547a4277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:23.676694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84e52c-9926-44a2-a832-719f547a4277 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:23.676972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84e52c-9926-44a2-a832-719f547a4277 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:23.677213 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84e52c-9926-44a2-a832-719f547a4277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:23.678945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ad84e52c-9926-44a2-a832-719f547a4277 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:23.776528 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84e52c-9926-44a2-a832-719f547a4277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:23.778462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84e52c-9926-44a2-a832-719f547a4277 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:23.798639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 719/1437] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:24.615009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f8909-3b78-4e37-8b40-eee7cc61117c None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:24.615645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f8909-3b78-4e37-8b40-eee7cc61117c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:24.615645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f8909-3b78-4e37-8b40-eee7cc61117c None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:24.617064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 15:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:24.623076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860338c-2841-46b5-a7c1-d260f19560b5 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:24.623856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860338c-2841-46b5-a7c1-d260f19560b5 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:24.623856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860338c-2841-46b5-a7c1-d260f19560b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:24.711770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-6860338c-2841-46b5-a7c1-d260f19560b5 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:24.713056 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-6860338c-2841-46b5-a7c1-d260f19560b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:24.715348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:24.818091 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 15:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:24.972724 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f8909-3b78-4e37-8b40-eee7cc61117c None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:24.975296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2d1f8909-3b78-4e37-8b40-eee7cc61117c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:25.136002 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f8909-3b78-4e37-8b40-eee7cc61117c None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:25.165323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:25.252846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c8927-48d2-48e3-aff2-32fb8c26f11e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:25.253382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c8927-48d2-48e3-aff2-32fb8c26f11e service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:25.253680 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c8927-48d2-48e3-aff2-32fb8c26f11e service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:25.253942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c8927-48d2-48e3-aff2-32fb8c26f11e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:25.255620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4a2c8927-48d2-48e3-aff2-32fb8c26f11e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:25.361607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c8927-48d2-48e3-aff2-32fb8c26f11e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:25.363297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c8927-48d2-48e3-aff2-32fb8c26f11e service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:25.382978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 720/1440] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:27.220583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697e309-5b53-487b-8af6-1336e986ee80 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:27.221534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697e309-5b53-487b-8af6-1336e986ee80 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:27.221534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697e309-5b53-487b-8af6-1336e986ee80 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:27.223696 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:56:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:27.229446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af532ddf-fb6c-43d7-97a8-1066d843bcff None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:27.229904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af532ddf-fb6c-43d7-97a8-1066d843bcff None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:27.230007 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af532ddf-fb6c-43d7-97a8-1066d843bcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:27.275148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:27.302874 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-af532ddf-fb6c-43d7-97a8-1066d843bcff None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:27.304109 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-af532ddf-fb6c-43d7-97a8-1066d843bcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:27.408544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:27.702493 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697e309-5b53-487b-8af6-1336e986ee80 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:27.705073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-6697e309-5b53-487b-8af6-1336e986ee80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:27.824460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697e309-5b53-487b-8af6-1336e986ee80 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:27.858472 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:27.903295 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581448ca-8d78-4c67-b778-c30e49c6ab2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:27.903913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581448ca-8d78-4c67-b778-c30e49c6ab2d service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:27.904188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581448ca-8d78-4c67-b778-c30e49c6ab2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:27.904459 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581448ca-8d78-4c67-b778-c30e49c6ab2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:27.906076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-581448ca-8d78-4c67-b778-c30e49c6ab2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:28.042265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581448ca-8d78-4c67-b778-c30e49c6ab2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:28.043675 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581448ca-8d78-4c67-b778-c30e49c6ab2d service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:28.063930 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 722/1443] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:30.186014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b62cb-9a6e-4454-a529-8634c953ef31 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:30.186661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b62cb-9a6e-4454-a529-8634c953ef31 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:30.186661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b62cb-9a6e-4454-a529-8634c953ef31 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:30.187970 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:30.195231 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8d179-50bd-4b25-b035-4819b86a79f3 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:30.195994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8d179-50bd-4b25-b035-4819b86a79f3 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:30.196166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8d179-50bd-4b25-b035-4819b86a79f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:30.270350 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-63e8d179-50bd-4b25-b035-4819b86a79f3 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:30.272300 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-63e8d179-50bd-4b25-b035-4819b86a79f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:30.293677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:30.387989 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:30.675683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b62cb-9a6e-4454-a529-8634c953ef31 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:30.677254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ad8b62cb-9a6e-4454-a529-8634c953ef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:30.788618 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b62cb-9a6e-4454-a529-8634c953ef31 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:30.801705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:30.878492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451f314-02cf-4c24-8f97-bcde74bb9385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:30.879167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451f314-02cf-4c24-8f97-bcde74bb9385 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:30.879444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451f314-02cf-4c24-8f97-bcde74bb9385 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:30.879719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451f314-02cf-4c24-8f97-bcde74bb9385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:30.881371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a451f314-02cf-4c24-8f97-bcde74bb9385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:31.001723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451f314-02cf-4c24-8f97-bcde74bb9385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:31.003257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451f314-02cf-4c24-8f97-bcde74bb9385 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:31.023805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 723/1446] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:33.373113 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4088431-6b69-400b-9099-55ed90c8372c None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:33.373710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4088431-6b69-400b-9099-55ed90c8372c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:33.373710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4088431-6b69-400b-9099-55ed90c8372c None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:33.375053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:56:33.381567 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111fbf-4730-4f7f-addb-fb597be1278c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:33.382143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111fbf-4730-4f7f-addb-fb597be1278c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:33.382143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54111fbf-4730-4f7f-addb-fb597be1278c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:33.433640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:33.452918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-54111fbf-4730-4f7f-addb-fb597be1278c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:33.454177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-54111fbf-4730-4f7f-addb-fb597be1278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:33.566328 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:33.845782 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4088431-6b69-400b-9099-55ed90c8372c None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:33.847587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e4088431-6b69-400b-9099-55ed90c8372c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:33.975626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4088431-6b69-400b-9099-55ed90c8372c None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:34.022282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:34.070917 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f11c8d-e034-45f7-907c-7310c8811f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:34.071621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f11c8d-e034-45f7-907c-7310c8811f5c service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:34.071895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f11c8d-e034-45f7-907c-7310c8811f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:34.072159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f11c8d-e034-45f7-907c-7310c8811f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:34.073883 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-92f11c8d-e034-45f7-907c-7310c8811f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:34.196321 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f11c8d-e034-45f7-907c-7310c8811f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:34.197789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f11c8d-e034-45f7-907c-7310c8811f5c service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:34.221507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 725/1449] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:36.324622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9489-8215-44db-8e24-885f9ec764f6 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:36.325175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9489-8215-44db-8e24-885f9ec764f6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:36.325175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa9489-8215-44db-8e24-885f9ec764f6 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:36.326524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:36.332322 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3f87d-a52a-4fe6-8dd3-69990424f3e5 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:36.332783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3f87d-a52a-4fe6-8dd3-69990424f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:36.332904 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3f87d-a52a-4fe6-8dd3-69990424f3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:36.414040 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-39d3f87d-a52a-4fe6-8dd3-69990424f3e5 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:36.415365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-39d3f87d-a52a-4fe6-8dd3-69990424f3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:36.439556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:36.532574 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:36.812113 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9489-8215-44db-8e24-885f9ec764f6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:36.814635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-27aa9489-8215-44db-8e24-885f9ec764f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:36.941895 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa9489-8215-44db-8e24-885f9ec764f6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:36.964935 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:37.029360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2e7db-528a-4386-8773-71275b542674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:37.029981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2e7db-528a-4386-8773-71275b542674 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:37.030258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2e7db-528a-4386-8773-71275b542674 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:37.030527 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2e7db-528a-4386-8773-71275b542674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:37.033073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-23d2e7db-528a-4386-8773-71275b542674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:37.170746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2e7db-528a-4386-8773-71275b542674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:37.172210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2e7db-528a-4386-8773-71275b542674 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:37.191680 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 726/1452] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:39.229281 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00632ee6-6bbd-45ff-acaf-f9afd3848694 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:39.229882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00632ee6-6bbd-45ff-acaf-f9afd3848694 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:39.229882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00632ee6-6bbd-45ff-acaf-f9afd3848694 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:39.231210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:39.237471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e4bf-a353-45cd-8f83-f20db9262eee None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:39.238202 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e4bf-a353-45cd-8f83-f20db9262eee None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:39.238304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e4bf-a353-45cd-8f83-f20db9262eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:39.321858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:39.325455 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5ba8e4bf-a353-45cd-8f83-f20db9262eee None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:39.327705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5ba8e4bf-a353-45cd-8f83-f20db9262eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:39.439363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:39.762507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00632ee6-6bbd-45ff-acaf-f9afd3848694 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:39.764121 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-00632ee6-6bbd-45ff-acaf-f9afd3848694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:39.889523 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00632ee6-6bbd-45ff-acaf-f9afd3848694 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:39.954659 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:39.982831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c0e26-34ed-438c-8e88-c3461fb3b032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:39.983442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c0e26-34ed-438c-8e88-c3461fb3b032 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:39.983709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c0e26-34ed-438c-8e88-c3461fb3b032 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:39.983968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c0e26-34ed-438c-8e88-c3461fb3b032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:39.986197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e36c0e26-34ed-438c-8e88-c3461fb3b032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:40.109931 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c0e26-34ed-438c-8e88-c3461fb3b032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:40.111340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c0e26-34ed-438c-8e88-c3461fb3b032 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:40.131209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 728/1455] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:42.380329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7a854-0fc4-42df-b326-ff6fe66fadc0 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:42.380920 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7a854-0fc4-42df-b326-ff6fe66fadc0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:42.380920 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7a854-0fc4-42df-b326-ff6fe66fadc0 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:42.382334 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 15:56:42.388563 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71de88-b841-4aae-9929-2a6850501ac0 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:42.389150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71de88-b841-4aae-9929-2a6850501ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:42.389150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71de88-b841-4aae-9929-2a6850501ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:42.469665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-3c71de88-b841-4aae-9929-2a6850501ac0 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:42.470953 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3c71de88-b841-4aae-9929-2a6850501ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:42.506379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:42.587344 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:42.909887 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7a854-0fc4-42df-b326-ff6fe66fadc0 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:42.911546 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5ad7a854-0fc4-42df-b326-ff6fe66fadc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:43.041859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7a854-0fc4-42df-b326-ff6fe66fadc0 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:43.074917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:43.133741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181cd94-bb7c-4d44-b532-be914333fef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:43.134822 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181cd94-bb7c-4d44-b532-be914333fef7 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:43.135195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181cd94-bb7c-4d44-b532-be914333fef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:43.135698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181cd94-bb7c-4d44-b532-be914333fef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:43.137533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c181cd94-bb7c-4d44-b532-be914333fef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:43.271756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181cd94-bb7c-4d44-b532-be914333fef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:43.273493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181cd94-bb7c-4d44-b532-be914333fef7 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:43.296346 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 729/1458] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:45.411544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d2778-3630-4c21-84ca-778668247701 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:45.412369 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d2778-3630-4c21-84ca-778668247701 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:45.412369 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d2778-3630-4c21-84ca-778668247701 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:45.413655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:56:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:45.420329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc89908-135a-443f-99ae-f01a4e121dce None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:45.420919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc89908-135a-443f-99ae-f01a4e121dce None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:45.420919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc89908-135a-443f-99ae-f01a4e121dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:45.504387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-fcc89908-135a-443f-99ae-f01a4e121dce None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:45.505654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fcc89908-135a-443f-99ae-f01a4e121dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:45.515927 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:45.628658 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:45.924701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d2778-3630-4c21-84ca-778668247701 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:45.926441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ad4d2778-3630-4c21-84ca-778668247701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:46.058850 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d2778-3630-4c21-84ca-778668247701 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:46.134362 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:46.159214 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dfe03-4e89-4334-99a4-4d6d7b392f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:46.159834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dfe03-4e89-4334-99a4-4d6d7b392f1d service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:46.161139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dfe03-4e89-4334-99a4-4d6d7b392f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:46.161405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dfe03-4e89-4334-99a4-4d6d7b392f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:46.163285 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-691dfe03-4e89-4334-99a4-4d6d7b392f1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:46.333514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dfe03-4e89-4334-99a4-4d6d7b392f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:46.335302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dfe03-4e89-4334-99a4-4d6d7b392f1d service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:46.356852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 731/1461] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:48.351831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc932faf-7adb-4f03-9889-327e86859b65 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:48.352403 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc932faf-7adb-4f03-9889-327e86859b65 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:48.352403 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc932faf-7adb-4f03-9889-327e86859b65 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:48.353764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:48.360311 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0771b-1c28-4054-a13e-0bd781e5c434 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:48.360779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0771b-1c28-4054-a13e-0bd781e5c434 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:48.360889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0771b-1c28-4054-a13e-0bd781e5c434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:48.448164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-81f0771b-1c28-4054-a13e-0bd781e5c434 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:48.449448 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-81f0771b-1c28-4054-a13e-0bd781e5c434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:48.494235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:48.557341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:48.865516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc932faf-7adb-4f03-9889-327e86859b65 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:48.867148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fc932faf-7adb-4f03-9889-327e86859b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:48.981180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc932faf-7adb-4f03-9889-327e86859b65 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:49.021560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:49.061669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d69f2-5fb5-423b-877e-538071aaebdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:49.062289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d69f2-5fb5-423b-877e-538071aaebdd service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:49.062569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d69f2-5fb5-423b-877e-538071aaebdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:49.062870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d69f2-5fb5-423b-877e-538071aaebdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:49.064529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cf6d69f2-5fb5-423b-877e-538071aaebdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:49.186824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d69f2-5fb5-423b-877e-538071aaebdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:49.188270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d69f2-5fb5-423b-877e-538071aaebdd service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:49.208581 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 732/1464] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:56:51.151597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d012d-abfd-482e-b967-4f62e652b634 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:51.152554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d012d-abfd-482e-b967-4f62e652b634 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:51.152554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d012d-abfd-482e-b967-4f62e652b634 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:51.154559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:56:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:51.161482 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c5baa-377e-4c19-b357-bfce46c901e5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:51.162154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c5baa-377e-4c19-b357-bfce46c901e5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:51.162338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c5baa-377e-4c19-b357-bfce46c901e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:51.236094 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2f9c5baa-377e-4c19-b357-bfce46c901e5 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:51.237411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2f9c5baa-377e-4c19-b357-bfce46c901e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:51.257514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:51.346128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:51.632521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d012d-abfd-482e-b967-4f62e652b634 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:51.634110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4a4d012d-abfd-482e-b967-4f62e652b634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:51.752151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d012d-abfd-482e-b967-4f62e652b634 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:51.826029 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:51.833450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077e8ee-964b-4071-b1bc-3dcfb58e39ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:51.834055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077e8ee-964b-4071-b1bc-3dcfb58e39ab service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:51.834331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077e8ee-964b-4071-b1bc-3dcfb58e39ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:51.834626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077e8ee-964b-4071-b1bc-3dcfb58e39ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:51.836233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f077e8ee-964b-4071-b1bc-3dcfb58e39ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:51.951304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077e8ee-964b-4071-b1bc-3dcfb58e39ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:51.952785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077e8ee-964b-4071-b1bc-3dcfb58e39ab service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:51.970862 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 734/1467] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:56:53.937075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84409b39-3a20-4471-91d3-3ca3353e491b None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:53.937715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84409b39-3a20-4471-91d3-3ca3353e491b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:53.937715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84409b39-3a20-4471-91d3-3ca3353e491b None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:53.939047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 15:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:56:53.945632 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1f21b-f8a6-460b-bb6a-e103dc42e2fa None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:53.946289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1f21b-f8a6-460b-bb6a-e103dc42e2fa None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:53.946289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1f21b-f8a6-460b-bb6a-e103dc42e2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:54.021177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-bac1f21b-f8a6-460b-bb6a-e103dc42e2fa None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:56:54.022429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bac1f21b-f8a6-460b-bb6a-e103dc42e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:54.076202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:54.129047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 15:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:56:54.413650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84409b39-3a20-4471-91d3-3ca3353e491b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:56:54.415252 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-84409b39-3a20-4471-91d3-3ca3353e491b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:54.535012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84409b39-3a20-4471-91d3-3ca3353e491b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:56:54.589279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:56:54.617948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee6157-a53e-4cbd-abf7-5ed1c8f2542b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:56:54.618564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee6157-a53e-4cbd-abf7-5ed1c8f2542b service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:56:54.618871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee6157-a53e-4cbd-abf7-5ed1c8f2542b service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:56:54.619139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee6157-a53e-4cbd-abf7-5ed1c8f2542b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:56:54.620731 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2fee6157-a53e-4cbd-abf7-5ed1c8f2542b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:56:54.751655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee6157-a53e-4cbd-abf7-5ed1c8f2542b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:56:54.751935 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee6157-a53e-4cbd-abf7-5ed1c8f2542b service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:56:54.770635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 735/1470] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:04.126759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=22 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:04.768195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=66 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:14.639961 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3802-da8b-49f2-93de-3b01c8d01a98 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:14.640531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3802-da8b-49f2-93de-3b01c8d01a98 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:14.640531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3802-da8b-49f2-93de-3b01c8d01a98 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:14.641759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 736/1471] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:14.647568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452e071-2431-48f5-ab4b-6fa0b300ea3e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:14.648087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452e071-2431-48f5-ab4b-6fa0b300ea3e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:14.648087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452e071-2431-48f5-ab4b-6fa0b300ea3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:14.723895 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b452e071-2431-48f5-ab4b-6fa0b300ea3e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:14.724292 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b452e071-2431-48f5-ab4b-6fa0b300ea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:14.847740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 736/1472] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:15.141415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e907d1-1f96-451a-9522-7fae088d45f3 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.141700 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e907d1-1f96-451a-9522-7fae088d45f3 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.141974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e907d1-1f96-451a-9522-7fae088d45f3 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.143375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 737/1473] 10.222.0.77 () {54 vars in 967 bytes} [Mon Aug 22 15:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:15.149022 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e437c86-2d02-4151-a112-d29cf6a2fcd0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.149354 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e437c86-2d02-4151-a112-d29cf6a2fcd0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.149642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e437c86-2d02-4151-a112-d29cf6a2fcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.232520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6e437c86-2d02-4151-a112-d29cf6a2fcd0 None None] MFA Rules not processed for user `3f7c46f4dc084a948bd09ca9b86c2748`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:15.233727 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6e437c86-2d02-4151-a112-d29cf6a2fcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:15.255034 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:15.318441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 737/1474] 10.222.0.77 () {58 vars in 1064 bytes} [Mon Aug 22 15:57:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:15.326616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e907d1-1f96-451a-9522-7fae088d45f3 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:15.328164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-36e907d1-1f96-451a-9522-7fae088d45f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:15.444325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e907d1-1f96-451a-9522-7fae088d45f3 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:15.526058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bda78d-d076-4f6e-b677-271f6c062092 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7c46f4dc084a948bd09ca9b86c2748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:15.526703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bda78d-d076-4f6e-b677-271f6c062092 service glance] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:15.526982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bda78d-d076-4f6e-b677-271f6c062092 service glance] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:15.527248 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bda78d-d076-4f6e-b677-271f6c062092 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:15.528912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-09bda78d-d076-4f6e-b677-271f6c062092 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:15.588482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:15.649370 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bda78d-d076-4f6e-b677-271f6c062092 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:15.650892 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bda78d-d076-4f6e-b677-271f6c062092 service glance] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:15.670985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 738/1475] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:17.680029 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264541ae-65dd-4b5a-834a-43b3fe6d3928 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:17.680627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264541ae-65dd-4b5a-834a-43b3fe6d3928 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:17.680627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264541ae-65dd-4b5a-834a-43b3fe6d3928 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:17.681944 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 738/1476] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:17.687488 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fdd64-fc36-4817-8a5f-bb92fdadbb4a None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:17.687948 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fdd64-fc36-4817-8a5f-bb92fdadbb4a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:17.688045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fdd64-fc36-4817-8a5f-bb92fdadbb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:17.758572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-632fdd64-fc36-4817-8a5f-bb92fdadbb4a None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:17.759854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-632fdd64-fc36-4817-8a5f-bb92fdadbb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:17.874351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 739/1477] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:18.140541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264541ae-65dd-4b5a-834a-43b3fe6d3928 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:18.142096 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-264541ae-65dd-4b5a-834a-43b3fe6d3928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:18.316174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264541ae-65dd-4b5a-834a-43b3fe6d3928 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:18.369803 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:18.419640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c2dc2-5fa3-4c7b-81f2-5b85cbb4980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:18.420286 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2dc2-5fa3-4c7b-81f2-5b85cbb4980d admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:18.420548 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2dc2-5fa3-4c7b-81f2-5b85cbb4980d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:18.420818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c2dc2-5fa3-4c7b-81f2-5b85cbb4980d admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:18.421468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c2dc2-5fa3-4c7b-81f2-5b85cbb4980d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:18.423314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-f54c2dc2-5fa3-4c7b-81f2-5b85cbb4980d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:57:18.423314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 22 15:57:18.423314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: Aug 22 15:57:18.424483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c2dc2-5fa3-4c7b-81f2-5b85cbb4980d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:18.446637 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 739/1478] 10.222.0.77 () {56 vars in 1108 bytes} [Mon Aug 22 15:57:18 2022] GET /identity/v3/projects => generated 2553 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:57:20.384062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e756e5-8ea4-431d-8f94-57b09d21fe7b None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:20.384981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e756e5-8ea4-431d-8f94-57b09d21fe7b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:20.384981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e756e5-8ea4-431d-8f94-57b09d21fe7b None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:20.387334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 740/1479] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:57:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:20.393689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3dedc-5906-4c6a-a563-454247e7b938 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:20.394155 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3dedc-5906-4c6a-a563-454247e7b938 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:20.394258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3dedc-5906-4c6a-a563-454247e7b938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:20.466524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-cea3dedc-5906-4c6a-a563-454247e7b938 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:20.467812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cea3dedc-5906-4c6a-a563-454247e7b938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:20.569571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 740/1480] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:20.862083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e756e5-8ea4-431d-8f94-57b09d21fe7b None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:20.864461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-69e756e5-8ea4-431d-8f94-57b09d21fe7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:20.879912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:21.048228 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e756e5-8ea4-431d-8f94-57b09d21fe7b None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:21.152062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:21.189743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee7b64-2445-4605-a838-1771a071f13d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:21.190557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee7b64-2445-4605-a838-1771a071f13d service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:21.191036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee7b64-2445-4605-a838-1771a071f13d service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:21.191439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee7b64-2445-4605-a838-1771a071f13d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:21.193996 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-37ee7b64-2445-4605-a838-1771a071f13d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:21.294385 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee7b64-2445-4605-a838-1771a071f13d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:21.296062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee7b64-2445-4605-a838-1771a071f13d service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:21.314708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 741/1481] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:23.435429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e75bcf-d9b2-4cf4-8b69-0674d873b356 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:23.436039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e75bcf-d9b2-4cf4-8b69-0674d873b356 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:23.436039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e75bcf-d9b2-4cf4-8b69-0674d873b356 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:23.437495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 741/1482] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:23.443544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885723ef-7570-4bd8-9505-20e0a1573d7b None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:23.444241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885723ef-7570-4bd8-9505-20e0a1573d7b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:23.444241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885723ef-7570-4bd8-9505-20e0a1573d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:23.518270 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-885723ef-7570-4bd8-9505-20e0a1573d7b None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:23.519551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-885723ef-7570-4bd8-9505-20e0a1573d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:23.575629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:23.632809 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 742/1483] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:23.917495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e75bcf-d9b2-4cf4-8b69-0674d873b356 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:23.920164 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-23e75bcf-d9b2-4cf4-8b69-0674d873b356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:23.954423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:24.050428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e75bcf-d9b2-4cf4-8b69-0674d873b356 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:24.145065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a70db-c973-4100-b367-5317682b7052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:24.145691 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a70db-c973-4100-b367-5317682b7052 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:24.146100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a70db-c973-4100-b367-5317682b7052 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:24.146337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a70db-c973-4100-b367-5317682b7052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:24.148048 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-050a70db-c973-4100-b367-5317682b7052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:24.228767 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:24.276632 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a70db-c973-4100-b367-5317682b7052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:24.278105 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a70db-c973-4100-b367-5317682b7052 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:24.297473 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 742/1484] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 15:57:26.267734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee481bd-c0df-4bcb-8051-9a298cee3380 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:26.268315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee481bd-c0df-4bcb-8051-9a298cee3380 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:26.268315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee481bd-c0df-4bcb-8051-9a298cee3380 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:26.269876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 743/1485] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:26.276682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aacb8-a580-4b7a-85c0-35e56db5a1a9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:26.277228 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aacb8-a580-4b7a-85c0-35e56db5a1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:26.277228 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95aacb8-a580-4b7a-85c0-35e56db5a1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:26.351317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c95aacb8-a580-4b7a-85c0-35e56db5a1a9 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:26.352573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c95aacb8-a580-4b7a-85c0-35e56db5a1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:26.460063 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 743/1486] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 15:57:26.750504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee481bd-c0df-4bcb-8051-9a298cee3380 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:26.752928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-dee481bd-c0df-4bcb-8051-9a298cee3380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:26.878330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee481bd-c0df-4bcb-8051-9a298cee3380 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:26.955453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:26.959265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6048b3-a16b-45e3-a007-b71d69c6d738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:26.960132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6048b3-a16b-45e3-a007-b71d69c6d738 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:26.960454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6048b3-a16b-45e3-a007-b71d69c6d738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:26.960876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6048b3-a16b-45e3-a007-b71d69c6d738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:26.963053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5a6048b3-a16b-45e3-a007-b71d69c6d738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:27.079301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6048b3-a16b-45e3-a007-b71d69c6d738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:27.080677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6048b3-a16b-45e3-a007-b71d69c6d738 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:27.100628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 744/1487] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:29.138616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2ce4b-6be7-4663-9613-30481a36dbbb None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:29.139220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2ce4b-6be7-4663-9613-30481a36dbbb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:29.139220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2ce4b-6be7-4663-9613-30481a36dbbb None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:29.140580 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 744/1488] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:29.146366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b5a7b-58cb-4f7d-89d5-e5615f0933a7 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:29.146919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b5a7b-58cb-4f7d-89d5-e5615f0933a7 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:29.146919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b5a7b-58cb-4f7d-89d5-e5615f0933a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:29.221927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-dc2b5a7b-58cb-4f7d-89d5-e5615f0933a7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:29.223204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-dc2b5a7b-58cb-4f7d-89d5-e5615f0933a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:29.281929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:29.337667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 745/1489] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:29.629885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2ce4b-6be7-4663-9613-30481a36dbbb None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:29.631568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9bd2ce4b-6be7-4663-9613-30481a36dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:29.673351 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:29.747875 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2ce4b-6be7-4663-9613-30481a36dbbb None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:29.826212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a988ddf-29e3-43b7-afaf-00d67872ac49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:29.826860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988ddf-29e3-43b7-afaf-00d67872ac49 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:29.827143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988ddf-29e3-43b7-afaf-00d67872ac49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:29.827406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988ddf-29e3-43b7-afaf-00d67872ac49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:29.829030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4a988ddf-29e3-43b7-afaf-00d67872ac49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:29.926531 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:29.960147 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a988ddf-29e3-43b7-afaf-00d67872ac49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:29.961643 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a988ddf-29e3-43b7-afaf-00d67872ac49 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:29.988491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 745/1490] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:32.157052 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271e95d-9d66-416e-9173-6ea21ddb7407 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:32.157592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271e95d-9d66-416e-9173-6ea21ddb7407 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:32.157592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271e95d-9d66-416e-9173-6ea21ddb7407 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:32.158850 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 746/1491] 10.222.0.77 () {54 vars in 927 bytes} [Mon Aug 22 15:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:57:32.164452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97b199-369f-45ae-b160-e4fc50ffa51e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:32.164951 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97b199-369f-45ae-b160-e4fc50ffa51e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:32.164951 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97b199-369f-45ae-b160-e4fc50ffa51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:32.235098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4d97b199-369f-45ae-b160-e4fc50ffa51e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:57:32.236355 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4d97b199-369f-45ae-b160-e4fc50ffa51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:32.475815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 746/1492] 10.222.0.77 () {58 vars in 1024 bytes} [Mon Aug 22 15:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:57:32.758632 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271e95d-9d66-416e-9173-6ea21ddb7407 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:57:32.760244 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d271e95d-9d66-416e-9173-6ea21ddb7407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:32.879586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271e95d-9d66-416e-9173-6ea21ddb7407 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:57:32.961897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba9654-a686-4e04-911f-118fe7ba070c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:57:32.962531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba9654-a686-4e04-911f-118fe7ba070c service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:57:32.962840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba9654-a686-4e04-911f-118fe7ba070c service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:57:32.963110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba9654-a686-4e04-911f-118fe7ba070c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:57:32.964754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-6aba9654-a686-4e04-911f-118fe7ba070c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:57:32.974879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:33.085330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba9654-a686-4e04-911f-118fe7ba070c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:57:33.086726 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba9654-a686-4e04-911f-118fe7ba070c service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:57:33.106300 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 747/1493] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:57:42.474085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=82 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:57:43.103276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=50 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:46.238128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7685f4-82de-4177-94c4-199d54068c0d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:46.238989 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7685f4-82de-4177-94c4-199d54068c0d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:46.238989 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7685f4-82de-4177-94c4-199d54068c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:46.336817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8d7685f4-82de-4177-94c4-199d54068c0d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:46.338122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8d7685f4-82de-4177-94c4-199d54068c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:46.445361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 747/1494] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:46.455440 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7ebec-5502-40b7-be51-928f4d9bab6a None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:46.456277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7ebec-5502-40b7-be51-928f4d9bab6a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:46.456277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7ebec-5502-40b7-be51-928f4d9bab6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:46.549888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-a4f7ebec-5502-40b7-be51-928f4d9bab6a None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:46.551299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a4f7ebec-5502-40b7-be51-928f4d9bab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:46.658883 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 748/1495] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:46.667063 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7685f4-82de-4177-94c4-199d54068c0d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:46.668585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8d7685f4-82de-4177-94c4-199d54068c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:46.685232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7685f4-82de-4177-94c4-199d54068c0d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:46.761288 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:46.804639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0eff8b-1a97-4eca-8321-417ca998ac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:46.805282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0eff8b-1a97-4eca-8321-417ca998ac09 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:46.805630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0eff8b-1a97-4eca-8321-417ca998ac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:46.806025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0eff8b-1a97-4eca-8321-417ca998ac09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:46.806550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0eff8b-1a97-4eca-8321-417ca998ac09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 15:58:46.806862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0eff8b-1a97-4eca-8321-417ca998ac09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:46.807939 dv-cinder-854004-1-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-0c0eff8b-1a97-4eca-8321-417ca998ac09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:58:46.807939 dv-cinder-854004-1-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 22 15:58:46.807939 dv-cinder-854004-1-smb devstack@keystone.service[81661]: Aug 22 15:58:46.808838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0eff8b-1a97-4eca-8321-417ca998ac09 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:46.824320 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 748/1496] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 15:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 15:58:46.834090 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7ebec-5502-40b7-be51-928f4d9bab6a None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:46.844668 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7ebec-5502-40b7-be51-928f4d9bab6a None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:46.924862 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:46.975504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1eb314-115c-4547-ba22-8e8dab55b0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:46.976142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eb314-115c-4547-ba22-8e8dab55b0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:46.976417 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eb314-115c-4547-ba22-8e8dab55b0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:46.976684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eb314-115c-4547-ba22-8e8dab55b0b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:46.977327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1eb314-115c-4547-ba22-8e8dab55b0b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:46.979401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: WARNING py.warnings [None req-ce1eb314-115c-4547-ba22-8e8dab55b0b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:58:46.979401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: warnings.warn(msg) Aug 22 15:58:46.979401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: Aug 22 15:58:46.980658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1eb314-115c-4547-ba22-8e8dab55b0b9 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:47.063495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 749/1497] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 15:58:46 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:47.069597 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0eff8b-1a97-4eca-8321-417ca998ac09 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:47.071163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0c0eff8b-1a97-4eca-8321-417ca998ac09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:47.112472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0eff8b-1a97-4eca-8321-417ca998ac09 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:47.214207 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bf756-6434-44fc-89d3-11f2d3fa19e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:47.214865 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bf756-6434-44fc-89d3-11f2d3fa19e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:47.215137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bf756-6434-44fc-89d3-11f2d3fa19e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:47.215448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bf756-6434-44fc-89d3-11f2d3fa19e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:47.216081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940bf756-6434-44fc-89d3-11f2d3fa19e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:47.217072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-940bf756-6434-44fc-89d3-11f2d3fa19e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:58:47.217072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 22 15:58:47.217072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: Aug 22 15:58:47.218296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940bf756-6434-44fc-89d3-11f2d3fa19e0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:47.268982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 749/1498] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 15:58:47 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 15:58:47.273682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1eb314-115c-4547-ba22-8e8dab55b0b9 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:47.275326 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ce1eb314-115c-4547-ba22-8e8dab55b0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:47.343100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1eb314-115c-4547-ba22-8e8dab55b0b9 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:47.445156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:47.458365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e4f9d-04a1-429d-b358-85d1c47c2e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:47.459150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4f9d-04a1-429d-b358-85d1c47c2e14 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:47.459251 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4f9d-04a1-429d-b358-85d1c47c2e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:47.459509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4f9d-04a1-429d-b358-85d1c47c2e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:47.460157 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e4f9d-04a1-429d-b358-85d1c47c2e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:47.461170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: WARNING py.warnings [None req-1d3e4f9d-04a1-429d-b358-85d1c47c2e14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:58:47.461170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: warnings.warn(msg) Aug 22 15:58:47.461170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: Aug 22 15:58:47.462060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e4f9d-04a1-429d-b358-85d1c47c2e14 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:47.475232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 750/1499] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:47.479424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bf756-6434-44fc-89d3-11f2d3fa19e0 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:47.481340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-940bf756-6434-44fc-89d3-11f2d3fa19e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:47.493729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bf756-6434-44fc-89d3-11f2d3fa19e0 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:47.521794 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:47.611318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f059f-f6bc-4628-8ce5-1c077605c8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:47.611851 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f059f-f6bc-4628-8ce5-1c077605c8bf admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:47.612124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f059f-f6bc-4628-8ce5-1c077605c8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:47.612390 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f059f-f6bc-4628-8ce5-1c077605c8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:47.613041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f059f-f6bc-4628-8ce5-1c077605c8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:47.614061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-013f059f-f6bc-4628-8ce5-1c077605c8bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:58:47.614061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 22 15:58:47.614061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: Aug 22 15:58:47.615001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f059f-f6bc-4628-8ce5-1c077605c8bf admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:47.628082 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 750/1500] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 15:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 15:58:47.632501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e4f9d-04a1-429d-b358-85d1c47c2e14 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:47.634047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1d3e4f9d-04a1-429d-b358-85d1c47c2e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:47.671165 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e4f9d-04a1-429d-b358-85d1c47c2e14 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:47.772433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00fce6-8872-4f32-9417-670ca8d5b54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:47.773093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00fce6-8872-4f32-9417-670ca8d5b54b admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:47.773386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00fce6-8872-4f32-9417-670ca8d5b54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:47.773650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00fce6-8872-4f32-9417-670ca8d5b54b admin admin] PATH_INFO: `/v3/projects/52c42443cb59443a9370a29ccdf13aa1/users/a74b31d39c9b43c6944c0664bcfe160f/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:47.796873 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00fce6-8872-4f32-9417-670ca8d5b54b admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c42443cb59443a9370a29ccdf13aa1, user_id=a74b31d39c9b43c6944c0664bcfe160f, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:47.797911 dv-cinder-854004-1-smb devstack@keystone.service[81660]: WARNING py.warnings [None req-ce00fce6-8872-4f32-9417-670ca8d5b54b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:58:47.797911 dv-cinder-854004-1-smb devstack@keystone.service[81660]: warnings.warn(msg) Aug 22 15:58:47.797911 dv-cinder-854004-1-smb devstack@keystone.service[81660]: Aug 22 15:58:47.800078 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00fce6-8872-4f32-9417-670ca8d5b54b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:47.829722 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 751/1501] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 15:58:47 2022] PUT /identity/v3/projects/52c42443cb59443a9370a29ccdf13aa1/users/a74b31d39c9b43c6944c0664bcfe160f/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:47.846561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427497f-a599-43b7-9f95-30a2d67ae6cb None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:47.846889 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427497f-a599-43b7-9f95-30a2d67ae6cb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:47.847155 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427497f-a599-43b7-9f95-30a2d67ae6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:47.912215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a427497f-a599-43b7-9f95-30a2d67ae6cb None None] MFA Rules not processed for user `a74b31d39c9b43c6944c0664bcfe160f`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:47.914427 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a427497f-a599-43b7-9f95-30a2d67ae6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:48.004072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 751/1502] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:48.018674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984b3bd-b88b-4ebb-ba00-a5a4bba0217c None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:48.019015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984b3bd-b88b-4ebb-ba00-a5a4bba0217c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:48.019306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984b3bd-b88b-4ebb-ba00-a5a4bba0217c None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:48.021431 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 752/1503] 10.222.0.77 () {54 vars in 964 bytes} [Mon Aug 22 15:58:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:58:48.029178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0fabe-01ba-4ccd-a2e3-68f82816449a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:48.029537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0fabe-01ba-4ccd-a2e3-68f82816449a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:48.029943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0fabe-01ba-4ccd-a2e3-68f82816449a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:48.078039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:48.124135 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-04c0fabe-01ba-4ccd-a2e3-68f82816449a None None] MFA Rules not processed for user `80b255bd61e3445ab154f01fea9a95b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:48.125245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-04c0fabe-01ba-4ccd-a2e3-68f82816449a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:48.202478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 752/1504] 10.222.0.77 () {58 vars in 1061 bytes} [Mon Aug 22 15:58:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:48.210902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984b3bd-b88b-4ebb-ba00-a5a4bba0217c None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:48.212499 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8984b3bd-b88b-4ebb-ba00-a5a4bba0217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:48.286475 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:48.348981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984b3bd-b88b-4ebb-ba00-a5a4bba0217c None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:48.422249 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d09f7f-194e-4920-b98f-d3d28dcd5d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:48.423176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d09f7f-194e-4920-b98f-d3d28dcd5d37 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:48.423575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d09f7f-194e-4920-b98f-d3d28dcd5d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:48.424012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d09f7f-194e-4920-b98f-d3d28dcd5d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:48.426708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-99d09f7f-194e-4920-b98f-d3d28dcd5d37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:48.551335 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d09f7f-194e-4920-b98f-d3d28dcd5d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:48.552803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d09f7f-194e-4920-b98f-d3d28dcd5d37 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:48.556351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:48.575442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 753/1505] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:48.626011 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b272b9-bee2-4375-955b-632298092d05 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:48.626540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b272b9-bee2-4375-955b-632298092d05 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:48.626540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b272b9-bee2-4375-955b-632298092d05 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:48.628117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 753/1506] 10.222.0.77 () {52 vars in 830 bytes} [Mon Aug 22 15:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 15:58:48.632853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d09f7f-194e-4920-b98f-d3d28dcd5d37 service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:48.634841 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-99d09f7f-194e-4920-b98f-d3d28dcd5d37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:48.739528 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d09f7f-194e-4920-b98f-d3d28dcd5d37 service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:48.850364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:48.851021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:48.851293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:48.851560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] PATH_INFO: `/v3/users/a74b31d39c9b43c6944c0664bcfe160f` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:48.868692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a74b31d39c9b43c6944c0664bcfe160f)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:48.870246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: WARNING py.warnings [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:58:48.870246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: warnings.warn(msg) Aug 22 15:58:48.870246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: Aug 22 15:58:48.872110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:48.887742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:48.969446 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a74b31d39c9b43c6944c0664bcfe160f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:48.998293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a74b31d39c9b43c6944c0664bcfe160f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:49.010289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a74b31d39c9b43c6944c0664bcfe160f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:49.024959 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a74b31d39c9b43c6944c0664bcfe160f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:49.025516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a74b31d39c9b43c6944c0664bcfe160f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:49.031272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 754/1507] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 15:58:48 2022] DELETE /identity/v3/users/a74b31d39c9b43c6944c0664bcfe160f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:49.038004 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9841f94-42a8-4306-b67a-7cfccfa341ec None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:49.038381 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9841f94-42a8-4306-b67a-7cfccfa341ec None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:49.038807 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9841f94-42a8-4306-b67a-7cfccfa341ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:49.114687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c9841f94-42a8-4306-b67a-7cfccfa341ec None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 15:58:49.116206 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c9841f94-42a8-4306-b67a-7cfccfa341ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:49.192787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:49.212970 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 754/1508] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 15:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 15:58:49.223125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:49.224400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:49.336514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f70ba-f1e4-49ea-8c05-af3360b3f3fe admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:49.395489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:58:49.417754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f221b0-72ea-48e7-9723-ab29c707fa01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:49.418370 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f221b0-72ea-48e7-9723-ab29c707fa01 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:49.418679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f221b0-72ea-48e7-9723-ab29c707fa01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:49.418956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f221b0-72ea-48e7-9723-ab29c707fa01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:49.420640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-30f221b0-72ea-48e7-9723-ab29c707fa01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:49.551446 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f221b0-72ea-48e7-9723-ab29c707fa01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:49.552817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f221b0-72ea-48e7-9723-ab29c707fa01 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:49.699219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 755/1509] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 15:58:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 15:58:50.094507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9841f94-42a8-4306-b67a-7cfccfa341ec None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 15:58:50.095744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c9841f94-42a8-4306-b67a-7cfccfa341ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 15:58:50.107620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9841f94-42a8-4306-b67a-7cfccfa341ec None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 15:58:50.220469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b56c1-a296-4a75-8905-6ebc5bb62e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 15:58:50.221114 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b56c1-a296-4a75-8905-6ebc5bb62e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 15:58:50.221388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b56c1-a296-4a75-8905-6ebc5bb62e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 15:58:50.221708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b56c1-a296-4a75-8905-6ebc5bb62e16 admin admin] PATH_INFO: `/v3/projects/52c42443cb59443a9370a29ccdf13aa1` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 15:58:50.232328 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b56c1-a296-4a75-8905-6ebc5bb62e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c42443cb59443a9370a29ccdf13aa1)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 15:58:50.233717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-402b56c1-a296-4a75-8905-6ebc5bb62e16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 15:58:50.233717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 22 15:58:50.233717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: Aug 22 15:58:50.235051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b56c1-a296-4a75-8905-6ebc5bb62e16 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 15:58:50.295303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-402b56c1-a296-4a75-8905-6ebc5bb62e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c42443cb59443a9370a29ccdf13aa1', 'request_id': 'req-402b56c1-a296-4a75-8905-6ebc5bb62e16'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:50.301644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-402b56c1-a296-4a75-8905-6ebc5bb62e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c42443cb59443a9370a29ccdf13aa1', 'request_id': 'req-402b56c1-a296-4a75-8905-6ebc5bb62e16'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:50.312250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-402b56c1-a296-4a75-8905-6ebc5bb62e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c42443cb59443a9370a29ccdf13aa1', 'request_id': 'req-402b56c1-a296-4a75-8905-6ebc5bb62e16'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:50.348012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-402b56c1-a296-4a75-8905-6ebc5bb62e16 admin admin] The token cache is being invalidate because project 52c42443cb59443a9370a29ccdf13aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 15:58:50.348241 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-402b56c1-a296-4a75-8905-6ebc5bb62e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:50.348752 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-402b56c1-a296-4a75-8905-6ebc5bb62e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 15:58:50.350126 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 755/1510] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 15:58:50 2022] DELETE /identity/v3/projects/52c42443cb59443a9370a29ccdf13aa1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 15:58:59.696331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=62 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 15:59:00.341682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:31.000008 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2991ae3-3266-4316-bfff-65a5ce1cc343 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:31.000684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2991ae3-3266-4316-bfff-65a5ce1cc343 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:31.000684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2991ae3-3266-4316-bfff-65a5ce1cc343 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:31.001870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 16:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:00:31.007197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45afd0-8dc5-41b9-a8f2-732bc13e9b77 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:31.007723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45afd0-8dc5-41b9-a8f2-732bc13e9b77 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:31.007723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45afd0-8dc5-41b9-a8f2-732bc13e9b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:31.099778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8e45afd0-8dc5-41b9-a8f2-732bc13e9b77 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:31.101027 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8e45afd0-8dc5-41b9-a8f2-732bc13e9b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:31.213158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:31.365795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2991ae3-3266-4316-bfff-65a5ce1cc343 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:31.368371 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d2991ae3-3266-4316-bfff-65a5ce1cc343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:31.500166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2991ae3-3266-4316-bfff-65a5ce1cc343 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:31.507351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb905571-0d09-41cc-9e12-e58598cfd488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:31.507999 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb905571-0d09-41cc-9e12-e58598cfd488 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:31.508280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb905571-0d09-41cc-9e12-e58598cfd488 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:31.508550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb905571-0d09-41cc-9e12-e58598cfd488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:31.517820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb905571-0d09-41cc-9e12-e58598cfd488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:31.519265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb905571-0d09-41cc-9e12-e58598cfd488 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:31.530234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 757/1513] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:00:32.380868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddb406-3cfa-47f8-9e1f-23a0301265cc None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:32.381460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddb406-3cfa-47f8-9e1f-23a0301265cc None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:32.381460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddb406-3cfa-47f8-9e1f-23a0301265cc None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:32.382817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 16:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:00:32.387933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34666e5-f296-4a14-8373-2fbc48a42af2 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:32.388394 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34666e5-f296-4a14-8373-2fbc48a42af2 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:32.388532 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34666e5-f296-4a14-8373-2fbc48a42af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:32.411139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-a34666e5-f296-4a14-8373-2fbc48a42af2 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:32.412514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a34666e5-f296-4a14-8373-2fbc48a42af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:32.421672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 16:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:32.572149 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddb406-3cfa-47f8-9e1f-23a0301265cc None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:32.588260 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddb406-3cfa-47f8-9e1f-23a0301265cc None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:32.594386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccd547-7aed-4b81-aca6-fc47e400b0ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:32.595023 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccd547-7aed-4b81-aca6-fc47e400b0ba service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:32.595296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccd547-7aed-4b81-aca6-fc47e400b0ba service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:32.595569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccd547-7aed-4b81-aca6-fc47e400b0ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:32.604587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccd547-7aed-4b81-aca6-fc47e400b0ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:32.606197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccd547-7aed-4b81-aca6-fc47e400b0ba service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:32.616237 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 758/1516] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:00:33.425798 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0436387-2a82-4f7c-861e-baa545ccd429 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:33.426406 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0436387-2a82-4f7c-861e-baa545ccd429 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:33.426406 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0436387-2a82-4f7c-861e-baa545ccd429 None None] PATH_INFO: `/v3` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:33.427691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 759/1517] 10.222.0.85 () {54 vars in 925 bytes} [Mon Aug 22 16:00:33 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:00:33.434881 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061df5e-5744-4a58-b789-2b3b50157ce2 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:33.435314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061df5e-5744-4a58-b789-2b3b50157ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:33.435412 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061df5e-5744-4a58-b789-2b3b50157ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:33.497955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5061df5e-5744-4a58-b789-2b3b50157ce2 None None] MFA Rules not processed for user `4be9a664d10d438382b9e359b26ba86e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:33.499218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5061df5e-5744-4a58-b789-2b3b50157ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:33.517459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:33.574796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 759/1518] 10.222.0.85 () {58 vars in 1015 bytes} [Mon Aug 22 16:00:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:37.563044 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9c1b8-6224-446f-8de3-f59219313fa0 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:37.563885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9c1b8-6224-446f-8de3-f59219313fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:37.563885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9c1b8-6224-446f-8de3-f59219313fa0 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:37.566280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 760/1519] 10.222.0.77 () {54 vars in 961 bytes} [Mon Aug 22 16:00:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 16:00:37.571590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9136c4d-f54f-417c-9efd-43d3a54a466e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:37.572113 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9136c4d-f54f-417c-9efd-43d3a54a466e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:37.572113 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9136c4d-f54f-417c-9efd-43d3a54a466e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:37.596575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e9136c4d-f54f-417c-9efd-43d3a54a466e None None] MFA Rules not processed for user `4be9a664d10d438382b9e359b26ba86e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:37.597807 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e9136c4d-f54f-417c-9efd-43d3a54a466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:37.607430 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 760/1520] 10.222.0.77 () {58 vars in 1058 bytes} [Mon Aug 22 16:00:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:37.615217 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9c1b8-6224-446f-8de3-f59219313fa0 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:37.630328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9c1b8-6224-446f-8de3-f59219313fa0 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:37.636583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e490448-b962-444b-a930-ff9232a8be15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be9a664d10d438382b9e359b26ba86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:37.637157 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e490448-b962-444b-a930-ff9232a8be15 service placement] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:37.637423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e490448-b962-444b-a930-ff9232a8be15 service placement] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:37.637688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e490448-b962-444b-a930-ff9232a8be15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:37.646851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e490448-b962-444b-a930-ff9232a8be15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:37.648449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e490448-b962-444b-a930-ff9232a8be15 service placement] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:37.659098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 761/1521] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:00:43.860860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828d8cb-92ce-4130-bb64-b98459922e8b None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:43.861509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828d8cb-92ce-4130-bb64-b98459922e8b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:43.861509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828d8cb-92ce-4130-bb64-b98459922e8b None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:43.862785 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 16:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:00:43.869041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e9a44-ef71-461f-af39-44ee1a7e47aa None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:43.869605 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e9a44-ef71-461f-af39-44ee1a7e47aa None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:43.869985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e9a44-ef71-461f-af39-44ee1a7e47aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:43.895402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c64e9a44-ef71-461f-af39-44ee1a7e47aa None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:43.896641 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c64e9a44-ef71-461f-af39-44ee1a7e47aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:43.906082 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 16:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:44.063579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828d8cb-92ce-4130-bb64-b98459922e8b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:44.079446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828d8cb-92ce-4130-bb64-b98459922e8b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:44.085849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722507e-95d7-4e3e-9c1e-ca477cc74986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:44.086451 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722507e-95d7-4e3e-9c1e-ca477cc74986 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:44.086758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722507e-95d7-4e3e-9c1e-ca477cc74986 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:44.087030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722507e-95d7-4e3e-9c1e-ca477cc74986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:44.095667 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722507e-95d7-4e3e-9c1e-ca477cc74986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:44.097271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722507e-95d7-4e3e-9c1e-ca477cc74986 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:44.109016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 762/1524] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:00:44.927843 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6ffeb-941b-4a7f-95d0-ab539afa0fbe None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:44.928454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6ffeb-941b-4a7f-95d0-ab539afa0fbe None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:44.928454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6ffeb-941b-4a7f-95d0-ab539afa0fbe None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:44.929713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 16:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:00:44.934965 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd03b8e-c6cd-45f8-9101-cf8c6964ba60 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:44.935400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd03b8e-c6cd-45f8-9101-cf8c6964ba60 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:44.935495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd03b8e-c6cd-45f8-9101-cf8c6964ba60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:44.955180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8bd03b8e-c6cd-45f8-9101-cf8c6964ba60 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:44.956373 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8bd03b8e-c6cd-45f8-9101-cf8c6964ba60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:44.970040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 16:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:45.125013 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6ffeb-941b-4a7f-95d0-ab539afa0fbe None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:45.140397 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6ffeb-941b-4a7f-95d0-ab539afa0fbe None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:45.145935 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e09b3-b532-4cb4-9aad-2da7fc580b2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:45.146527 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e09b3-b532-4cb4-9aad-2da7fc580b2f service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:45.146826 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e09b3-b532-4cb4-9aad-2da7fc580b2f service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:45.147092 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e09b3-b532-4cb4-9aad-2da7fc580b2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:45.155938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e09b3-b532-4cb4-9aad-2da7fc580b2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:45.157517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e09b3-b532-4cb4-9aad-2da7fc580b2f service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:45.166948 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 764/1527] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:00:49.044679 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99afbf9-a791-40f8-9497-67911444317e None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:49.044679 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99afbf9-a791-40f8-9497-67911444317e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:49.045420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99afbf9-a791-40f8-9497-67911444317e None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:49.046105 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 16:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:00:49.052272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b883dd-a613-4206-b8cb-9b7ec0891d4e None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:49.052858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b883dd-a613-4206-b8cb-9b7ec0891d4e None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:49.052858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b883dd-a613-4206-b8cb-9b7ec0891d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:49.074001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-95b883dd-a613-4206-b8cb-9b7ec0891d4e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:49.075449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-95b883dd-a613-4206-b8cb-9b7ec0891d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:49.084571 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 16:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:49.386889 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99afbf9-a791-40f8-9497-67911444317e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:49.388908 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f99afbf9-a791-40f8-9497-67911444317e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:49.485885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99afbf9-a791-40f8-9497-67911444317e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:49.491537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb691d76-b124-45f0-86a5-1bd306d246f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:49.492517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb691d76-b124-45f0-86a5-1bd306d246f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:49.492795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb691d76-b124-45f0-86a5-1bd306d246f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:49.493058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb691d76-b124-45f0-86a5-1bd306d246f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:49.503825 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb691d76-b124-45f0-86a5-1bd306d246f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:49.505289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb691d76-b124-45f0-86a5-1bd306d246f2 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:49.515381 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 765/1530] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:00:51.459634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26861fa-38b3-4e4a-af87-f52029514641 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:51.460279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26861fa-38b3-4e4a-af87-f52029514641 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:51.460279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26861fa-38b3-4e4a-af87-f52029514641 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:51.461553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 16:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:00:51.467692 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba7ab-3b4a-42bf-a3cb-1053e85280b9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:51.468535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba7ab-3b4a-42bf-a3cb-1053e85280b9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:51.468724 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba7ab-3b4a-42bf-a3cb-1053e85280b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:51.490429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a90ba7ab-3b4a-42bf-a3cb-1053e85280b9 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:51.491704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a90ba7ab-3b4a-42bf-a3cb-1053e85280b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:51.500370 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 16:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:51.794203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26861fa-38b3-4e4a-af87-f52029514641 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:51.807781 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26861fa-38b3-4e4a-af87-f52029514641 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:51.811741 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720ea07-2a57-46ed-a16c-4ae8fe5a1b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:51.812348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720ea07-2a57-46ed-a16c-4ae8fe5a1b74 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:51.812624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720ea07-2a57-46ed-a16c-4ae8fe5a1b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:51.812894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720ea07-2a57-46ed-a16c-4ae8fe5a1b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:51.822243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720ea07-2a57-46ed-a16c-4ae8fe5a1b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:51.823742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720ea07-2a57-46ed-a16c-4ae8fe5a1b74 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:51.833841 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 767/1533] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:00:55.280558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241199d5-8f9d-4e9d-9a68-9019282747ee None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:55.281158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241199d5-8f9d-4e9d-9a68-9019282747ee None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:55.281158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241199d5-8f9d-4e9d-9a68-9019282747ee None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:55.282689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 16:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:00:55.288947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05878758-f293-40c5-b83c-34990d86254b None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:55.289403 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05878758-f293-40c5-b83c-34990d86254b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:55.289503 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05878758-f293-40c5-b83c-34990d86254b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:55.311699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-05878758-f293-40c5-b83c-34990d86254b None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:55.312903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-05878758-f293-40c5-b83c-34990d86254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:55.322487 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 16:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:55.944226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241199d5-8f9d-4e9d-9a68-9019282747ee None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:55.946286 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-241199d5-8f9d-4e9d-9a68-9019282747ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:56.022663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:00:56.039414 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241199d5-8f9d-4e9d-9a68-9019282747ee None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:56.045634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61e1c6-f788-4a3a-9671-903bf91af4a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:56.046538 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61e1c6-f788-4a3a-9671-903bf91af4a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:56.046883 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61e1c6-f788-4a3a-9671-903bf91af4a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:56.047153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61e1c6-f788-4a3a-9671-903bf91af4a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:56.057645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61e1c6-f788-4a3a-9671-903bf91af4a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:56.059147 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61e1c6-f788-4a3a-9671-903bf91af4a2 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:56.070387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 768/1536] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:00:58.003117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bde720-9fe9-4301-a1f4-d6ea06f54d3a None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:58.003662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bde720-9fe9-4301-a1f4-d6ea06f54d3a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:58.003662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bde720-9fe9-4301-a1f4-d6ea06f54d3a None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:58.005038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 16:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:00:58.011426 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd04563-f73f-47a5-9af2-c118a4bee6e7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:58.011875 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd04563-f73f-47a5-9af2-c118a4bee6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:58.011997 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd04563-f73f-47a5-9af2-c118a4bee6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:58.037844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8bd04563-f73f-47a5-9af2-c118a4bee6e7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:00:58.039128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8bd04563-f73f-47a5-9af2-c118a4bee6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:58.048172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 16:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:00:58.604219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bde720-9fe9-4301-a1f4-d6ea06f54d3a None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:00:58.607031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a0bde720-9fe9-4301-a1f4-d6ea06f54d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:00:58.627378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bde720-9fe9-4301-a1f4-d6ea06f54d3a None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:00:58.632182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08ad53-7fe7-4297-ab82-1310225f4b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:00:58.632783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08ad53-7fe7-4297-ab82-1310225f4b5a service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:00:58.633055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08ad53-7fe7-4297-ab82-1310225f4b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:00:58.633323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08ad53-7fe7-4297-ab82-1310225f4b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:00:58.644606 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08ad53-7fe7-4297-ab82-1310225f4b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:00:58.646070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08ad53-7fe7-4297-ab82-1310225f4b5a service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:00:58.656662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 770/1539] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:01:08.032140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=11 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:01:08.652072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:29.489233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e3117-d854-400c-b488-411bc7d18716 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:29.490566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e3117-d854-400c-b488-411bc7d18716 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:29.491111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e3117-d854-400c-b488-411bc7d18716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:29.517493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-972e3117-d854-400c-b488-411bc7d18716 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:29.518911 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-972e3117-d854-400c-b488-411bc7d18716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:29.530455 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 770/1540] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:29.540821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e6ca8-3c60-42c6-8885-9e16638e6c04 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:29.541963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e6ca8-3c60-42c6-8885-9e16638e6c04 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:29.542529 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e6ca8-3c60-42c6-8885-9e16638e6c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:29.559008 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97c619-d59e-45af-b9cf-b9dd81eaece2 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:29.559369 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97c619-d59e-45af-b9cf-b9dd81eaece2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:29.559568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97c619-d59e-45af-b9cf-b9dd81eaece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:29.571647 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-f09e6ca8-3c60-42c6-8885-9e16638e6c04 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:29.572968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f09e6ca8-3c60-42c6-8885-9e16638e6c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:29.589781 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 771/1541] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:29.599557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e6ca8-3c60-42c6-8885-9e16638e6c04 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:29.600023 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-eb97c619-d59e-45af-b9cf-b9dd81eaece2 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:29.601196 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-eb97c619-d59e-45af-b9cf-b9dd81eaece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:29.609993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e6ca8-3c60-42c6-8885-9e16638e6c04 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:29.622926 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 771/1542] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:29.623164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63412632-48ee-45e2-a073-837ff92b4fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:29.623595 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63412632-48ee-45e2-a073-837ff92b4fce admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:29.623872 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63412632-48ee-45e2-a073-837ff92b4fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:29.624135 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63412632-48ee-45e2-a073-837ff92b4fce admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:29.624930 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63412632-48ee-45e2-a073-837ff92b4fce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:02:29.625241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63412632-48ee-45e2-a073-837ff92b4fce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:29.626259 dv-cinder-854004-1-smb devstack@keystone.service[81660]: WARNING py.warnings [None req-63412632-48ee-45e2-a073-837ff92b4fce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 16:02:29.626259 dv-cinder-854004-1-smb devstack@keystone.service[81660]: warnings.warn(msg) Aug 22 16:02:29.626259 dv-cinder-854004-1-smb devstack@keystone.service[81660]: Aug 22 16:02:29.627181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63412632-48ee-45e2-a073-837ff92b4fce admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:29.638895 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bfbf3-e478-446a-9d4a-7a5603bffca4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:29.639226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bfbf3-e478-446a-9d4a-7a5603bffca4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:29.639450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bfbf3-e478-446a-9d4a-7a5603bffca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:29.652438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 772/1543] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:02:29.663109 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc13c6-f18d-475e-8258-62986340ab76 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:29.663459 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc13c6-f18d-475e-8258-62986340ab76 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:29.663636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc13c6-f18d-475e-8258-62986340ab76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:29.707714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-fc7bfbf3-e478-446a-9d4a-7a5603bffca4 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:29.708983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fc7bfbf3-e478-446a-9d4a-7a5603bffca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:29.719140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-53fc13c6-f18d-475e-8258-62986340ab76 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:29.720410 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-53fc13c6-f18d-475e-8258-62986340ab76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:29.729468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 772/1544] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:02:29.730445 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bfbf3-e478-446a-9d4a-7a5603bffca4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:29.754109 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 773/1545] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:02:29.755282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bf8e8-122b-4777-826c-4b5fba75301c None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:29.755568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bf8e8-122b-4777-826c-4b5fba75301c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:29.755842 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bf8e8-122b-4777-826c-4b5fba75301c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:29.761074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bfbf3-e478-446a-9d4a-7a5603bffca4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:29.774242 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f15a7-7201-41c5-9d35-647272107d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:29.774968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f15a7-7201-41c5-9d35-647272107d44 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:29.775249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f15a7-7201-41c5-9d35-647272107d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:29.775524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f15a7-7201-41c5-9d35-647272107d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:29.776168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f15a7-7201-41c5-9d35-647272107d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:29.777263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-ac2f15a7-7201-41c5-9d35-647272107d44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 16:02:29.777263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 22 16:02:29.777263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: Aug 22 16:02:29.778486 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f15a7-7201-41c5-9d35-647272107d44 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:29.803644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-283bf8e8-122b-4777-826c-4b5fba75301c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:29.804878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-283bf8e8-122b-4777-826c-4b5fba75301c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:29.829457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 774/1546] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:29.830676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35dc09-f5b2-4b4c-8071-b0740abd3674 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:29.830967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35dc09-f5b2-4b4c-8071-b0740abd3674 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:29.831239 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35dc09-f5b2-4b4c-8071-b0740abd3674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:29.869457 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 773/1547] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:29 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:29.871077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f15a7-7201-41c5-9d35-647272107d44 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:29.876758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-7f35dc09-f5b2-4b4c-8071-b0740abd3674 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:29.877902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7f35dc09-f5b2-4b4c-8071-b0740abd3674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:29.946517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f15a7-7201-41c5-9d35-647272107d44 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:29.951853 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7f9bc-1db8-402a-9cb0-55a04e39f6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:29.952467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f9bc-1db8-402a-9cb0-55a04e39f6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:29.956355 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f9bc-1db8-402a-9cb0-55a04e39f6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:29.956533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 775/1548] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:29.956641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f9bc-1db8-402a-9cb0-55a04e39f6b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:29.956641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7f9bc-1db8-402a-9cb0-55a04e39f6b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:02:29.956641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7f9bc-1db8-402a-9cb0-55a04e39f6b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:29.956927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758ca22-15d7-409c-93cd-938747e19ac3 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:29.956927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758ca22-15d7-409c-93cd-938747e19ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:29.956927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758ca22-15d7-409c-93cd-938747e19ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:29.957168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7f9bc-1db8-402a-9cb0-55a04e39f6b5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:29.969488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 774/1549] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:02:29.970792 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413aee-05e5-4030-a4fa-669df6f27a2b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:29.971082 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413aee-05e5-4030-a4fa-669df6f27a2b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:29.971358 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10413aee-05e5-4030-a4fa-669df6f27a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:29.983034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-7758ca22-15d7-409c-93cd-938747e19ac3 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:29.984381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7758ca22-15d7-409c-93cd-938747e19ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:29.992566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-10413aee-05e5-4030-a4fa-669df6f27a2b None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:30.000482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 776/1550] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:30.000669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-10413aee-05e5-4030-a4fa-669df6f27a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:30.000789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccf9b2-2539-4c28-9c2b-2962d074ba78 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.000789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccf9b2-2539-4c28-9c2b-2962d074ba78 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.000789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebccf9b2-2539-4c28-9c2b-2962d074ba78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.008760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 775/1551] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:30.013453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413aee-05e5-4030-a4fa-669df6f27a2b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.019185 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-ebccf9b2-2539-4c28-9c2b-2962d074ba78 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:30.020436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ebccf9b2-2539-4c28-9c2b-2962d074ba78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:30.025145 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10413aee-05e5-4030-a4fa-669df6f27a2b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.030699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 777/1552] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:30.030992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e9312-6c20-496c-9e12-873a90332121 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.031171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e9312-6c20-496c-9e12-873a90332121 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.031343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e9312-6c20-496c-9e12-873a90332121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.031977 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632630b-15aa-455d-b41f-9e6f4de5827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.032614 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632630b-15aa-455d-b41f-9e6f4de5827f admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.032896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632630b-15aa-455d-b41f-9e6f4de5827f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.033171 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632630b-15aa-455d-b41f-9e6f4de5827f admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.033803 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632630b-15aa-455d-b41f-9e6f4de5827f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.035767 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632630b-15aa-455d-b41f-9e6f4de5827f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.051086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-850e9312-6c20-496c-9e12-873a90332121 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:30.052312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-850e9312-6c20-496c-9e12-873a90332121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:30.059272 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 776/1553] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/users => generated 284 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:30.060099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632630b-15aa-455d-b41f-9e6f4de5827f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.060491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 778/1554] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:30.061122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e9312-6c20-496c-9e12-873a90332121 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.071595 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e9312-6c20-496c-9e12-873a90332121 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.077049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda336e-a438-4028-ac2a-bb42443d8459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.077254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632630b-15aa-455d-b41f-9e6f4de5827f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.077990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda336e-a438-4028-ac2a-bb42443d8459 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.078324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda336e-a438-4028-ac2a-bb42443d8459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.078691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda336e-a438-4028-ac2a-bb42443d8459 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.079242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda336e-a438-4028-ac2a-bb42443d8459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.081314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda336e-a438-4028-ac2a-bb42443d8459 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.082285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384a2ae-0a82-4505-bb92-aeced59c7d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.082925 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384a2ae-0a82-4505-bb92-aeced59c7d85 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.083206 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384a2ae-0a82-4505-bb92-aeced59c7d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.083476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384a2ae-0a82-4505-bb92-aeced59c7d85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.084124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384a2ae-0a82-4505-bb92-aeced59c7d85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:02:30.084425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384a2ae-0a82-4505-bb92-aeced59c7d85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.086053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384a2ae-0a82-4505-bb92-aeced59c7d85 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.100006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 777/1555] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:02:30.101408 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2723e9b-8ed2-476b-894e-36ce8e50c95b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.101725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2723e9b-8ed2-476b-894e-36ce8e50c95b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.102042 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2723e9b-8ed2-476b-894e-36ce8e50c95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.112250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 779/1556] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:30.113125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda336e-a438-4028-ac2a-bb42443d8459 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.129629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b2723e9b-8ed2-476b-894e-36ce8e50c95b None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:30.130793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b2723e9b-8ed2-476b-894e-36ce8e50c95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:30.178011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda336e-a438-4028-ac2a-bb42443d8459 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.182639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d0d7a-92ce-4d91-b1c7-ded21c58e57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.183313 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d0d7a-92ce-4d91-b1c7-ded21c58e57f admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.183592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d0d7a-92ce-4d91-b1c7-ded21c58e57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.183863 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d0d7a-92ce-4d91-b1c7-ded21c58e57f admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.184514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d0d7a-92ce-4d91-b1c7-ded21c58e57f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:02:30.184813 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d0d7a-92ce-4d91-b1c7-ded21c58e57f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.186427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d0d7a-92ce-4d91-b1c7-ded21c58e57f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.192302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 778/1557] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:30.193605 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f1798-9e7f-4f9c-937d-6dcff174e0ec None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.193889 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f1798-9e7f-4f9c-937d-6dcff174e0ec None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.194162 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f1798-9e7f-4f9c-937d-6dcff174e0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.198510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 780/1558] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:02:30.199830 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7253e-3392-40f6-a73b-8a5361b38011 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.200178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7253e-3392-40f6-a73b-8a5361b38011 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.200428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7253e-3392-40f6-a73b-8a5361b38011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.212186 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:30.219386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-dc5f1798-9e7f-4f9c-937d-6dcff174e0ec None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:30.220393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-7fc7253e-3392-40f6-a73b-8a5361b38011 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:30.220759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-dc5f1798-9e7f-4f9c-937d-6dcff174e0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:30.221582 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7fc7253e-3392-40f6-a73b-8a5361b38011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:30.228728 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 779/1559] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:30.233095 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 781/1560] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:30.233262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f1798-9e7f-4f9c-937d-6dcff174e0ec None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.233375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e149-5023-468c-9c0c-01e7759c7406 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.233375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e149-5023-468c-9c0c-01e7759c7406 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.233375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e149-5023-468c-9c0c-01e7759c7406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.240775 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f1798-9e7f-4f9c-937d-6dcff174e0ec None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.245477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a1927-ac6a-473d-a70f-5e95e1a66ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.246079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a1927-ac6a-473d-a70f-5e95e1a66ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.246356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a1927-ac6a-473d-a70f-5e95e1a66ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.246653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a1927-ac6a-473d-a70f-5e95e1a66ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.247306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a1927-ac6a-473d-a70f-5e95e1a66ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.248945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a1927-ac6a-473d-a70f-5e95e1a66ff1 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.253362 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-fa43e149-5023-468c-9c0c-01e7759c7406 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:30.254574 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-fa43e149-5023-468c-9c0c-01e7759c7406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:30.259342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 780/1561] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:30.260040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a1927-ac6a-473d-a70f-5e95e1a66ff1 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.264017 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 782/1562] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:30.264942 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43e149-5023-468c-9c0c-01e7759c7406 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.269939 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a1927-ac6a-473d-a70f-5e95e1a66ff1 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.274875 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43e149-5023-468c-9c0c-01e7759c7406 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.275641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6e2a1-40e1-4b66-8267-48f8dfd2ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.276334 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e2a1-40e1-4b66-8267-48f8dfd2ff37 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.276792 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e2a1-40e1-4b66-8267-48f8dfd2ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.277130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e2a1-40e1-4b66-8267-48f8dfd2ff37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.277768 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6e2a1-40e1-4b66-8267-48f8dfd2ff37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.279772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217ac9c-5aed-40e1-ab1a-e5bda78a54b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.279923 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6e2a1-40e1-4b66-8267-48f8dfd2ff37 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.280580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ac9c-5aed-40e1-ab1a-e5bda78a54b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.280860 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ac9c-5aed-40e1-ab1a-e5bda78a54b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.281122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217ac9c-5aed-40e1-ab1a-e5bda78a54b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.281741 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217ac9c-5aed-40e1-ab1a-e5bda78a54b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.282783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: WARNING py.warnings [None req-8217ac9c-5aed-40e1-ab1a-e5bda78a54b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 16:02:30.282783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: warnings.warn(msg) Aug 22 16:02:30.282783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: Aug 22 16:02:30.283985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217ac9c-5aed-40e1-ab1a-e5bda78a54b4 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.292402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:30.308750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 783/1563] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:30.309785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217ac9c-5aed-40e1-ab1a-e5bda78a54b4 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.313418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 781/1564] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:30.314297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6e2a1-40e1-4b66-8267-48f8dfd2ff37 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.319617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217ac9c-5aed-40e1-ab1a-e5bda78a54b4 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.376462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cb533-fe2e-49be-ac36-eebf5e0c1512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.377077 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb533-fe2e-49be-ac36-eebf5e0c1512 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.377752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb533-fe2e-49be-ac36-eebf5e0c1512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.378027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cb533-fe2e-49be-ac36-eebf5e0c1512 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.378201 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6e2a1-40e1-4b66-8267-48f8dfd2ff37 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.378708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cb533-fe2e-49be-ac36-eebf5e0c1512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:02:30.379013 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cb533-fe2e-49be-ac36-eebf5e0c1512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.380697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467cb533-fe2e-49be-ac36-eebf5e0c1512 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.383163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3096f5-7bb2-4ebd-9a3f-4598406d56a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.383801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3096f5-7bb2-4ebd-9a3f-4598406d56a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.384084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3096f5-7bb2-4ebd-9a3f-4598406d56a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.384352 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3096f5-7bb2-4ebd-9a3f-4598406d56a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.384988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3096f5-7bb2-4ebd-9a3f-4598406d56a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.387020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3096f5-7bb2-4ebd-9a3f-4598406d56a6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.392845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 784/1565] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:02:30.393870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cb533-fe2e-49be-ac36-eebf5e0c1512 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.403606 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467cb533-fe2e-49be-ac36-eebf5e0c1512 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.408133 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96039c1-a2b1-47e0-95b5-0475a6743ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.408841 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96039c1-a2b1-47e0-95b5-0475a6743ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.409139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96039c1-a2b1-47e0-95b5-0475a6743ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.409403 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96039c1-a2b1-47e0-95b5-0475a6743ec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.410052 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96039c1-a2b1-47e0-95b5-0475a6743ec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:02:30.410343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96039c1-a2b1-47e0-95b5-0475a6743ec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.411996 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96039c1-a2b1-47e0-95b5-0475a6743ec8 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.422324 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 782/1566] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:30.425332 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad42e3-2a54-4bcf-9a8e-9d9f8b201910 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.425794 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad42e3-2a54-4bcf-9a8e-9d9f8b201910 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.426209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad42e3-2a54-4bcf-9a8e-9d9f8b201910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.434389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 785/1567] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:02:30.435489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96039c1-a2b1-47e0-95b5-0475a6743ec8 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.446805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96039c1-a2b1-47e0-95b5-0475a6743ec8 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.453454 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-bfad42e3-2a54-4bcf-9a8e-9d9f8b201910 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:30.454766 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bfad42e3-2a54-4bcf-9a8e-9d9f8b201910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:30.507550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae49baf-fa8d-44a1-b1ac-81f1b4fbb50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.508171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae49baf-fa8d-44a1-b1ac-81f1b4fbb50b admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.508454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae49baf-fa8d-44a1-b1ac-81f1b4fbb50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.508736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae49baf-fa8d-44a1-b1ac-81f1b4fbb50b admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.509382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae49baf-fa8d-44a1-b1ac-81f1b4fbb50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.511160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae49baf-fa8d-44a1-b1ac-81f1b4fbb50b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.519456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 783/1568] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:30.520348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad42e3-2a54-4bcf-9a8e-9d9f8b201910 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.524879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 786/1569] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:30.524879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae49baf-fa8d-44a1-b1ac-81f1b4fbb50b admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.530140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad42e3-2a54-4bcf-9a8e-9d9f8b201910 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.534291 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae49baf-fa8d-44a1-b1ac-81f1b4fbb50b admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.535086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963905e-cbda-46a4-b324-ba1286e97994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.535707 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963905e-cbda-46a4-b324-ba1286e97994 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.535984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963905e-cbda-46a4-b324-ba1286e97994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.536254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963905e-cbda-46a4-b324-ba1286e97994 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.536931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963905e-cbda-46a4-b324-ba1286e97994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:02:30.537236 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963905e-cbda-46a4-b324-ba1286e97994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.538850 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963905e-cbda-46a4-b324-ba1286e97994 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.539166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8530f7-95d5-4417-96dd-71eb725735c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.539778 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8530f7-95d5-4417-96dd-71eb725735c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.540058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8530f7-95d5-4417-96dd-71eb725735c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.540342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8530f7-95d5-4417-96dd-71eb725735c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.540988 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8530f7-95d5-4417-96dd-71eb725735c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.542694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8530f7-95d5-4417-96dd-71eb725735c5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.551625 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 784/1570] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:02:30.552485 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963905e-cbda-46a4-b324-ba1286e97994 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.553463 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 787/1571] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:30.555472 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8530f7-95d5-4417-96dd-71eb725735c5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.564344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963905e-cbda-46a4-b324-ba1286e97994 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.566518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8530f7-95d5-4417-96dd-71eb725735c5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.569318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2348b-91ee-4716-8341-e933a8e3c109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.569935 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2348b-91ee-4716-8341-e933a8e3c109 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.570208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2348b-91ee-4716-8341-e933a8e3c109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.570476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2348b-91ee-4716-8341-e933a8e3c109 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.571146 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2348b-91ee-4716-8341-e933a8e3c109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.571322 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d3649-f5f2-4eda-833d-ca4fd551a2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.571924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d3649-f5f2-4eda-833d-ca4fd551a2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.572198 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d3649-f5f2-4eda-833d-ca4fd551a2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.572597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d3649-f5f2-4eda-833d-ca4fd551a2d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.573066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2348b-91ee-4716-8341-e933a8e3c109 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.573222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d3649-f5f2-4eda-833d-ca4fd551a2d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.575254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d3649-f5f2-4eda-833d-ca4fd551a2d2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.595752 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 785/1572] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/users => generated 295 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:30.596577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2348b-91ee-4716-8341-e933a8e3c109 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.606550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2348b-91ee-4716-8341-e933a8e3c109 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.607637 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 788/1573] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:30.611299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d3649-f5f2-4eda-833d-ca4fd551a2d2 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.628659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:30.645793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:30.669544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaacc62-ba05-45b2-8a75-f6825ca355b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.670150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaacc62-ba05-45b2-8a75-f6825ca355b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.670423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaacc62-ba05-45b2-8a75-f6825ca355b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.670708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaacc62-ba05-45b2-8a75-f6825ca355b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.671336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaacc62-ba05-45b2-8a75-f6825ca355b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.673287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaacc62-ba05-45b2-8a75-f6825ca355b9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.674879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d3649-f5f2-4eda-833d-ca4fd551a2d2 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.679481 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9f305-b08f-408b-bda2-162add216441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.680093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9f305-b08f-408b-bda2-162add216441 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.680370 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9f305-b08f-408b-bda2-162add216441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.680757 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9f305-b08f-408b-bda2-162add216441 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.681242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9f305-b08f-408b-bda2-162add216441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.683266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9f305-b08f-408b-bda2-162add216441 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.695717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 786/1574] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:30.696544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaacc62-ba05-45b2-8a75-f6825ca355b9 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.707302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaacc62-ba05-45b2-8a75-f6825ca355b9 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.711925 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724cb5d-a926-43fa-9b3e-cdffc1c3ee59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.712525 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724cb5d-a926-43fa-9b3e-cdffc1c3ee59 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.712799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724cb5d-a926-43fa-9b3e-cdffc1c3ee59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.713062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724cb5d-a926-43fa-9b3e-cdffc1c3ee59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.713709 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724cb5d-a926-43fa-9b3e-cdffc1c3ee59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:02:30.714037 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724cb5d-a926-43fa-9b3e-cdffc1c3ee59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.714702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 789/1575] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:30.715704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724cb5d-a926-43fa-9b3e-cdffc1c3ee59 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.715875 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9f305-b08f-408b-bda2-162add216441 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.728025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 787/1576] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:02:30.728858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724cb5d-a926-43fa-9b3e-cdffc1c3ee59 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.738943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724cb5d-a926-43fa-9b3e-cdffc1c3ee59 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.784755 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9f305-b08f-408b-bda2-162add216441 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.790334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ae8bb-5c39-4a1f-a1da-4d149aaa1cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.791045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae8bb-5c39-4a1f-a1da-4d149aaa1cce admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.791319 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae8bb-5c39-4a1f-a1da-4d149aaa1cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.791588 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ae8bb-5c39-4a1f-a1da-4d149aaa1cce admin admin] PATH_INFO: `/v3/projects/c27cf0657bbd4d4eaf7090c7584a8a89/users/0ccb2a8c3713451387a49b6aee526f35/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.799787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98205049-3a84-46c2-8a1d-cf9dc917dba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.800361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205049-3a84-46c2-8a1d-cf9dc917dba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.801150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205049-3a84-46c2-8a1d-cf9dc917dba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.801457 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205049-3a84-46c2-8a1d-cf9dc917dba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.802213 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98205049-3a84-46c2-8a1d-cf9dc917dba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.803874 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98205049-3a84-46c2-8a1d-cf9dc917dba1 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.807727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ae8bb-5c39-4a1f-a1da-4d149aaa1cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c27cf0657bbd4d4eaf7090c7584a8a89, user_id=0ccb2a8c3713451387a49b6aee526f35, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.810627 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ae8bb-5c39-4a1f-a1da-4d149aaa1cce admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.814452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 788/1577] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:30.815388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98205049-3a84-46c2-8a1d-cf9dc917dba1 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.827454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 790/1578] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:30 2022] PUT /identity/v3/projects/c27cf0657bbd4d4eaf7090c7584a8a89/users/0ccb2a8c3713451387a49b6aee526f35/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:30.827783 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98205049-3a84-46c2-8a1d-cf9dc917dba1 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.839463 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ae8bb-5c39-4a1f-a1da-4d149aaa1cce admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.886117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574eb8ec-ea0d-4fb2-94a0-3a040e507fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.886791 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574eb8ec-ea0d-4fb2-94a0-3a040e507fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.887047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574eb8ec-ea0d-4fb2-94a0-3a040e507fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.887341 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574eb8ec-ea0d-4fb2-94a0-3a040e507fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.887974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574eb8ec-ea0d-4fb2-94a0-3a040e507fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.889945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574eb8ec-ea0d-4fb2-94a0-3a040e507fd9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.900902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ae8bb-5c39-4a1f-a1da-4d149aaa1cce admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.906451 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605e2c8-6433-42b0-a96c-812e98938c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.907114 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605e2c8-6433-42b0-a96c-812e98938c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.907401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605e2c8-6433-42b0-a96c-812e98938c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.907693 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605e2c8-6433-42b0-a96c-812e98938c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.908535 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605e2c8-6433-42b0-a96c-812e98938c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.910475 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605e2c8-6433-42b0-a96c-812e98938c71 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.918578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 789/1579] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:30.919428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574eb8ec-ea0d-4fb2-94a0-3a040e507fd9 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.921031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 791/1580] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:30.921856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605e2c8-6433-42b0-a96c-812e98938c71 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:30.931631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605e2c8-6433-42b0-a96c-812e98938c71 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.941052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:30.965082 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:30.984246 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574eb8ec-ea0d-4fb2-94a0-3a040e507fd9 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:30.989394 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739a356-34ef-42de-84e4-1a8cfd120310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.989599 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80411c87-ca0c-41ac-83cc-d3ba27358f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:30.990009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739a356-34ef-42de-84e4-1a8cfd120310 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.990217 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80411c87-ca0c-41ac-83cc-d3ba27358f95 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:30.990315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739a356-34ef-42de-84e4-1a8cfd120310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.990497 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80411c87-ca0c-41ac-83cc-d3ba27358f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:30.990640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739a356-34ef-42de-84e4-1a8cfd120310 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.990830 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80411c87-ca0c-41ac-83cc-d3ba27358f95 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:30.991238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739a356-34ef-42de-84e4-1a8cfd120310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.991464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80411c87-ca0c-41ac-83cc-d3ba27358f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:30.992856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739a356-34ef-42de-84e4-1a8cfd120310 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:30.993418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80411c87-ca0c-41ac-83cc-d3ba27358f95 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.002906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 792/1581] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:31.006187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739a356-34ef-42de-84e4-1a8cfd120310 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.014713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739a356-34ef-42de-84e4-1a8cfd120310 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.018373 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 790/1582] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:30 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:31.019226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80411c87-ca0c-41ac-83cc-d3ba27358f95 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.022768 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4b648-cf4f-442a-8ccb-d47e120dbc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.023386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4b648-cf4f-442a-8ccb-d47e120dbc67 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.023694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4b648-cf4f-442a-8ccb-d47e120dbc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.024066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4b648-cf4f-442a-8ccb-d47e120dbc67 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.024570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4b648-cf4f-442a-8ccb-d47e120dbc67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.026577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4b648-cf4f-442a-8ccb-d47e120dbc67 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.029336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80411c87-ca0c-41ac-83cc-d3ba27358f95 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.034166 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b371be3-34d1-4fc1-8096-06045a7402d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.034935 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b371be3-34d1-4fc1-8096-06045a7402d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.035213 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b371be3-34d1-4fc1-8096-06045a7402d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.035850 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b371be3-34d1-4fc1-8096-06045a7402d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.036204 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b371be3-34d1-4fc1-8096-06045a7402d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.038169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b371be3-34d1-4fc1-8096-06045a7402d5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.053560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 793/1583] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:31 2022] POST /identity/v3/users => generated 297 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:31.054517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4b648-cf4f-442a-8ccb-d47e120dbc67 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.064913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4b648-cf4f-442a-8ccb-d47e120dbc67 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.068967 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 791/1584] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:31 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:31.070260 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d09292-9c8a-49fd-bd3e-ae00fee93dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.070400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc2de1-44c4-459e-b8bc-27b0e9f110fa None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.070746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc2de1-44c4-459e-b8bc-27b0e9f110fa None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.071055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc2de1-44c4-459e-b8bc-27b0e9f110fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.071578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d09292-9c8a-49fd-bd3e-ae00fee93dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.072086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d09292-9c8a-49fd-bd3e-ae00fee93dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.072514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d09292-9c8a-49fd-bd3e-ae00fee93dd3 admin admin] PATH_INFO: `/v3/projects/b8985aa9c72943dfa234318c7c3c86a2/users/4d3445e9462b42cd82ea10ed54193c89/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.088813 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d09292-9c8a-49fd-bd3e-ae00fee93dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8985aa9c72943dfa234318c7c3c86a2, user_id=4d3445e9462b42cd82ea10ed54193c89, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.091630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d09292-9c8a-49fd-bd3e-ae00fee93dd3 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.101500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b2bc2de1-44c4-459e-b8bc-27b0e9f110fa None None] MFA Rules not processed for user `0ccb2a8c3713451387a49b6aee526f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:31.103703 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b2bc2de1-44c4-459e-b8bc-27b0e9f110fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:31.108375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 794/1585] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:31 2022] PUT /identity/v3/projects/b8985aa9c72943dfa234318c7c3c86a2/users/4d3445e9462b42cd82ea10ed54193c89/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:31.109428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d09292-9c8a-49fd-bd3e-ae00fee93dd3 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.170400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d09292-9c8a-49fd-bd3e-ae00fee93dd3 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.175287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a374732-9fbd-4fbc-83da-a4f581663b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.175901 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a374732-9fbd-4fbc-83da-a4f581663b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.176181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a374732-9fbd-4fbc-83da-a4f581663b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.176452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a374732-9fbd-4fbc-83da-a4f581663b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.177101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a374732-9fbd-4fbc-83da-a4f581663b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.178753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a374732-9fbd-4fbc-83da-a4f581663b25 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.180000 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 792/1586] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:31.181189 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc2de1-44c4-459e-b8bc-27b0e9f110fa None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.189426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 795/1587] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:31.190247 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a374732-9fbd-4fbc-83da-a4f581663b25 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.193160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc2de1-44c4-459e-b8bc-27b0e9f110fa None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.198718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09004b3-a7d2-4d29-9fd7-73c4c9cd54cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.199433 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09004b3-a7d2-4d29-9fd7-73c4c9cd54cb admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.199782 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09004b3-a7d2-4d29-9fd7-73c4c9cd54cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.199981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a374732-9fbd-4fbc-83da-a4f581663b25 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.200194 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09004b3-a7d2-4d29-9fd7-73c4c9cd54cb admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.201253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09004b3-a7d2-4d29-9fd7-73c4c9cd54cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.203220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09004b3-a7d2-4d29-9fd7-73c4c9cd54cb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.204922 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65442d-eb4f-480a-a6f8-417c8a218c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.205558 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65442d-eb4f-480a-a6f8-417c8a218c25 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.205783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65442d-eb4f-480a-a6f8-417c8a218c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.206055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65442d-eb4f-480a-a6f8-417c8a218c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.206723 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65442d-eb4f-480a-a6f8-417c8a218c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.208328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65442d-eb4f-480a-a6f8-417c8a218c25 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.219666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 796/1588] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:31.220526 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65442d-eb4f-480a-a6f8-417c8a218c25 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.228634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 793/1589] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:31 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:31.229781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09004b3-a7d2-4d29-9fd7-73c4c9cd54cb admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.232438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65442d-eb4f-480a-a6f8-417c8a218c25 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.237575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a149ad-0b3e-41e8-8ced-19c2faa1f91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.238296 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a149ad-0b3e-41e8-8ced-19c2faa1f91a admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.238704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a149ad-0b3e-41e8-8ced-19c2faa1f91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.239074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a149ad-0b3e-41e8-8ced-19c2faa1f91a admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.239854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a149ad-0b3e-41e8-8ced-19c2faa1f91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.239964 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09004b3-a7d2-4d29-9fd7-73c4c9cd54cb admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.241644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a149ad-0b3e-41e8-8ced-19c2faa1f91a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.245240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240860ac-187c-4425-8b92-814f38161b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.245810 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240860ac-187c-4425-8b92-814f38161b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.246081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240860ac-187c-4425-8b92-814f38161b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.246345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240860ac-187c-4425-8b92-814f38161b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.247016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240860ac-187c-4425-8b92-814f38161b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.248606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240860ac-187c-4425-8b92-814f38161b75 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.253743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 797/1590] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:31.257813 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a149ad-0b3e-41e8-8ced-19c2faa1f91a admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.262434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 794/1591] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:31.262434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64ae5e-b6e4-4fe5-8821-70cc85d0c1e7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.262434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64ae5e-b6e4-4fe5-8821-70cc85d0c1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.262434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64ae5e-b6e4-4fe5-8821-70cc85d0c1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.267967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a149ad-0b3e-41e8-8ced-19c2faa1f91a admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.272819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23c21e-e137-40b4-80ee-4c2b3bb04105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.273430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23c21e-e137-40b4-80ee-4c2b3bb04105 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.273708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23c21e-e137-40b4-80ee-4c2b3bb04105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.273978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23c21e-e137-40b4-80ee-4c2b3bb04105 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.274631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23c21e-e137-40b4-80ee-4c2b3bb04105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.276595 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23c21e-e137-40b4-80ee-4c2b3bb04105 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.280093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6c64ae5e-b6e4-4fe5-8821-70cc85d0c1e7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:31.281299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6c64ae5e-b6e4-4fe5-8821-70cc85d0c1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:31.288793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 795/1592] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:31.289571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64ae5e-b6e4-4fe5-8821-70cc85d0c1e7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.300017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64ae5e-b6e4-4fe5-8821-70cc85d0c1e7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.304568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657cdda-7838-4598-85d9-dc7d1ab62399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.305175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657cdda-7838-4598-85d9-dc7d1ab62399 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.305455 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657cdda-7838-4598-85d9-dc7d1ab62399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.305725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657cdda-7838-4598-85d9-dc7d1ab62399 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.306342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657cdda-7838-4598-85d9-dc7d1ab62399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.310067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 798/1593] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:31 2022] POST /identity/v3/users => generated 285 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:31.310067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23c21e-e137-40b4-80ee-4c2b3bb04105 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.310321 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657cdda-7838-4598-85d9-dc7d1ab62399 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.320558 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23c21e-e137-40b4-80ee-4c2b3bb04105 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.326803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db960e5-c41a-41da-bf26-d4497d2db791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.327659 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db960e5-c41a-41da-bf26-d4497d2db791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.327899 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db960e5-c41a-41da-bf26-d4497d2db791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.328174 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db960e5-c41a-41da-bf26-d4497d2db791 admin admin] PATH_INFO: `/v3/projects/ab89d49f96c74b0990b05ff13d89c7ce/users/9c75b97977c2433fb27aa21e4f82ce2e/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.344827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 796/1594] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:31 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:31.344827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657cdda-7838-4598-85d9-dc7d1ab62399 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.347522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db960e5-c41a-41da-bf26-d4497d2db791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab89d49f96c74b0990b05ff13d89c7ce, user_id=9c75b97977c2433fb27aa21e4f82ce2e, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.350244 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db960e5-c41a-41da-bf26-d4497d2db791 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.365197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 799/1595] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:31 2022] PUT /identity/v3/projects/ab89d49f96c74b0990b05ff13d89c7ce/users/9c75b97977c2433fb27aa21e4f82ce2e/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:31.366115 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db960e5-c41a-41da-bf26-d4497d2db791 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.371489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:31.398571 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:31.420672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657cdda-7838-4598-85d9-dc7d1ab62399 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.443177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db960e5-c41a-41da-bf26-d4497d2db791 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.448064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcb7e1-b660-4107-9087-0ffd1bb1a40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.448736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcb7e1-b660-4107-9087-0ffd1bb1a40c admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.449012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcb7e1-b660-4107-9087-0ffd1bb1a40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.449335 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcb7e1-b660-4107-9087-0ffd1bb1a40c admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.450013 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcb7e1-b660-4107-9087-0ffd1bb1a40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.452012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcb7e1-b660-4107-9087-0ffd1bb1a40c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.462194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 800/1596] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:31.463256 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcb7e1-b660-4107-9087-0ffd1bb1a40c admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.474482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcb7e1-b660-4107-9087-0ffd1bb1a40c admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.479221 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baafdd-cdf7-49bb-8b74-8b6b5ea871ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.479865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baafdd-cdf7-49bb-8b74-8b6b5ea871ea admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.479999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20c11e-862f-48ec-9ff2-fa4797791391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.480149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baafdd-cdf7-49bb-8b74-8b6b5ea871ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.480402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baafdd-cdf7-49bb-8b74-8b6b5ea871ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.480669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20c11e-862f-48ec-9ff2-fa4797791391 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.481006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20c11e-862f-48ec-9ff2-fa4797791391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.481143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baafdd-cdf7-49bb-8b74-8b6b5ea871ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.481282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20c11e-862f-48ec-9ff2-fa4797791391 admin admin] PATH_INFO: `/v3/projects/aaa7c50a452d415d9086b4e26636bbe4/users/8d9a3c6d32dc495a8b9fdd85f8e54c13/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.482685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baafdd-cdf7-49bb-8b74-8b6b5ea871ea admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.494567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 801/1597] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:31.495514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baafdd-cdf7-49bb-8b74-8b6b5ea871ea admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.499894 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20c11e-862f-48ec-9ff2-fa4797791391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa7c50a452d415d9086b4e26636bbe4, user_id=8d9a3c6d32dc495a8b9fdd85f8e54c13, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.501857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-5b20c11e-862f-48ec-9ff2-fa4797791391 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 16:02:31.501857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 22 16:02:31.501857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: Aug 22 16:02:31.505016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20c11e-862f-48ec-9ff2-fa4797791391 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.506789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baafdd-cdf7-49bb-8b74-8b6b5ea871ea admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.512742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f658b4-9ada-49c1-9055-58cf7af41582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.513802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f658b4-9ada-49c1-9055-58cf7af41582 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.514141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f658b4-9ada-49c1-9055-58cf7af41582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.515128 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f658b4-9ada-49c1-9055-58cf7af41582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.515898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f658b4-9ada-49c1-9055-58cf7af41582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.517870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f658b4-9ada-49c1-9055-58cf7af41582 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.523153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 797/1598] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:31 2022] PUT /identity/v3/projects/aaa7c50a452d415d9086b4e26636bbe4/users/8d9a3c6d32dc495a8b9fdd85f8e54c13/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:31.524944 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20c11e-862f-48ec-9ff2-fa4797791391 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.530716 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 802/1599] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:31.531726 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f658b4-9ada-49c1-9055-58cf7af41582 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.542106 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f658b4-9ada-49c1-9055-58cf7af41582 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.581638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20c11e-862f-48ec-9ff2-fa4797791391 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.585278 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784c84d-e808-4914-8673-267205a2be48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.586002 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784c84d-e808-4914-8673-267205a2be48 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.586282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784c84d-e808-4914-8673-267205a2be48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.586556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784c84d-e808-4914-8673-267205a2be48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.604407 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2930bcc-5c4a-4c53-955d-df294ce6c4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.605041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2930bcc-5c4a-4c53-955d-df294ce6c4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.605315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2930bcc-5c4a-4c53-955d-df294ce6c4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.605575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2930bcc-5c4a-4c53-955d-df294ce6c4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.606225 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2930bcc-5c4a-4c53-955d-df294ce6c4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.607907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2930bcc-5c4a-4c53-955d-df294ce6c4a4 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.617546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 803/1600] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:31.618370 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2930bcc-5c4a-4c53-955d-df294ce6c4a4 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.628142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2930bcc-5c4a-4c53-955d-df294ce6c4a4 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.633592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee2130-4907-46c7-9d78-39793afdbcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.634327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee2130-4907-46c7-9d78-39793afdbcb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.634633 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee2130-4907-46c7-9d78-39793afdbcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.634906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee2130-4907-46c7-9d78-39793afdbcb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.635544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee2130-4907-46c7-9d78-39793afdbcb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.637586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee2130-4907-46c7-9d78-39793afdbcb0 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.651249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784c84d-e808-4914-8673-267205a2be48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.652987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784c84d-e808-4914-8673-267205a2be48 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.658163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:31.663876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 804/1601] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:31 2022] POST /identity/v3/users => generated 291 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:31.663876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092da2-ce41-4244-b639-14a19f9a98b4 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.663876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092da2-ce41-4244-b639-14a19f9a98b4 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.663876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2092da2-ce41-4244-b639-14a19f9a98b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.664822 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 798/1602] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:31.665225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784c84d-e808-4914-8673-267205a2be48 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.675888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784c84d-e808-4914-8673-267205a2be48 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.682002 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279dbec1-aea8-4ca9-b966-2acbdd542d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.682362 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-a2092da2-ce41-4244-b639-14a19f9a98b4 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:31.683169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dbec1-aea8-4ca9-b966-2acbdd542d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.683323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dbec1-aea8-4ca9-b966-2acbdd542d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.683590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dbec1-aea8-4ca9-b966-2acbdd542d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.683827 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a2092da2-ce41-4244-b639-14a19f9a98b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:31.684362 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279dbec1-aea8-4ca9-b966-2acbdd542d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.686126 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279dbec1-aea8-4ca9-b966-2acbdd542d91 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.692622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 805/1603] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:31.693236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2092da2-ce41-4244-b639-14a19f9a98b4 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.704137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 799/1604] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:31.704137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ef299-b836-4af4-9032-8b0bdf006e9e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.704137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ef299-b836-4af4-9032-8b0bdf006e9e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.704137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ef299-b836-4af4-9032-8b0bdf006e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.712711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2092da2-ce41-4244-b639-14a19f9a98b4 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.717584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b52dfe-332f-4dc4-a417-d764d18c9f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.718310 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b52dfe-332f-4dc4-a417-d764d18c9f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.718627 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b52dfe-332f-4dc4-a417-d764d18c9f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.718899 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b52dfe-332f-4dc4-a417-d764d18c9f22 admin admin] PATH_INFO: `/v3/projects/6175fe96bc0547449c330a8694d6877c/users/df6c7864c9304f0b9464fa20834d5481/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.723552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5a6ef299-b836-4af4-9032-8b0bdf006e9e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:31.724927 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5a6ef299-b836-4af4-9032-8b0bdf006e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:31.733331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 800/1605] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:31.734254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ef299-b836-4af4-9032-8b0bdf006e9e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.738351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b52dfe-332f-4dc4-a417-d764d18c9f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6175fe96bc0547449c330a8694d6877c, user_id=df6c7864c9304f0b9464fa20834d5481, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.741383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b52dfe-332f-4dc4-a417-d764d18c9f22 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.745863 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ef299-b836-4af4-9032-8b0bdf006e9e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.752946 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49588811-63a2-4fb3-88cd-694e81827961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.753725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588811-63a2-4fb3-88cd-694e81827961 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.754089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588811-63a2-4fb3-88cd-694e81827961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.754435 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588811-63a2-4fb3-88cd-694e81827961 admin admin] PATH_INFO: `/v3/projects/4b3d3cfe0ecb4b9d8efbab1107184d3e/users/0a01c075e69b49aa8f44968ed2cca1b0/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.757642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 806/1606] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:31 2022] PUT /identity/v3/projects/6175fe96bc0547449c330a8694d6877c/users/df6c7864c9304f0b9464fa20834d5481/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:31.759023 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b52dfe-332f-4dc4-a417-d764d18c9f22 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.773312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49588811-63a2-4fb3-88cd-694e81827961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3d3cfe0ecb4b9d8efbab1107184d3e, user_id=0a01c075e69b49aa8f44968ed2cca1b0, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.777172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49588811-63a2-4fb3-88cd-694e81827961 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.796419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 801/1607] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:31 2022] PUT /identity/v3/projects/4b3d3cfe0ecb4b9d8efbab1107184d3e/users/0a01c075e69b49aa8f44968ed2cca1b0/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:31.797045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49588811-63a2-4fb3-88cd-694e81827961 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.819865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:31.837089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b52dfe-332f-4dc4-a417-d764d18c9f22 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.871690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49588811-63a2-4fb3-88cd-694e81827961 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.879398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0280be6-ef70-45e0-8ecc-3a010f6d6000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.879725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0280be6-ef70-45e0-8ecc-3a010f6d6000 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.880111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0280be6-ef70-45e0-8ecc-3a010f6d6000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.880462 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0280be6-ef70-45e0-8ecc-3a010f6d6000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.881261 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0280be6-ef70-45e0-8ecc-3a010f6d6000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.884115 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0280be6-ef70-45e0-8ecc-3a010f6d6000 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.895738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 802/1608] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:31.896605 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0280be6-ef70-45e0-8ecc-3a010f6d6000 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.898369 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a0280be6-ef70-45e0-8ecc-3a010f6d6000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:31.913206 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d09ad2-9163-4f49-8469-ad94b954fa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.914472 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d09ad2-9163-4f49-8469-ad94b954fa7c admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.915093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d09ad2-9163-4f49-8469-ad94b954fa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.915533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d09ad2-9163-4f49-8469-ad94b954fa7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.916411 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d09ad2-9163-4f49-8469-ad94b954fa7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.918518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d09ad2-9163-4f49-8469-ad94b954fa7c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.934273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 807/1609] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:31.935749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d09ad2-9163-4f49-8469-ad94b954fa7c admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:31.946501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d09ad2-9163-4f49-8469-ad94b954fa7c admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.953507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68157598-2109-4cd4-bf9e-76e8ecbbfd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.954303 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157598-2109-4cd4-bf9e-76e8ecbbfd7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.954662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157598-2109-4cd4-bf9e-76e8ecbbfd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.955126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157598-2109-4cd4-bf9e-76e8ecbbfd7d admin admin] PATH_INFO: `/v3/projects/294c0515116649c284445edf4715060d/users/ed3f302056ec439da79e3b8bd048b3f6/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.960438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0280be6-ef70-45e0-8ecc-3a010f6d6000 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:31.964532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4024f-d379-45c6-9180-e9d3306bb14a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:31.964974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4024f-d379-45c6-9180-e9d3306bb14a service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:31.965324 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4024f-d379-45c6-9180-e9d3306bb14a service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:31.965659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4024f-d379-45c6-9180-e9d3306bb14a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:31.972559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68157598-2109-4cd4-bf9e-76e8ecbbfd7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=294c0515116649c284445edf4715060d, user_id=ed3f302056ec439da79e3b8bd048b3f6, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.975399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68157598-2109-4cd4-bf9e-76e8ecbbfd7d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.976275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4024f-d379-45c6-9180-e9d3306bb14a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:31.977769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4024f-d379-45c6-9180-e9d3306bb14a service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:31.990116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 803/1610] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:31.990846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4024f-d379-45c6-9180-e9d3306bb14a service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:32.000244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4024f-d379-45c6-9180-e9d3306bb14a service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:32.004699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 808/1611] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:31 2022] PUT /identity/v3/projects/294c0515116649c284445edf4715060d/users/ed3f302056ec439da79e3b8bd048b3f6/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:32.006240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf0ec2-31cf-4898-8f2c-08050e019d8c None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.006523 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf0ec2-31cf-4898-8f2c-08050e019d8c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.006828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf0ec2-31cf-4898-8f2c-08050e019d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.071432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-9caf0ec2-31cf-4898-8f2c-08050e019d8c None None] MFA Rules not processed for user `df6c7864c9304f0b9464fa20834d5481`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:32.072692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9caf0ec2-31cf-4898-8f2c-08050e019d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:32.075524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c5a31-6730-41ba-b439-0d39d4b4976b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:32.080088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c5a31-6730-41ba-b439-0d39d4b4976b service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.080416 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c5a31-6730-41ba-b439-0d39d4b4976b service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.080696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c5a31-6730-41ba-b439-0d39d4b4976b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.105038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:32.181022 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c5a31-6730-41ba-b439-0d39d4b4976b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:32.183138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c5a31-6730-41ba-b439-0d39d4b4976b service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:32.193329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 809/1612] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:32 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:32.193329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adb522-4c70-42f0-8f3b-45dd681284d7 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.193329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adb522-4c70-42f0-8f3b-45dd681284d7 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.193329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adb522-4c70-42f0-8f3b-45dd681284d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.196327 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 804/1613] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:32.197127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c5a31-6730-41ba-b439-0d39d4b4976b service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:32.208532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c5a31-6730-41ba-b439-0d39d4b4976b service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:32.214067 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bbd1e-04b3-4303-b783-eb5d0ca2fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:32.214465 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c6adb522-4c70-42f0-8f3b-45dd681284d7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:32.214739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bbd1e-04b3-4303-b783-eb5d0ca2fa4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.215022 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bbd1e-04b3-4303-b783-eb5d0ca2fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.215294 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bbd1e-04b3-4303-b783-eb5d0ca2fa4c admin admin] PATH_INFO: `/v3/projects/e86b1a92585d4a8488fea38a2200a812/users/9718b2489b9949dc97c1680c3b1dcc26/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.216240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c6adb522-4c70-42f0-8f3b-45dd681284d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:32.225237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 810/1614] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:32.226242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adb522-4c70-42f0-8f3b-45dd681284d7 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:32.233691 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bbd1e-04b3-4303-b783-eb5d0ca2fa4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86b1a92585d4a8488fea38a2200a812, user_id=9718b2489b9949dc97c1680c3b1dcc26, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:32.236461 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bbd1e-04b3-4303-b783-eb5d0ca2fa4c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:32.237255 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adb522-4c70-42f0-8f3b-45dd681284d7 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:32.243746 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26c17f-0f8d-4e54-b684-41b1d3384b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:32.244651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26c17f-0f8d-4e54-b684-41b1d3384b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.245024 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26c17f-0f8d-4e54-b684-41b1d3384b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.245527 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26c17f-0f8d-4e54-b684-41b1d3384b75 admin admin] PATH_INFO: `/v3/projects/e6ea7bd601d9418782e43e132af07c9d/users/b29713afd5134d1fa73cd896ae4d49cd/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.259212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 805/1615] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:32 2022] PUT /identity/v3/projects/e86b1a92585d4a8488fea38a2200a812/users/9718b2489b9949dc97c1680c3b1dcc26/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:32.259212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9e4cb-7f66-43e3-8839-4db90f93f679 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.259212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9e4cb-7f66-43e3-8839-4db90f93f679 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.259212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9e4cb-7f66-43e3-8839-4db90f93f679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.267920 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26c17f-0f8d-4e54-b684-41b1d3384b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ea7bd601d9418782e43e132af07c9d, user_id=b29713afd5134d1fa73cd896ae4d49cd, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:32.271026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26c17f-0f8d-4e54-b684-41b1d3384b75 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:32.295808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 811/1616] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:32 2022] PUT /identity/v3/projects/e6ea7bd601d9418782e43e132af07c9d/users/b29713afd5134d1fa73cd896ae4d49cd/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:32.298335 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26c17f-0f8d-4e54-b684-41b1d3384b75 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:32.328513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-79a9e4cb-7f66-43e3-8839-4db90f93f679 None None] MFA Rules not processed for user `ed3f302056ec439da79e3b8bd048b3f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:32.328513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-79a9e4cb-7f66-43e3-8839-4db90f93f679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:32.338375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:32.397566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26c17f-0f8d-4e54-b684-41b1d3384b75 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:32.405359 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18ed44-312c-41cd-8c62-98b0e0798a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:32.406182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ed44-312c-41cd-8c62-98b0e0798a3e admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.406558 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ed44-312c-41cd-8c62-98b0e0798a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.406963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ed44-312c-41cd-8c62-98b0e0798a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.408646 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18ed44-312c-41cd-8c62-98b0e0798a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:32.410645 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18ed44-312c-41cd-8c62-98b0e0798a3e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:32.422615 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 806/1617] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:32.429672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9e4cb-7f66-43e3-8839-4db90f93f679 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:32.460486 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9e4cb-7f66-43e3-8839-4db90f93f679 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:32.472374 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 812/1618] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:32 2022] POST /identity/v3/projects => generated 401 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:32.474285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b997e3a-6f19-4168-a98c-b7a9a4d78ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:32.475013 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b997e3a-6f19-4168-a98c-b7a9a4d78ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.476708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18ed44-312c-41cd-8c62-98b0e0798a3e admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:32.477570 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b997e3a-6f19-4168-a98c-b7a9a4d78ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.477850 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b997e3a-6f19-4168-a98c-b7a9a4d78ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.478694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b997e3a-6f19-4168-a98c-b7a9a4d78ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:32.484383 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b997e3a-6f19-4168-a98c-b7a9a4d78ca3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:32.506984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 807/1619] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:32.508819 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7000a-df4d-4025-a9fe-49819b6332cc None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.509325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7000a-df4d-4025-a9fe-49819b6332cc None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.510210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7000a-df4d-4025-a9fe-49819b6332cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.559473 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d4e7000a-df4d-4025-a9fe-49819b6332cc None None] MFA Rules not processed for user `b29713afd5134d1fa73cd896ae4d49cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:32.561005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d4e7000a-df4d-4025-a9fe-49819b6332cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:32.576080 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18ed44-312c-41cd-8c62-98b0e0798a3e admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:32.581122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf3475-8c44-4892-918f-fbb0ccf93d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:32.582144 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf3475-8c44-4892-918f-fbb0ccf93d3b service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.582808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf3475-8c44-4892-918f-fbb0ccf93d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.582808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf3475-8c44-4892-918f-fbb0ccf93d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.631709 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:32.666352 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf3475-8c44-4892-918f-fbb0ccf93d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:32.668030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 808/1620] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:32.668278 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf3475-8c44-4892-918f-fbb0ccf93d3b service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:32.670565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466e48e-d9cd-4a1e-bf60-c427a026e802 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.671141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466e48e-d9cd-4a1e-bf60-c427a026e802 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.671597 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466e48e-d9cd-4a1e-bf60-c427a026e802 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.675263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 809/1621] 10.222.0.77 () {54 vars in 962 bytes} [Mon Aug 22 16:02:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:02:32.676807 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466e48e-d9cd-4a1e-bf60-c427a026e802 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:32.680098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 813/1622] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:32.681243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf3475-8c44-4892-918f-fbb0ccf93d3b service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:32.691415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf3475-8c44-4892-918f-fbb0ccf93d3b service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:32.696213 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466e48e-d9cd-4a1e-bf60-c427a026e802 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:32.698218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a18871-eda8-4e26-bb35-8914259b2175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:32.699302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a18871-eda8-4e26-bb35-8914259b2175 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.699394 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a18871-eda8-4e26-bb35-8914259b2175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.699715 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a18871-eda8-4e26-bb35-8914259b2175 admin admin] PATH_INFO: `/v3/projects/e86b1a92585d4a8488fea38a2200a812/users/9718b2489b9949dc97c1680c3b1dcc26/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.702274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a18871-eda8-4e26-bb35-8914259b2175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86b1a92585d4a8488fea38a2200a812, user_id=9718b2489b9949dc97c1680c3b1dcc26, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:32.705152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a18871-eda8-4e26-bb35-8914259b2175 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:32.710465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccd343-0c92-41ac-b844-2d3a9b033c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:32.711465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd343-0c92-41ac-b844-2d3a9b033c33 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.711869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd343-0c92-41ac-b844-2d3a9b033c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.712237 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd343-0c92-41ac-b844-2d3a9b033c33 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.712962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccd343-0c92-41ac-b844-2d3a9b033c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:32.715012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccd343-0c92-41ac-b844-2d3a9b033c33 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:32.722758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 814/1623] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:32 2022] PUT /identity/v3/projects/e86b1a92585d4a8488fea38a2200a812/users/9718b2489b9949dc97c1680c3b1dcc26/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:32.724555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a18871-eda8-4e26-bb35-8914259b2175 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:32.760270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 810/1624] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:32 2022] POST /identity/v3/users => generated 307 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:32.765116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7833e6-480f-4656-a7cc-5cd7f914e074 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.765682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7833e6-480f-4656-a7cc-5cd7f914e074 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.765682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7833e6-480f-4656-a7cc-5cd7f914e074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.836694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:32.848550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-dc7833e6-480f-4656-a7cc-5cd7f914e074 None None] MFA Rules not processed for user `20e4a18ab77642baa9adb9a4b49fbcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:32.849990 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-dc7833e6-480f-4656-a7cc-5cd7f914e074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:32.873126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a18871-eda8-4e26-bb35-8914259b2175 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:32.882467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14962dcc-6f53-417a-be36-febd40006092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:32.883246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14962dcc-6f53-417a-be36-febd40006092 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.883610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14962dcc-6f53-417a-be36-febd40006092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.884743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14962dcc-6f53-417a-be36-febd40006092 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.885554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14962dcc-6f53-417a-be36-febd40006092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:32.889760 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14962dcc-6f53-417a-be36-febd40006092 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:32.937674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 815/1625] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:32 2022] POST /identity/v3/projects => generated 371 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:32.939286 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d0d87-a645-4540-9ee8-592235da0d19 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:32.939709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d0d87-a645-4540-9ee8-592235da0d19 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:32.939842 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d0d87-a645-4540-9ee8-592235da0d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:32.985174 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-a15d0d87-a645-4540-9ee8-592235da0d19 None None] MFA Rules not processed for user `9718b2489b9949dc97c1680c3b1dcc26`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:32.986433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a15d0d87-a645-4540-9ee8-592235da0d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:32.993464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 811/1626] 10.222.0.77 () {58 vars in 1059 bytes} [Mon Aug 22 16:02:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:32.994914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7833e6-480f-4656-a7cc-5cd7f914e074 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:33.018423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7833e6-480f-4656-a7cc-5cd7f914e074 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:33.154905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 816/1627] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:33.174775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d0d87-a645-4540-9ee8-592235da0d19 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:33.187484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df92b86-da3c-4d21-b5c2-7f040a601be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:33.188127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df92b86-da3c-4d21-b5c2-7f040a601be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:33.188403 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df92b86-da3c-4d21-b5c2-7f040a601be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:33.188674 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df92b86-da3c-4d21-b5c2-7f040a601be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:33.189923 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df92b86-da3c-4d21-b5c2-7f040a601be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:33.191653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df92b86-da3c-4d21-b5c2-7f040a601be1 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:33.203781 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d0d87-a645-4540-9ee8-592235da0d19 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:33.216779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 812/1628] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:33.217692 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df92b86-da3c-4d21-b5c2-7f040a601be1 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:33.219551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c547984-5cf4-409d-bf81-9a6aee949233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:33.220200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c547984-5cf4-409d-bf81-9a6aee949233 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:33.220477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c547984-5cf4-409d-bf81-9a6aee949233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:33.220747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c547984-5cf4-409d-bf81-9a6aee949233 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:33.221395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c547984-5cf4-409d-bf81-9a6aee949233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:33.223422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c547984-5cf4-409d-bf81-9a6aee949233 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:33.261184 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 817/1629] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:33 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:33.261184 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c547984-5cf4-409d-bf81-9a6aee949233 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:33.319001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:33.360944 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df92b86-da3c-4d21-b5c2-7f040a601be1 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:33.371497 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ff404-dd7b-4c60-a5d4-ad8feab24f8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:33.373461 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff404-dd7b-4c60-a5d4-ad8feab24f8e service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:33.373849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff404-dd7b-4c60-a5d4-ad8feab24f8e service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:33.374627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff404-dd7b-4c60-a5d4-ad8feab24f8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:33.389333 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c547984-5cf4-409d-bf81-9a6aee949233 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:33.395664 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecdc2f-3e17-4fbd-aeaa-be762e03a3f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:33.396330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecdc2f-3e17-4fbd-aeaa-be762e03a3f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:33.396603 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecdc2f-3e17-4fbd-aeaa-be762e03a3f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:33.396878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecdc2f-3e17-4fbd-aeaa-be762e03a3f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:33.426135 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecdc2f-3e17-4fbd-aeaa-be762e03a3f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:33.427623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecdc2f-3e17-4fbd-aeaa-be762e03a3f2 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:33.458691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 818/1630] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:33.459716 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecdc2f-3e17-4fbd-aeaa-be762e03a3f2 service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:33.482809 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecdc2f-3e17-4fbd-aeaa-be762e03a3f2 service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:33.493601 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ff404-dd7b-4c60-a5d4-ad8feab24f8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:33.495758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ff404-dd7b-4c60-a5d4-ad8feab24f8e service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:33.495884 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f332d-83d4-4cbc-bb2e-3805779fe5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:33.496464 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f332d-83d4-4cbc-bb2e-3805779fe5ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:33.496743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f332d-83d4-4cbc-bb2e-3805779fe5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:33.497021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f332d-83d4-4cbc-bb2e-3805779fe5ce admin admin] PATH_INFO: `/v3/projects/b5dcc6612c0d4fa6bfa32d2e0a9e1dbf/users/20a652cf1dec4f65aaf2f95af4cd77dd/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:33.516917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 813/1631] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:33.519247 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ff404-dd7b-4c60-a5d4-ad8feab24f8e service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:33.541852 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ff404-dd7b-4c60-a5d4-ad8feab24f8e service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:33.550883 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f332d-83d4-4cbc-bb2e-3805779fe5ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dcc6612c0d4fa6bfa32d2e0a9e1dbf, user_id=20a652cf1dec4f65aaf2f95af4cd77dd, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:33.554178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f332d-83d4-4cbc-bb2e-3805779fe5ce admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:33.556758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac661b-57ba-4527-9e22-7a6e2978e010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:33.560080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac661b-57ba-4527-9e22-7a6e2978e010 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:33.560701 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac661b-57ba-4527-9e22-7a6e2978e010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:33.562632 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac661b-57ba-4527-9e22-7a6e2978e010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:33.563774 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac661b-57ba-4527-9e22-7a6e2978e010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:33.568782 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac661b-57ba-4527-9e22-7a6e2978e010 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:33.586411 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 819/1632] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:33 2022] PUT /identity/v3/projects/b5dcc6612c0d4fa6bfa32d2e0a9e1dbf/users/20a652cf1dec4f65aaf2f95af4cd77dd/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:33.588013 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f332d-83d4-4cbc-bb2e-3805779fe5ce admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:33.604700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 814/1633] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:33.604700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac661b-57ba-4527-9e22-7a6e2978e010 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:33.624566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:33.624979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac661b-57ba-4527-9e22-7a6e2978e010 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:33.745606 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f332d-83d4-4cbc-bb2e-3805779fe5ce admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:33.752392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ec14c-cfe1-4b3a-97d5-e5ff86ad3f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:33.753155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ec14c-cfe1-4b3a-97d5-e5ff86ad3f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:33.753534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ec14c-cfe1-4b3a-97d5-e5ff86ad3f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:33.753905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ec14c-cfe1-4b3a-97d5-e5ff86ad3f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:33.754116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e119c3-cdc2-4b1b-8e9a-191ad611aa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:33.754866 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e119c3-cdc2-4b1b-8e9a-191ad611aa4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:33.754986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ec14c-cfe1-4b3a-97d5-e5ff86ad3f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:33.755363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e119c3-cdc2-4b1b-8e9a-191ad611aa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:33.755862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e119c3-cdc2-4b1b-8e9a-191ad611aa4f admin admin] PATH_INFO: `/v3/projects/ef9aea1294b94fd5975ad4ec3a4aa77b/users/0138ad70e90d4dcb887408f90d324e7a/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:33.758968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ec14c-cfe1-4b3a-97d5-e5ff86ad3f7c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:33.787387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 820/1634] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:33.788874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ec14c-cfe1-4b3a-97d5-e5ff86ad3f7c admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:33.792218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e119c3-cdc2-4b1b-8e9a-191ad611aa4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9aea1294b94fd5975ad4ec3a4aa77b, user_id=0138ad70e90d4dcb887408f90d324e7a, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:33.798563 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e119c3-cdc2-4b1b-8e9a-191ad611aa4f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:33.812299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ec14c-cfe1-4b3a-97d5-e5ff86ad3f7c admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:33.823550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98933ee1-9782-4212-b62f-a3b19b1aebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:33.824432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98933ee1-9782-4212-b62f-a3b19b1aebaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:33.824809 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98933ee1-9782-4212-b62f-a3b19b1aebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:33.825209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98933ee1-9782-4212-b62f-a3b19b1aebaf admin admin] PATH_INFO: `/v3/projects/b5dcc6612c0d4fa6bfa32d2e0a9e1dbf/users/20a652cf1dec4f65aaf2f95af4cd77dd/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:33.826904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 815/1635] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:33 2022] PUT /identity/v3/projects/ef9aea1294b94fd5975ad4ec3a4aa77b/users/0138ad70e90d4dcb887408f90d324e7a/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:33.830736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98933ee1-9782-4212-b62f-a3b19b1aebaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dcc6612c0d4fa6bfa32d2e0a9e1dbf, user_id=20a652cf1dec4f65aaf2f95af4cd77dd, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:33.831569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e119c3-cdc2-4b1b-8e9a-191ad611aa4f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:33.836426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98933ee1-9782-4212-b62f-a3b19b1aebaf admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:33.876120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 821/1636] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:33 2022] PUT /identity/v3/projects/b5dcc6612c0d4fa6bfa32d2e0a9e1dbf/users/20a652cf1dec4f65aaf2f95af4cd77dd/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:33.887370 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6d498-7f97-46b5-afd7-d7c22d414081 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:33.887656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6d498-7f97-46b5-afd7-d7c22d414081 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:33.894761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6d498-7f97-46b5-afd7-d7c22d414081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:33.991400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-70f6d498-7f97-46b5-afd7-d7c22d414081 None None] MFA Rules not processed for user `20a652cf1dec4f65aaf2f95af4cd77dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:33.996384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-70f6d498-7f97-46b5-afd7-d7c22d414081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:34.017379 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:34.035869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e119c3-cdc2-4b1b-8e9a-191ad611aa4f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:34.157016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cd10e-458f-4bf5-b9d6-139dc900a021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:34.157731 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cd10e-458f-4bf5-b9d6-139dc900a021 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:34.158133 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cd10e-458f-4bf5-b9d6-139dc900a021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:34.158469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cd10e-458f-4bf5-b9d6-139dc900a021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:34.159240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cd10e-458f-4bf5-b9d6-139dc900a021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:34.162574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cd10e-458f-4bf5-b9d6-139dc900a021 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:34.179420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 816/1637] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:34.179420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f9c1-68f6-4a10-ae2c-131607ed28f1 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:34.179420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f9c1-68f6-4a10-ae2c-131607ed28f1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:34.179420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246f9c1-68f6-4a10-ae2c-131607ed28f1 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:34.181199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 817/1638] 10.222.0.77 () {54 vars in 912 bytes} [Mon Aug 22 16:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:02:34.182899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246f9c1-68f6-4a10-ae2c-131607ed28f1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:34.228188 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246f9c1-68f6-4a10-ae2c-131607ed28f1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:34.234049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 822/1639] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:33 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:34.235674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a72c-3625-47eb-92fb-8f190e1a600b None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:34.235959 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a72c-3625-47eb-92fb-8f190e1a600b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:34.236228 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8a72c-3625-47eb-92fb-8f190e1a600b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:34.247491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ad4e7-3d98-4304-a342-28ea9b8e34b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:34.250265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ad4e7-3d98-4304-a342-28ea9b8e34b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:34.250569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ad4e7-3d98-4304-a342-28ea9b8e34b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:34.250880 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ad4e7-3d98-4304-a342-28ea9b8e34b1 admin admin] PATH_INFO: `/v3/projects/ef9aea1294b94fd5975ad4ec3a4aa77b/users/0138ad70e90d4dcb887408f90d324e7a/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:34.257215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ad4e7-3d98-4304-a342-28ea9b8e34b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9aea1294b94fd5975ad4ec3a4aa77b, user_id=0138ad70e90d4dcb887408f90d324e7a, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:34.271571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ad4e7-3d98-4304-a342-28ea9b8e34b1 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:34.278240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-5fb8a72c-3625-47eb-92fb-8f190e1a600b None None] MFA Rules not processed for user `20e4a18ab77642baa9adb9a4b49fbcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:34.279714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5fb8a72c-3625-47eb-92fb-8f190e1a600b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:34.305328 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 818/1640] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:34 2022] PUT /identity/v3/projects/ef9aea1294b94fd5975ad4ec3a4aa77b/users/0138ad70e90d4dcb887408f90d324e7a/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:34.306411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ad4e7-3d98-4304-a342-28ea9b8e34b1 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:34.414096 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ad4e7-3d98-4304-a342-28ea9b8e34b1 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:34.420204 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2955b8-3efd-40c1-a440-ec9a2f1f8588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:34.420898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2955b8-3efd-40c1-a440-ec9a2f1f8588 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:34.421247 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2955b8-3efd-40c1-a440-ec9a2f1f8588 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:34.422049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2955b8-3efd-40c1-a440-ec9a2f1f8588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:34.511878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 823/1641] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 16:02:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:34.513131 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00043987-579c-4207-8a42-28de06143f5d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:34.513651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00043987-579c-4207-8a42-28de06143f5d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:34.514020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00043987-579c-4207-8a42-28de06143f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:34.552859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-00043987-579c-4207-8a42-28de06143f5d None None] MFA Rules not processed for user `0138ad70e90d4dcb887408f90d324e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:34.553342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2955b8-3efd-40c1-a440-ec9a2f1f8588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:34.554455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-00043987-579c-4207-8a42-28de06143f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:34.555438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2955b8-3efd-40c1-a440-ec9a2f1f8588 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:34.568626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 819/1642] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:34 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:34.570900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:34.612236 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2955b8-3efd-40c1-a440-ec9a2f1f8588 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:34.626717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2955b8-3efd-40c1-a440-ec9a2f1f8588 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:34.647476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2390a-00c6-46a8-a272-1bec2429adff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:34.648291 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2390a-00c6-46a8-a272-1bec2429adff service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:34.648577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2390a-00c6-46a8-a272-1bec2429adff service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:34.648851 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2390a-00c6-46a8-a272-1bec2429adff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:34.675245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 824/1643] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:34.737172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:34.766591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00043987-579c-4207-8a42-28de06143f5d None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:34.782955 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00043987-579c-4207-8a42-28de06143f5d None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:34.793787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2339406-c2dc-471a-ab99-61a55ea1ddab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:34.794650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2339406-c2dc-471a-ab99-61a55ea1ddab service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:34.795082 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2339406-c2dc-471a-ab99-61a55ea1ddab service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:34.795502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2339406-c2dc-471a-ab99-61a55ea1ddab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:34.822536 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2339406-c2dc-471a-ab99-61a55ea1ddab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:34.825252 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2390a-00c6-46a8-a272-1bec2429adff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:34.825937 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2339406-c2dc-471a-ab99-61a55ea1ddab service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:34.828319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2390a-00c6-46a8-a272-1bec2429adff service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:34.861786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 820/1644] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:34.863132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 825/1645] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:02:35.394216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2390a-00c6-46a8-a272-1bec2429adff service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:35.558971 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2390a-00c6-46a8-a272-1bec2429adff service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:35.573962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:35.575915 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:35.576788 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:35.577074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] PATH_INFO: `/v3/users/df6c7864c9304f0b9464fa20834d5481` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:35.578622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6c7864c9304f0b9464fa20834d5481)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:35.579750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 16:02:35.579750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 22 16:02:35.579750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: Aug 22 16:02:35.581322 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:35.729054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6c7864c9304f0b9464fa20834d5481'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:35.729954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6c7864c9304f0b9464fa20834d5481'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:35.730579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6c7864c9304f0b9464fa20834d5481'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:35.779195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6c7864c9304f0b9464fa20834d5481'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:35.802940 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6c7864c9304f0b9464fa20834d5481'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:35.875583 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 821/1646] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:02:35 2022] DELETE /identity/v3/users/df6c7864c9304f0b9464fa20834d5481 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:35.880405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12034e-ac9e-438e-8ae1-967f2be77f63 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:35.880941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12034e-ac9e-438e-8ae1-967f2be77f63 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:35.880941 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12034e-ac9e-438e-8ae1-967f2be77f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:35.935760 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-ee12034e-ac9e-438e-8ae1-967f2be77f63 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:35.937197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ee12034e-ac9e-438e-8ae1-967f2be77f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:36.093103 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 826/1647] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:36.128984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:36.130716 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:36.313450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:36.359447 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115ffa2-996d-45a7-9fa6-483a541c7a67 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:36.373306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11af7b-ff49-4b26-99ed-cc8eb6cdefd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:36.375361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11af7b-ff49-4b26-99ed-cc8eb6cdefd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:36.376702 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11af7b-ff49-4b26-99ed-cc8eb6cdefd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:36.378162 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11af7b-ff49-4b26-99ed-cc8eb6cdefd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:36.405896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11af7b-ff49-4b26-99ed-cc8eb6cdefd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:36.411199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11af7b-ff49-4b26-99ed-cc8eb6cdefd4 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:36.500636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 822/1648] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:36.563072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12034e-ac9e-438e-8ae1-967f2be77f63 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:36.564854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ee12034e-ac9e-438e-8ae1-967f2be77f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:36.589611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12034e-ac9e-438e-8ae1-967f2be77f63 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:36.603199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65247fd1-4169-4a6e-b4ca-9cb561359c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:36.603944 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65247fd1-4169-4a6e-b4ca-9cb561359c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:36.604314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65247fd1-4169-4a6e-b4ca-9cb561359c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:36.604594 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65247fd1-4169-4a6e-b4ca-9cb561359c50 admin admin] PATH_INFO: `/v3/users/b29713afd5134d1fa73cd896ae4d49cd` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:36.608054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65247fd1-4169-4a6e-b4ca-9cb561359c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b29713afd5134d1fa73cd896ae4d49cd)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:36.610050 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65247fd1-4169-4a6e-b4ca-9cb561359c50 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:36.748056 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83dc9-93e8-43a7-a3fb-d03b53eb91b3 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:36.748606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83dc9-93e8-43a7-a3fb-d03b53eb91b3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:36.749091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b83dc9-93e8-43a7-a3fb-d03b53eb91b3 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:36.751004 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 823/1649] 10.222.0.77 () {54 vars in 962 bytes} [Mon Aug 22 16:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 16:02:36.760138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb06ca-90bb-43e0-8cd4-0c0a5559c612 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:36.760456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb06ca-90bb-43e0-8cd4-0c0a5559c612 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:36.761084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb06ca-90bb-43e0-8cd4-0c0a5559c612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:36.780393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-65247fd1-4169-4a6e-b4ca-9cb561359c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b29713afd5134d1fa73cd896ae4d49cd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:36.844569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9ceb06ca-90bb-43e0-8cd4-0c0a5559c612 None None] MFA Rules not processed for user `20e4a18ab77642baa9adb9a4b49fbcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:36.847636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-65247fd1-4169-4a6e-b4ca-9cb561359c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b29713afd5134d1fa73cd896ae4d49cd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:36.851160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9ceb06ca-90bb-43e0-8cd4-0c0a5559c612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:36.871828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-65247fd1-4169-4a6e-b4ca-9cb561359c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b29713afd5134d1fa73cd896ae4d49cd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:36.897762 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-65247fd1-4169-4a6e-b4ca-9cb561359c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b29713afd5134d1fa73cd896ae4d49cd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:36.898502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-65247fd1-4169-4a6e-b4ca-9cb561359c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b29713afd5134d1fa73cd896ae4d49cd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:36.925012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 827/1650] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:02:36 2022] DELETE /identity/v3/users/b29713afd5134d1fa73cd896ae4d49cd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:36.929950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ab937-6eb0-4aa1-9844-1bc862f3b53c None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:36.930673 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ab937-6eb0-4aa1-9844-1bc862f3b53c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:36.932417 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ab937-6eb0-4aa1-9844-1bc862f3b53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:36.960535 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:37.004208 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-8c3ab937-6eb0-4aa1-9844-1bc862f3b53c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:37.018750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8c3ab937-6eb0-4aa1-9844-1bc862f3b53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:37.119107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 824/1651] 10.222.0.77 () {58 vars in 1059 bytes} [Mon Aug 22 16:02:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:02:37.124209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb06ca-90bb-43e0-8cd4-0c0a5559c612 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:37.127235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9ceb06ca-90bb-43e0-8cd4-0c0a5559c612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:37.159946 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb06ca-90bb-43e0-8cd4-0c0a5559c612 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:37.226343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 828/1652] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:02:37.229287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f15c-d4ae-4457-907d-ad83de96d8a7 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:37.229572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f15c-d4ae-4457-907d-ad83de96d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:37.237869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f15c-d4ae-4457-907d-ad83de96d8a7 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:37.239593 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 829/1653] 10.222.0.77 () {54 vars in 912 bytes} [Mon Aug 22 16:02:37 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:02:37.245382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550774-2788-4ec3-8e71-1df29747de88 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:37.247644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550774-2788-4ec3-8e71-1df29747de88 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:37.248081 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17550774-2788-4ec3-8e71-1df29747de88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:37.307793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-17550774-2788-4ec3-8e71-1df29747de88 None None] MFA Rules not processed for user `20e4a18ab77642baa9adb9a4b49fbcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:37.312751 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-17550774-2788-4ec3-8e71-1df29747de88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:37.417629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:37.420683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:37.421057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:37.422497 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] PATH_INFO: `/v3/projects/6175fe96bc0547449c330a8694d6877c` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:37.424071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6175fe96bc0547449c330a8694d6877c)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:37.426466 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:37.589245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 830/1654] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 16:02:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:37.590457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17550774-2788-4ec3-8e71-1df29747de88 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:37.593920 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-17550774-2788-4ec3-8e71-1df29747de88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:37.596641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6175fe96bc0547449c330a8694d6877c', 'request_id': 'req-414e296e-7bee-4d06-bc39-84a6889490c7'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:37.616942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6175fe96bc0547449c330a8694d6877c', 'request_id': 'req-414e296e-7bee-4d06-bc39-84a6889490c7'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:37.638417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6175fe96bc0547449c330a8694d6877c', 'request_id': 'req-414e296e-7bee-4d06-bc39-84a6889490c7'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:37.669164 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] The token cache is being invalidate because project 6175fe96bc0547449c330a8694d6877c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:02:37.670826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:37.672310 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:37.678701 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 825/1655] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:02:37 2022] DELETE /identity/v3/projects/6175fe96bc0547449c330a8694d6877c => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:37.678701 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:37.681030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:37.735315 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:37.872491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e296e-7bee-4d06-bc39-84a6889490c7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:37.874645 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17550774-2788-4ec3-8e71-1df29747de88 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:37.904008 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640afe3a-3f43-4033-b12a-a6f0b9bbb9b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:37.904903 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afe3a-3f43-4033-b12a-a6f0b9bbb9b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:37.905414 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afe3a-3f43-4033-b12a-a6f0b9bbb9b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:37.905833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afe3a-3f43-4033-b12a-a6f0b9bbb9b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:37.911555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-640afe3a-3f43-4033-b12a-a6f0b9bbb9b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:38.024886 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e656f-3063-41a1-943e-a2a3bc1da649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:38.025527 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e656f-3063-41a1-943e-a2a3bc1da649 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:38.025810 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e656f-3063-41a1-943e-a2a3bc1da649 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:38.026123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e656f-3063-41a1-943e-a2a3bc1da649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:38.028181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-397e656f-3063-41a1-943e-a2a3bc1da649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:38.034112 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:38.126191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e656f-3063-41a1-943e-a2a3bc1da649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:38.132379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e656f-3063-41a1-943e-a2a3bc1da649 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:38.159342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 831/1656] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:38.160957 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e656f-3063-41a1-943e-a2a3bc1da649 service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:38.167219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-397e656f-3063-41a1-943e-a2a3bc1da649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:38.192095 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640afe3a-3f43-4033-b12a-a6f0b9bbb9b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:38.193918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640afe3a-3f43-4033-b12a-a6f0b9bbb9b6 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:38.199965 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e656f-3063-41a1-943e-a2a3bc1da649 service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:38.215896 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cf70a-1314-4584-a98b-d1c92a350337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:38.217392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cf70a-1314-4584-a98b-d1c92a350337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:38.217392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cf70a-1314-4584-a98b-d1c92a350337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:38.218001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cf70a-1314-4584-a98b-d1c92a350337 admin admin] PATH_INFO: `/v3/users/20a652cf1dec4f65aaf2f95af4cd77dd` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:38.223680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cf70a-1314-4584-a98b-d1c92a350337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a652cf1dec4f65aaf2f95af4cd77dd)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:38.230864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cf70a-1314-4584-a98b-d1c92a350337 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:38.234689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 826/1657] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:38.235803 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640afe3a-3f43-4033-b12a-a6f0b9bbb9b6 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:38.237828 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-640afe3a-3f43-4033-b12a-a6f0b9bbb9b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:38.281639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640afe3a-3f43-4033-b12a-a6f0b9bbb9b6 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:38.286628 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8c222-e898-44d8-a0b6-5f34dcf30f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:38.287355 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8c222-e898-44d8-a0b6-5f34dcf30f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:38.287656 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8c222-e898-44d8-a0b6-5f34dcf30f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:38.287919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8c222-e898-44d8-a0b6-5f34dcf30f1e admin admin] PATH_INFO: `/v3/users/0ccb2a8c3713451387a49b6aee526f35` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:38.289194 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8c222-e898-44d8-a0b6-5f34dcf30f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ccb2a8c3713451387a49b6aee526f35)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:38.291652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8c222-e898-44d8-a0b6-5f34dcf30f1e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:38.413761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-bb8cf70a-1314-4584-a98b-d1c92a350337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a652cf1dec4f65aaf2f95af4cd77dd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:38.423065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-15e8c222-e898-44d8-a0b6-5f34dcf30f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ccb2a8c3713451387a49b6aee526f35'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:38.424405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-15e8c222-e898-44d8-a0b6-5f34dcf30f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ccb2a8c3713451387a49b6aee526f35'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:38.426302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-15e8c222-e898-44d8-a0b6-5f34dcf30f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ccb2a8c3713451387a49b6aee526f35'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:38.448395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-bb8cf70a-1314-4584-a98b-d1c92a350337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a652cf1dec4f65aaf2f95af4cd77dd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:38.462520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-15e8c222-e898-44d8-a0b6-5f34dcf30f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ccb2a8c3713451387a49b6aee526f35'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:38.466240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-bb8cf70a-1314-4584-a98b-d1c92a350337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a652cf1dec4f65aaf2f95af4cd77dd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:38.481775 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-15e8c222-e898-44d8-a0b6-5f34dcf30f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ccb2a8c3713451387a49b6aee526f35'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:38.487695 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-bb8cf70a-1314-4584-a98b-d1c92a350337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a652cf1dec4f65aaf2f95af4cd77dd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:38.492215 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-bb8cf70a-1314-4584-a98b-d1c92a350337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a652cf1dec4f65aaf2f95af4cd77dd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:38.505758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 832/1658] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:02:38 2022] DELETE /identity/v3/users/20a652cf1dec4f65aaf2f95af4cd77dd => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:38.525978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 827/1659] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:02:38 2022] DELETE /identity/v3/users/0ccb2a8c3713451387a49b6aee526f35 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:38.531653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8222e8-c56c-46a0-b521-da6a58c0b7e8 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:38.532324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8222e8-c56c-46a0-b521-da6a58c0b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:38.532879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8222e8-c56c-46a0-b521-da6a58c0b7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:38.556429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-3b8222e8-c56c-46a0-b521-da6a58c0b7e8 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:38.559114 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3b8222e8-c56c-46a0-b521-da6a58c0b7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:38.638766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 833/1660] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:38.728538 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8c222-e898-44d8-a0b6-5f34dcf30f1e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:38.730113 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-15e8c222-e898-44d8-a0b6-5f34dcf30f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:38.782652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:38.888628 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8c222-e898-44d8-a0b6-5f34dcf30f1e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:38.907813 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e00d5-bdc4-4a0d-8a72-8a63fae7c430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:38.908476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e00d5-bdc4-4a0d-8a72-8a63fae7c430 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:38.908756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e00d5-bdc4-4a0d-8a72-8a63fae7c430 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:38.909032 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e00d5-bdc4-4a0d-8a72-8a63fae7c430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:38.950205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e00d5-bdc4-4a0d-8a72-8a63fae7c430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:38.952149 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e00d5-bdc4-4a0d-8a72-8a63fae7c430 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:38.988105 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 828/1661] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:40.227657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8222e8-c56c-46a0-b521-da6a58c0b7e8 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:40.229890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3b8222e8-c56c-46a0-b521-da6a58c0b7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:40.253089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8222e8-c56c-46a0-b521-da6a58c0b7e8 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:40.264519 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:40.265592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:40.266069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:40.266546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] PATH_INFO: `/v3/projects/c27cf0657bbd4d4eaf7090c7584a8a89` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:40.269004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c27cf0657bbd4d4eaf7090c7584a8a89)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:40.270442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: WARNING py.warnings [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 16:02:40.270442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: warnings.warn(msg) Aug 22 16:02:40.270442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: Aug 22 16:02:40.274491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:40.294956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:40.433547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c27cf0657bbd4d4eaf7090c7584a8a89', 'request_id': 'req-8aec2e94-66e0-4041-9bcd-c9603a114068'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:40.446434 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c27cf0657bbd4d4eaf7090c7584a8a89', 'request_id': 'req-8aec2e94-66e0-4041-9bcd-c9603a114068'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:40.487939 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c27cf0657bbd4d4eaf7090c7584a8a89', 'request_id': 'req-8aec2e94-66e0-4041-9bcd-c9603a114068'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:40.527836 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] The token cache is being invalidate because project c27cf0657bbd4d4eaf7090c7584a8a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:02:40.530623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:40.533770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:40.543304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 834/1662] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:02:40 2022] DELETE /identity/v3/projects/c27cf0657bbd4d4eaf7090c7584a8a89 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:40.547181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e00d5-bdc4-4a0d-8a72-8a63fae7c430 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:40.561589 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e00d5-bdc4-4a0d-8a72-8a63fae7c430 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:40.601970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:40.604146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:40.717269 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146d7ba-e247-4c3f-b653-6528e3ba8d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:40.718044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146d7ba-e247-4c3f-b653-6528e3ba8d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:40.718404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146d7ba-e247-4c3f-b653-6528e3ba8d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:40.718783 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146d7ba-e247-4c3f-b653-6528e3ba8d6e admin admin] PATH_INFO: `/v3/users/9718b2489b9949dc97c1680c3b1dcc26` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:40.720404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146d7ba-e247-4c3f-b653-6528e3ba8d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9718b2489b9949dc97c1680c3b1dcc26)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:40.723629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146d7ba-e247-4c3f-b653-6528e3ba8d6e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:40.799672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec2e94-66e0-4041-9bcd-c9603a114068 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:40.828982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:40.831354 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:40.831646 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:40.831927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] PATH_INFO: `/v3/projects/b5dcc6612c0d4fa6bfa32d2e0a9e1dbf` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:40.837779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5dcc6612c0d4fa6bfa32d2e0a9e1dbf)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:40.841683 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:40.861898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f146d7ba-e247-4c3f-b653-6528e3ba8d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9718b2489b9949dc97c1680c3b1dcc26'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:40.864587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f146d7ba-e247-4c3f-b653-6528e3ba8d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9718b2489b9949dc97c1680c3b1dcc26'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:40.866286 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f146d7ba-e247-4c3f-b653-6528e3ba8d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9718b2489b9949dc97c1680c3b1dcc26'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:40.884982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f146d7ba-e247-4c3f-b653-6528e3ba8d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9718b2489b9949dc97c1680c3b1dcc26'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:40.911328 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f146d7ba-e247-4c3f-b653-6528e3ba8d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9718b2489b9949dc97c1680c3b1dcc26'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:40.983723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 829/1663] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:02:40 2022] DELETE /identity/v3/users/9718b2489b9949dc97c1680c3b1dcc26 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:41.029780 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5dcc6612c0d4fa6bfa32d2e0a9e1dbf', 'request_id': 'req-cf9459ca-b342-4a1b-9e1e-67372e6815f9'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:41.069913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5dcc6612c0d4fa6bfa32d2e0a9e1dbf', 'request_id': 'req-cf9459ca-b342-4a1b-9e1e-67372e6815f9'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:41.093622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5dcc6612c0d4fa6bfa32d2e0a9e1dbf', 'request_id': 'req-cf9459ca-b342-4a1b-9e1e-67372e6815f9'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:41.140117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] The token cache is being invalidate because project b5dcc6612c0d4fa6bfa32d2e0a9e1dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:02:41.140863 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:41.147173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:41.151289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 835/1664] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:02:40 2022] DELETE /identity/v3/projects/b5dcc6612c0d4fa6bfa32d2e0a9e1dbf => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:02:41.156418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab8134-5050-49e7-8fb7-6910f4fe5f9d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:41.156710 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab8134-5050-49e7-8fb7-6910f4fe5f9d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:41.156993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab8134-5050-49e7-8fb7-6910f4fe5f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:41.247224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-fbab8134-5050-49e7-8fb7-6910f4fe5f9d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:41.255079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fbab8134-5050-49e7-8fb7-6910f4fe5f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:41.260074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:41.262327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:41.424517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:41.463412 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:41.541903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9459ca-b342-4a1b-9e1e-67372e6815f9 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:41.553494 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 830/1665] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:41.557881 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:41.558434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c7f3b-bafa-42e3-b235-c4a0a2136a6e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:41.558556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:41.558874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:41.559067 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c7f3b-bafa-42e3-b235-c4a0a2136a6e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:41.559249 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] PATH_INFO: `/v3/projects/e6ea7bd601d9418782e43e132af07c9d` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:41.559617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c7f3b-bafa-42e3-b235-c4a0a2136a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:41.561251 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ea7bd601d9418782e43e132af07c9d)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:41.563395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:41.596970 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a77c7f3b-bafa-42e3-b235-c4a0a2136a6e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:41.598905 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a77c7f3b-bafa-42e3-b235-c4a0a2136a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:41.633079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 831/1666] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:41.634704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c7f3b-bafa-42e3-b235-c4a0a2136a6e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:41.651023 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c7f3b-bafa-42e3-b235-c4a0a2136a6e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:41.658326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ed97e-955f-49c4-9c8f-685c3b8db6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:41.658978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ed97e-955f-49c4-9c8f-685c3b8db6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:41.659417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ed97e-955f-49c4-9c8f-685c3b8db6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:41.659831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ed97e-955f-49c4-9c8f-685c3b8db6b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:41.660506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ed97e-955f-49c4-9c8f-685c3b8db6b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:02:41.661172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ed97e-955f-49c4-9c8f-685c3b8db6b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:41.663155 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ed97e-955f-49c4-9c8f-685c3b8db6b6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:41.719177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ea7bd601d9418782e43e132af07c9d', 'request_id': 'req-cc86c077-54bc-4388-a36a-98cbfcf2eda0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:41.725036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 832/1667] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:02:41.727981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ed97e-955f-49c4-9c8f-685c3b8db6b6 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:41.736004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ea7bd601d9418782e43e132af07c9d', 'request_id': 'req-cc86c077-54bc-4388-a36a-98cbfcf2eda0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:41.742261 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ed97e-955f-49c4-9c8f-685c3b8db6b6 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:41.755771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ea7bd601d9418782e43e132af07c9d', 'request_id': 'req-cc86c077-54bc-4388-a36a-98cbfcf2eda0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:41.793560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] The token cache is being invalidate because project e6ea7bd601d9418782e43e132af07c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:02:41.793901 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:41.796727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:41.799295 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 836/1668] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:02:41 2022] DELETE /identity/v3/projects/e6ea7bd601d9418782e43e132af07c9d => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:41.803688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:41.809060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:41.983919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86c077-54bc-4388-a36a-98cbfcf2eda0 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:41.987588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e05ee7-54d6-4105-b0d9-919519e91f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:41.988556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e05ee7-54d6-4105-b0d9-919519e91f86 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:41.988811 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e05ee7-54d6-4105-b0d9-919519e91f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:41.989103 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e05ee7-54d6-4105-b0d9-919519e91f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:41.991352 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e05ee7-54d6-4105-b0d9-919519e91f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:41.993487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e05ee7-54d6-4105-b0d9-919519e91f86 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:41.999507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a638e71-eb05-412a-904a-c93c07bce97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:42.000401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a638e71-eb05-412a-904a-c93c07bce97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:42.000871 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a638e71-eb05-412a-904a-c93c07bce97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:42.001247 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a638e71-eb05-412a-904a-c93c07bce97d admin admin] PATH_INFO: `/v3/users/0138ad70e90d4dcb887408f90d324e7a` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:42.002870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a638e71-eb05-412a-904a-c93c07bce97d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0138ad70e90d4dcb887408f90d324e7a)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:42.016089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a638e71-eb05-412a-904a-c93c07bce97d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:42.052463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 833/1669] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:41 2022] POST /identity/v3/projects => generated 405 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:42.053570 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e05ee7-54d6-4105-b0d9-919519e91f86 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:42.056032 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e8e05ee7-54d6-4105-b0d9-919519e91f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:42.102766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0a638e71-eb05-412a-904a-c93c07bce97d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0138ad70e90d4dcb887408f90d324e7a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.118537 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:42.129942 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0a638e71-eb05-412a-904a-c93c07bce97d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0138ad70e90d4dcb887408f90d324e7a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.156756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0a638e71-eb05-412a-904a-c93c07bce97d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0138ad70e90d4dcb887408f90d324e7a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.176573 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0a638e71-eb05-412a-904a-c93c07bce97d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0138ad70e90d4dcb887408f90d324e7a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.178748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0a638e71-eb05-412a-904a-c93c07bce97d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0138ad70e90d4dcb887408f90d324e7a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.211118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 837/1670] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:02:41 2022] DELETE /identity/v3/users/0138ad70e90d4dcb887408f90d324e7a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:02:42.324313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e05ee7-54d6-4105-b0d9-919519e91f86 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:42.477091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:42.494038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73a776-959d-4a01-b690-f508e34f324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:42.495063 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73a776-959d-4a01-b690-f508e34f324b admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:42.496539 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73a776-959d-4a01-b690-f508e34f324b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:42.496757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73a776-959d-4a01-b690-f508e34f324b admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:42.497368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73a776-959d-4a01-b690-f508e34f324b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:42.504142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73a776-959d-4a01-b690-f508e34f324b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:42.571932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 834/1671] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:42 2022] POST /identity/v3/users => generated 303 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:42.578125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a638e71-eb05-412a-904a-c93c07bce97d admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:42.579721 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0a638e71-eb05-412a-904a-c93c07bce97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:42.590624 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73a776-959d-4a01-b690-f508e34f324b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:42.595580 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7e73a776-959d-4a01-b690-f508e34f324b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:42.620487 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a638e71-eb05-412a-904a-c93c07bce97d admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:42.626626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73a776-959d-4a01-b690-f508e34f324b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:42.636421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bf8e8-c5db-43e6-b6a4-867184720392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:42.637106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bf8e8-c5db-43e6-b6a4-867184720392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:42.637387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bf8e8-c5db-43e6-b6a4-867184720392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:42.637662 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bf8e8-c5db-43e6-b6a4-867184720392 admin admin] PATH_INFO: `/v3/users/ed3f302056ec439da79e3b8bd048b3f6` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:42.638666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38c63d-845c-4a2b-b10e-95ec937a5bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:42.639322 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38c63d-845c-4a2b-b10e-95ec937a5bea admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:42.642293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38c63d-845c-4a2b-b10e-95ec937a5bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:42.642640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38c63d-845c-4a2b-b10e-95ec937a5bea admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:42.643338 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38c63d-845c-4a2b-b10e-95ec937a5bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:42.647509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bf8e8-c5db-43e6-b6a4-867184720392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3f302056ec439da79e3b8bd048b3f6)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:42.647679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38c63d-845c-4a2b-b10e-95ec937a5bea admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:42.649476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bf8e8-c5db-43e6-b6a4-867184720392 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:42.668561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 838/1672] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:42.672907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38c63d-845c-4a2b-b10e-95ec937a5bea admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:42.687475 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38c63d-845c-4a2b-b10e-95ec937a5bea admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:42.697138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fef25c-31ed-45df-849b-95b0b2987fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:42.699617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fef25c-31ed-45df-849b-95b0b2987fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:42.699961 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fef25c-31ed-45df-849b-95b0b2987fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:42.700751 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fef25c-31ed-45df-849b-95b0b2987fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:42.701739 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fef25c-31ed-45df-849b-95b0b2987fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:42.704928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fef25c-31ed-45df-849b-95b0b2987fb6 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:42.722233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 839/1673] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:42.737544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fef25c-31ed-45df-849b-95b0b2987fb6 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:42.768876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fef25c-31ed-45df-849b-95b0b2987fb6 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:42.788437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd7bf8e8-c5db-43e6-b6a4-867184720392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3f302056ec439da79e3b8bd048b3f6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.789617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd7bf8e8-c5db-43e6-b6a4-867184720392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3f302056ec439da79e3b8bd048b3f6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.793839 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd7bf8e8-c5db-43e6-b6a4-867184720392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3f302056ec439da79e3b8bd048b3f6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.797617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f6907-9340-42c8-a7a6-ea156f39ebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:42.798358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f6907-9340-42c8-a7a6-ea156f39ebc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:42.798580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f6907-9340-42c8-a7a6-ea156f39ebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:42.798872 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f6907-9340-42c8-a7a6-ea156f39ebc0 admin admin] PATH_INFO: `/v3/projects/a863e82461104a71a64e3094e138cf98/users/b7794ab3ff764f8487dea0ade9a09ef2/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:42.832394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd7bf8e8-c5db-43e6-b6a4-867184720392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3f302056ec439da79e3b8bd048b3f6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.852028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd7bf8e8-c5db-43e6-b6a4-867184720392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3f302056ec439da79e3b8bd048b3f6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:42.863556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f6907-9340-42c8-a7a6-ea156f39ebc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a863e82461104a71a64e3094e138cf98, user_id=b7794ab3ff764f8487dea0ade9a09ef2, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:42.866569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f6907-9340-42c8-a7a6-ea156f39ebc0 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:42.901901 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 840/1674] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:42 2022] PUT /identity/v3/projects/a863e82461104a71a64e3094e138cf98/users/b7794ab3ff764f8487dea0ade9a09ef2/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:42.906846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5f75-d771-495f-876e-094e1f1ee9f4 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:42.907130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5f75-d771-495f-876e-094e1f1ee9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:42.907404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5f75-d771-495f-876e-094e1f1ee9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:42.911533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 835/1675] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:02:42 2022] DELETE /identity/v3/users/ed3f302056ec439da79e3b8bd048b3f6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:42.916498 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a294de-ef88-4b63-b3d3-6cb0f535f9f1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:42.916898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a294de-ef88-4b63-b3d3-6cb0f535f9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:42.917205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a294de-ef88-4b63-b3d3-6cb0f535f9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:42.955291 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-811c5f75-d771-495f-876e-094e1f1ee9f4 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:42.956399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-811c5f75-d771-495f-876e-094e1f1ee9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:42.983039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-56a294de-ef88-4b63-b3d3-6cb0f535f9f1 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:42.985818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-56a294de-ef88-4b63-b3d3-6cb0f535f9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:43.101343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 841/1676] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:43.126685 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 836/1677] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:43.154723 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c5f75-d771-495f-876e-094e1f1ee9f4 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:43.156679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-811c5f75-d771-495f-876e-094e1f1ee9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:43.184248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a294de-ef88-4b63-b3d3-6cb0f535f9f1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:43.185864 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-56a294de-ef88-4b63-b3d3-6cb0f535f9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:43.334375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a294de-ef88-4b63-b3d3-6cb0f535f9f1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:43.343860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ac413-53e9-4ccb-bb8d-a35451c9b875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:43.344508 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac413-53e9-4ccb-bb8d-a35451c9b875 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:43.344781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac413-53e9-4ccb-bb8d-a35451c9b875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:43.345048 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac413-53e9-4ccb-bb8d-a35451c9b875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:43.366206 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ac413-53e9-4ccb-bb8d-a35451c9b875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:43.367671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ac413-53e9-4ccb-bb8d-a35451c9b875 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:43.368347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c5f75-d771-495f-876e-094e1f1ee9f4 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:43.383837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24e1ba-08a3-4465-a495-30baadcd5d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:43.383996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:43.384751 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24e1ba-08a3-4465-a495-30baadcd5d74 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:43.385323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24e1ba-08a3-4465-a495-30baadcd5d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:43.385875 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24e1ba-08a3-4465-a495-30baadcd5d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:43.395513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 837/1678] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:02:43.396530 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ac413-53e9-4ccb-bb8d-a35451c9b875 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:43.405520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9a4ac413-53e9-4ccb-bb8d-a35451c9b875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:43.407791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24e1ba-08a3-4465-a495-30baadcd5d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:43.413242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24e1ba-08a3-4465-a495-30baadcd5d74 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:43.433640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ac413-53e9-4ccb-bb8d-a35451c9b875 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:43.444453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf55772-ff12-4f30-9257-8241e7efdf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:43.445280 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf55772-ff12-4f30-9257-8241e7efdf49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:43.445616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf55772-ff12-4f30-9257-8241e7efdf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:43.445896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf55772-ff12-4f30-9257-8241e7efdf49 admin admin] PATH_INFO: `/v3/projects/e86b1a92585d4a8488fea38a2200a812` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:43.448354 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf55772-ff12-4f30-9257-8241e7efdf49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86b1a92585d4a8488fea38a2200a812)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:43.452525 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 842/1679] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:43.452829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf55772-ff12-4f30-9257-8241e7efdf49 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:43.587744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7bf55772-ff12-4f30-9257-8241e7efdf49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86b1a92585d4a8488fea38a2200a812', 'request_id': 'req-7bf55772-ff12-4f30-9257-8241e7efdf49'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:43.599191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7bf55772-ff12-4f30-9257-8241e7efdf49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86b1a92585d4a8488fea38a2200a812', 'request_id': 'req-7bf55772-ff12-4f30-9257-8241e7efdf49'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:43.617674 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7bf55772-ff12-4f30-9257-8241e7efdf49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86b1a92585d4a8488fea38a2200a812', 'request_id': 'req-7bf55772-ff12-4f30-9257-8241e7efdf49'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:43.645704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7bf55772-ff12-4f30-9257-8241e7efdf49 admin admin] The token cache is being invalidate because project e86b1a92585d4a8488fea38a2200a812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:02:43.645960 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7bf55772-ff12-4f30-9257-8241e7efdf49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:43.647090 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7bf55772-ff12-4f30-9257-8241e7efdf49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:43.652659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 838/1680] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:02:43 2022] DELETE /identity/v3/projects/e86b1a92585d4a8488fea38a2200a812 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:43.654353 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1f4c-ecc1-47cc-8e70-dca73db7da88 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:43.654844 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1f4c-ecc1-47cc-8e70-dca73db7da88 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:43.655130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1f4c-ecc1-47cc-8e70-dca73db7da88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:43.694906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-e0cb1f4c-ecc1-47cc-8e70-dca73db7da88 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:43.699961 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e0cb1f4c-ecc1-47cc-8e70-dca73db7da88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:43.814802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:43.894053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 843/1681] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:02:43.904084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d4ec-233d-4579-90ec-b079327a9753 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:43.904468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d4ec-233d-4579-90ec-b079327a9753 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:43.905175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d4ec-233d-4579-90ec-b079327a9753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:43.961606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0044d4ec-233d-4579-90ec-b079327a9753 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:43.965066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0044d4ec-233d-4579-90ec-b079327a9753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:43.991516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7ed62-78b9-46b7-8053-bb90ce5b4628 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:43.991831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7ed62-78b9-46b7-8053-bb90ce5b4628 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:43.992107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7ed62-78b9-46b7-8053-bb90ce5b4628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:44.004518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 839/1682] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:44.006313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d4ec-233d-4579-90ec-b079327a9753 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:44.038460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-33d7ed62-78b9-46b7-8053-bb90ce5b4628 None None] MFA Rules not processed for user `8d9a3c6d32dc495a8b9fdd85f8e54c13`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:44.040270 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-33d7ed62-78b9-46b7-8053-bb90ce5b4628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:44.041419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d4ec-233d-4579-90ec-b079327a9753 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:44.071110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ab5d1-8d3e-466a-bf19-dc9c61fd188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:44.072174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab5d1-8d3e-466a-bf19-dc9c61fd188b admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:44.072645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab5d1-8d3e-466a-bf19-dc9c61fd188b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:44.073086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab5d1-8d3e-466a-bf19-dc9c61fd188b admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:44.075532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ab5d1-8d3e-466a-bf19-dc9c61fd188b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:02:44.076804 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ab5d1-8d3e-466a-bf19-dc9c61fd188b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:44.081157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ab5d1-8d3e-466a-bf19-dc9c61fd188b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:44.115873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 840/1683] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:02:44.116994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ab5d1-8d3e-466a-bf19-dc9c61fd188b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:44.142295 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 844/1684] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:02:44.144323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff94e7-4f82-48f7-b662-d288d6403c74 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:44.144606 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff94e7-4f82-48f7-b662-d288d6403c74 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:44.144886 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff94e7-4f82-48f7-b662-d288d6403c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:44.146885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ab5d1-8d3e-466a-bf19-dc9c61fd188b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:44.152391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14030978-dca3-45e7-83bf-a804ebeab767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:44.155053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14030978-dca3-45e7-83bf-a804ebeab767 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:44.155805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14030978-dca3-45e7-83bf-a804ebeab767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:44.156728 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14030978-dca3-45e7-83bf-a804ebeab767 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:44.159057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14030978-dca3-45e7-83bf-a804ebeab767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:44.168292 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14030978-dca3-45e7-83bf-a804ebeab767 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:44.170088 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-3eff94e7-4f82-48f7-b662-d288d6403c74 None None] MFA Rules not processed for user `8d9a3c6d32dc495a8b9fdd85f8e54c13`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:44.172249 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3eff94e7-4f82-48f7-b662-d288d6403c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:44.184790 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 845/1685] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:44.197392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff94e7-4f82-48f7-b662-d288d6403c74 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:44.199670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3eff94e7-4f82-48f7-b662-d288d6403c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:44.237160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 841/1686] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:44 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:44.237160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14030978-dca3-45e7-83bf-a804ebeab767 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:44.240465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-14030978-dca3-45e7-83bf-a804ebeab767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:44.334893 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff94e7-4f82-48f7-b662-d288d6403c74 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:44.369282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14030978-dca3-45e7-83bf-a804ebeab767 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:44.375798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:44.376445 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:44.376823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:44.377191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] PATH_INFO: `/v3/projects/ef9aea1294b94fd5975ad4ec3a4aa77b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:44.378455 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef9aea1294b94fd5975ad4ec3a4aa77b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:44.381363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:44.468586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:44.481796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef9aea1294b94fd5975ad4ec3a4aa77b', 'request_id': 'req-d5385657-9e60-4aef-b2b6-01f67be92e9d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:44.489794 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:44.502812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef9aea1294b94fd5975ad4ec3a4aa77b', 'request_id': 'req-d5385657-9e60-4aef-b2b6-01f67be92e9d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:44.524425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef9aea1294b94fd5975ad4ec3a4aa77b', 'request_id': 'req-d5385657-9e60-4aef-b2b6-01f67be92e9d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:44.540290 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6709dc0-26cf-4e4a-bd8a-2bbdce957990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:44.542841 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6709dc0-26cf-4e4a-bd8a-2bbdce957990 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:44.543122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6709dc0-26cf-4e4a-bd8a-2bbdce957990 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:44.543397 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6709dc0-26cf-4e4a-bd8a-2bbdce957990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:44.567197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] The token cache is being invalidate because project ef9aea1294b94fd5975ad4ec3a4aa77b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:02:44.567585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:44.570774 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:44.577601 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 842/1687] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:02:44 2022] DELETE /identity/v3/projects/ef9aea1294b94fd5975ad4ec3a4aa77b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:44.577601 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:44.583379 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:44.702299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5385657-9e60-4aef-b2b6-01f67be92e9d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:44.712216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b459da1-c079-466d-8c66-be18564b805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:44.713095 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459da1-c079-466d-8c66-be18564b805d admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:44.713515 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459da1-c079-466d-8c66-be18564b805d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:44.713876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b459da1-c079-466d-8c66-be18564b805d admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:44.715582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b459da1-c079-466d-8c66-be18564b805d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:44.721336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b459da1-c079-466d-8c66-be18564b805d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:44.738051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6709dc0-26cf-4e4a-bd8a-2bbdce957990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:44.739737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6709dc0-26cf-4e4a-bd8a-2bbdce957990 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:44.762670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 843/1688] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:44 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:44.765714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fab44-4ebf-497a-8af7-ac6a8db590cf None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:44.766392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fab44-4ebf-497a-8af7-ac6a8db590cf None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:44.766875 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fab44-4ebf-497a-8af7-ac6a8db590cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:44.770894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 846/1689] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:44.772268 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6709dc0-26cf-4e4a-bd8a-2bbdce957990 service nova] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:44.795717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d91fab44-4ebf-497a-8af7-ac6a8db590cf None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:44.797682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d91fab44-4ebf-497a-8af7-ac6a8db590cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:44.800202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6709dc0-26cf-4e4a-bd8a-2bbdce957990 service nova] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:44.804779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d43d24-b66d-4684-8aec-fc443afcdff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:44.805511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d43d24-b66d-4684-8aec-fc443afcdff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:44.805895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d43d24-b66d-4684-8aec-fc443afcdff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:44.806167 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d43d24-b66d-4684-8aec-fc443afcdff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:44.808990 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 844/1690] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:44.818488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b0e3-7b34-4628-939e-5ab8480b257d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:44.818813 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b0e3-7b34-4628-939e-5ab8480b257d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:44.819091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b0e3-7b34-4628-939e-5ab8480b257d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:44.826002 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d43d24-b66d-4684-8aec-fc443afcdff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:44.827920 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d43d24-b66d-4684-8aec-fc443afcdff6 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:44.847299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 847/1691] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:44.851460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d43d24-b66d-4684-8aec-fc443afcdff6 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:44.852424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0ad2b0e3-7b34-4628-939e-5ab8480b257d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:44.853689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0ad2b0e3-7b34-4628-939e-5ab8480b257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:44.873577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 845/1692] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:44.877200 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2b0e3-7b34-4628-939e-5ab8480b257d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:44.884648 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d43d24-b66d-4684-8aec-fc443afcdff6 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:44.888814 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2b0e3-7b34-4628-939e-5ab8480b257d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:44.894418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35ad55-20e1-4a4b-bee0-84d26d5cc704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:44.894884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e447e06-01cc-4aa1-8e55-731ecc376fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:44.895767 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447e06-01cc-4aa1-8e55-731ecc376fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:44.896140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447e06-01cc-4aa1-8e55-731ecc376fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:44.896629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447e06-01cc-4aa1-8e55-731ecc376fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:44.897362 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e447e06-01cc-4aa1-8e55-731ecc376fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:02:44.897741 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ad55-20e1-4a4b-bee0-84d26d5cc704 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:44.897912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e447e06-01cc-4aa1-8e55-731ecc376fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:44.898347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ad55-20e1-4a4b-bee0-84d26d5cc704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:44.899391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ad55-20e1-4a4b-bee0-84d26d5cc704 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:44.900183 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e447e06-01cc-4aa1-8e55-731ecc376fb8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:44.903664 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35ad55-20e1-4a4b-bee0-84d26d5cc704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:44.906151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35ad55-20e1-4a4b-bee0-84d26d5cc704 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:44.922647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 846/1693] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:02:44.926084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e447e06-01cc-4aa1-8e55-731ecc376fb8 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:44.941387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 848/1694] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:44.942543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35ad55-20e1-4a4b-bee0-84d26d5cc704 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:44.956800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e447e06-01cc-4aa1-8e55-731ecc376fb8 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:44.967843 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35ad55-20e1-4a4b-bee0-84d26d5cc704 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:44.972642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5a758-0bb0-48a2-87cd-d2a4f4fe640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:44.973610 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5a758-0bb0-48a2-87cd-d2a4f4fe640e admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:44.974150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5a758-0bb0-48a2-87cd-d2a4f4fe640e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:44.978670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5a758-0bb0-48a2-87cd-d2a4f4fe640e admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:44.980120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5a758-0bb0-48a2-87cd-d2a4f4fe640e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:44.983420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5a758-0bb0-48a2-87cd-d2a4f4fe640e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:44.989660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15431d81-1164-4dc5-b37d-68b0b1f352a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:44.990483 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15431d81-1164-4dc5-b37d-68b0b1f352a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:44.991138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15431d81-1164-4dc5-b37d-68b0b1f352a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:44.991524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15431d81-1164-4dc5-b37d-68b0b1f352a1 admin admin] PATH_INFO: `/v3/projects/3638bcea20004b85ad05ba583867f566/users/07069c5644ce4e1b93afce0805187286/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:45.035392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15431d81-1164-4dc5-b37d-68b0b1f352a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3638bcea20004b85ad05ba583867f566, user_id=07069c5644ce4e1b93afce0805187286, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:45.039692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15431d81-1164-4dc5-b37d-68b0b1f352a1 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:45.064872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 847/1695] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:44 2022] POST /identity/v3/projects => generated 357 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:45.072125 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5a758-0bb0-48a2-87cd-d2a4f4fe640e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:45.101182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 849/1696] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:44 2022] PUT /identity/v3/projects/3638bcea20004b85ad05ba583867f566/users/07069c5644ce4e1b93afce0805187286/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:45.105829 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f107f4-0732-4d45-82c7-752c60caa48c None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:45.106159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f107f4-0732-4d45-82c7-752c60caa48c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:45.106660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f107f4-0732-4d45-82c7-752c60caa48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:45.190144 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-36f107f4-0732-4d45-82c7-752c60caa48c None None] MFA Rules not processed for user `07069c5644ce4e1b93afce0805187286`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:45.194575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-36f107f4-0732-4d45-82c7-752c60caa48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:45.275208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5a758-0bb0-48a2-87cd-d2a4f4fe640e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:45.320029 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:45.371828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 850/1697] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:45.376010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f107f4-0732-4d45-82c7-752c60caa48c None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:45.441510 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005f64b-e4bd-4d90-8dd4-69c492dd0626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:45.442082 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005f64b-e4bd-4d90-8dd4-69c492dd0626 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:45.442358 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005f64b-e4bd-4d90-8dd4-69c492dd0626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:45.443153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005f64b-e4bd-4d90-8dd4-69c492dd0626 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:45.443934 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005f64b-e4bd-4d90-8dd4-69c492dd0626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:45.451379 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005f64b-e4bd-4d90-8dd4-69c492dd0626 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:45.501127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:45.505295 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 848/1698] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:45 2022] POST /identity/v3/users => generated 279 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:45.508127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005f64b-e4bd-4d90-8dd4-69c492dd0626 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:45.532748 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005f64b-e4bd-4d90-8dd4-69c492dd0626 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:45.550348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f107f4-0732-4d45-82c7-752c60caa48c None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:45.554072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7b6e7-46d3-4651-9475-be081a1ea690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:45.554751 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7b6e7-46d3-4651-9475-be081a1ea690 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:45.555582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7b6e7-46d3-4651-9475-be081a1ea690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:45.555582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7b6e7-46d3-4651-9475-be081a1ea690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:45.555955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7b6e7-46d3-4651-9475-be081a1ea690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:45.557649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7b6e7-46d3-4651-9475-be081a1ea690 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:45.558221 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f310541-f972-4a99-9163-4dc0c86bee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:45.559106 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310541-f972-4a99-9163-4dc0c86bee0f admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:45.559537 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310541-f972-4a99-9163-4dc0c86bee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:45.560227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f310541-f972-4a99-9163-4dc0c86bee0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:45.561025 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f310541-f972-4a99-9163-4dc0c86bee0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:45.563206 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f310541-f972-4a99-9163-4dc0c86bee0f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:45.590663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 849/1699] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:45.593851 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7b6e7-46d3-4651-9475-be081a1ea690 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:45.617096 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7b6e7-46d3-4651-9475-be081a1ea690 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:45.627261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 851/1700] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:45 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:02:45.628511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f310541-f972-4a99-9163-4dc0c86bee0f admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:45.630550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda32ab-b6f0-4c6d-9b7d-71e4793d34fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:45.631467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda32ab-b6f0-4c6d-9b7d-71e4793d34fe admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:45.632202 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda32ab-b6f0-4c6d-9b7d-71e4793d34fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:45.632626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda32ab-b6f0-4c6d-9b7d-71e4793d34fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:45.634045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda32ab-b6f0-4c6d-9b7d-71e4793d34fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:45.635953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda32ab-b6f0-4c6d-9b7d-71e4793d34fe admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:45.648699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 850/1701] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:45.656760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda32ab-b6f0-4c6d-9b7d-71e4793d34fe admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:45.670098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda32ab-b6f0-4c6d-9b7d-71e4793d34fe admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:45.748599 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f310541-f972-4a99-9163-4dc0c86bee0f admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:45.755105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd950eb-60fa-4f72-a925-44f07d29e5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:45.756002 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd950eb-60fa-4f72-a925-44f07d29e5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:45.756553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd950eb-60fa-4f72-a925-44f07d29e5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:45.756837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd950eb-60fa-4f72-a925-44f07d29e5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:45.757656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd950eb-60fa-4f72-a925-44f07d29e5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:45.760706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd950eb-60fa-4f72-a925-44f07d29e5c6 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:45.806655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 852/1702] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:45 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:02:45.810064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd950eb-60fa-4f72-a925-44f07d29e5c6 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:45.837269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd950eb-60fa-4f72-a925-44f07d29e5c6 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:45.839560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190371f1-e1d2-4d97-a00a-e5d8ab1f1ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:45.840844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190371f1-e1d2-4d97-a00a-e5d8ab1f1ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:45.841141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190371f1-e1d2-4d97-a00a-e5d8ab1f1ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:45.841420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190371f1-e1d2-4d97-a00a-e5d8ab1f1ecc admin admin] PATH_INFO: `/v3/projects/3760d9c63dc14f8baa7813c3b2fe095c/users/cca60fde7818417385653103062fc18f/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:45.853968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c40d70-ec32-4c9a-9274-af5456557b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:45.854642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c40d70-ec32-4c9a-9274-af5456557b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:45.854930 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c40d70-ec32-4c9a-9274-af5456557b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:45.855200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c40d70-ec32-4c9a-9274-af5456557b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:45.855873 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c40d70-ec32-4c9a-9274-af5456557b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:45.857529 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c40d70-ec32-4c9a-9274-af5456557b17 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:45.871573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190371f1-e1d2-4d97-a00a-e5d8ab1f1ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3760d9c63dc14f8baa7813c3b2fe095c, user_id=cca60fde7818417385653103062fc18f, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:45.875257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190371f1-e1d2-4d97-a00a-e5d8ab1f1ecc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:45.885552 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 853/1703] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:45.889623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c40d70-ec32-4c9a-9274-af5456557b17 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:45.902581 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 851/1704] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:45 2022] PUT /identity/v3/projects/3760d9c63dc14f8baa7813c3b2fe095c/users/cca60fde7818417385653103062fc18f/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:45.911676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7404-434f-4e51-999e-7fd84f43fbef None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:45.911961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7404-434f-4e51-999e-7fd84f43fbef None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:45.912239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7404-434f-4e51-999e-7fd84f43fbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:45.932045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c40d70-ec32-4c9a-9274-af5456557b17 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:45.959327 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f45f7404-434f-4e51-999e-7fd84f43fbef None None] MFA Rules not processed for user `cca60fde7818417385653103062fc18f`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:45.961068 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f45f7404-434f-4e51-999e-7fd84f43fbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:46.086253 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290918a-e8d8-4e8f-bd22-718cef4f0260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:46.086985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290918a-e8d8-4e8f-bd22-718cef4f0260 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:46.087263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290918a-e8d8-4e8f-bd22-718cef4f0260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:46.087539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290918a-e8d8-4e8f-bd22-718cef4f0260 admin admin] PATH_INFO: `/v3/projects/8195cee699494f1a8eee645eb332b686/users/50832141e399411aafc18b91112d368c/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:46.142668 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290918a-e8d8-4e8f-bd22-718cef4f0260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8195cee699494f1a8eee645eb332b686, user_id=50832141e399411aafc18b91112d368c, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:46.149588 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290918a-e8d8-4e8f-bd22-718cef4f0260 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:46.166029 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:46.182100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 852/1705] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:02:46.185627 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 854/1706] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:45 2022] PUT /identity/v3/projects/8195cee699494f1a8eee645eb332b686/users/50832141e399411aafc18b91112d368c/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:02:46.189784 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290918a-e8d8-4e8f-bd22-718cef4f0260 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:46.190127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f7404-434f-4e51-999e-7fd84f43fbef None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:46.224691 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f7404-434f-4e51-999e-7fd84f43fbef None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:46.262836 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:46.349364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003f863-a9c7-4750-80b4-6caae82951ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:46.353870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f863-a9c7-4750-80b4-6caae82951ba admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:46.356025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f863-a9c7-4750-80b4-6caae82951ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:46.357304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f863-a9c7-4750-80b4-6caae82951ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:46.360563 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003f863-a9c7-4750-80b4-6caae82951ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:46.364160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003f863-a9c7-4750-80b4-6caae82951ba admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:46.381957 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290918a-e8d8-4e8f-bd22-718cef4f0260 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:46.397227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b5951-ff61-42be-ad32-2fa89464817a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:46.399258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b5951-ff61-42be-ad32-2fa89464817a admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:46.399764 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b5951-ff61-42be-ad32-2fa89464817a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:46.400237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b5951-ff61-42be-ad32-2fa89464817a admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:46.403306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b5951-ff61-42be-ad32-2fa89464817a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:46.414369 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b5951-ff61-42be-ad32-2fa89464817a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:46.452953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 853/1707] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:46 2022] POST /identity/v3/projects => generated 355 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:46.453478 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 855/1708] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:46.455272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b5951-ff61-42be-ad32-2fa89464817a admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:46.456780 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003f863-a9c7-4750-80b4-6caae82951ba admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:46.465622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2003f863-a9c7-4750-80b4-6caae82951ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:46.481150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b5951-ff61-42be-ad32-2fa89464817a admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:46.633750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003f863-a9c7-4750-80b4-6caae82951ba admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:46.635245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ef79a-1219-454e-8f74-9a9f43e799c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:46.636361 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef79a-1219-454e-8f74-9a9f43e799c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:46.637458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef79a-1219-454e-8f74-9a9f43e799c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:46.637849 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ef79a-1219-454e-8f74-9a9f43e799c5 admin admin] PATH_INFO: `/v3/projects/8195cee699494f1a8eee645eb332b686/users/50832141e399411aafc18b91112d368c/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:46.643263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ef79a-1219-454e-8f74-9a9f43e799c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8195cee699494f1a8eee645eb332b686, user_id=50832141e399411aafc18b91112d368c, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:46.647489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:46.648855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:46.650066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ef79a-1219-454e-8f74-9a9f43e799c5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:46.650567 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:46.650974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0 admin admin] PATH_INFO: `/v3/projects/294c0515116649c284445edf4715060d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:46.655834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=294c0515116649c284445edf4715060d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:46.659776 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:46.691051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 856/1709] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:46 2022] PUT /identity/v3/projects/8195cee699494f1a8eee645eb332b686/users/50832141e399411aafc18b91112d368c/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:46.692187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ef79a-1219-454e-8f74-9a9f43e799c5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:46.792257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294c0515116649c284445edf4715060d', 'request_id': 'req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:46.808940 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294c0515116649c284445edf4715060d', 'request_id': 'req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:46.825733 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294c0515116649c284445edf4715060d', 'request_id': 'req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:46.865504 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0 admin admin] The token cache is being invalidate because project 294c0515116649c284445edf4715060d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:02:46.866137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:46.867879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ef79a-1219-454e-8f74-9a9f43e799c5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:46.869347 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-cf45a7b4-5538-4a30-8212-23dcf7bb2eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:46.874289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 854/1710] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:02:46 2022] DELETE /identity/v3/projects/294c0515116649c284445edf4715060d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:46.875835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809b80f-861b-4474-be1b-6bed0e7ed6c6 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:46.878544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809b80f-861b-4474-be1b-6bed0e7ed6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:46.878991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809b80f-861b-4474-be1b-6bed0e7ed6c6 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:46.887209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 855/1711] 10.222.0.77 () {54 vars in 912 bytes} [Mon Aug 22 16:02:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:02:46.888906 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27b895-e1ce-4da0-bd68-d3c01604eb55 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:46.891391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27b895-e1ce-4da0-bd68-d3c01604eb55 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:46.892099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27b895-e1ce-4da0-bd68-d3c01604eb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:46.966529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8a27b895-e1ce-4da0-bd68-d3c01604eb55 None None] MFA Rules not processed for user `50832141e399411aafc18b91112d368c`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:46.968097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8a27b895-e1ce-4da0-bd68-d3c01604eb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:46.981144 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:47.033424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3993a8f-90fb-457b-a9e1-5e2dc2528a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:47.035208 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993a8f-90fb-457b-a9e1-5e2dc2528a20 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:47.035598 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993a8f-90fb-457b-a9e1-5e2dc2528a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:47.036972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993a8f-90fb-457b-a9e1-5e2dc2528a20 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:47.038516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3993a8f-90fb-457b-a9e1-5e2dc2528a20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:47.044044 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3993a8f-90fb-457b-a9e1-5e2dc2528a20 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:47.073366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:47.103393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 857/1712] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:46 2022] POST /identity/v3/users => generated 284 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:47.105153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf735d95-ad78-452f-99a0-4b843027238d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:47.105538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf735d95-ad78-452f-99a0-4b843027238d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:47.105910 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf735d95-ad78-452f-99a0-4b843027238d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:47.180024 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-cf735d95-ad78-452f-99a0-4b843027238d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:47.186276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-cf735d95-ad78-452f-99a0-4b843027238d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:47.193447 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 856/1713] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:47.195757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a23e63-fb0e-45b3-826b-911c005030bb None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:47.196230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a23e63-fb0e-45b3-826b-911c005030bb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:47.196664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a23e63-fb0e-45b3-826b-911c005030bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:47.224804 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 858/1714] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:47.225694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf735d95-ad78-452f-99a0-4b843027238d None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:47.233800 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-cf735d95-ad78-452f-99a0-4b843027238d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:47.269338 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf735d95-ad78-452f-99a0-4b843027238d None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:47.281953 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823cbce-58cc-4cdf-a50b-24313e1e25ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:47.282559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823cbce-58cc-4cdf-a50b-24313e1e25ed admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:47.282874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823cbce-58cc-4cdf-a50b-24313e1e25ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:47.283150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823cbce-58cc-4cdf-a50b-24313e1e25ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:47.283817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823cbce-58cc-4cdf-a50b-24313e1e25ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:47.285469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823cbce-58cc-4cdf-a50b-24313e1e25ed admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:47.286442 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-85a23e63-fb0e-45b3-826b-911c005030bb None None] MFA Rules not processed for user `104abc0b38524a2f95ffe96c5872362c`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:47.289586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-85a23e63-fb0e-45b3-826b-911c005030bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:47.333251 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 859/1715] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:47.336237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823cbce-58cc-4cdf-a50b-24313e1e25ed admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:47.340083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d823cbce-58cc-4cdf-a50b-24313e1e25ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:47.408335 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 857/1716] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 16:02:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:47.412073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc0908-8fdb-4b18-a5e5-c87d11dc077d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:47.412392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc0908-8fdb-4b18-a5e5-c87d11dc077d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:47.412674 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc0908-8fdb-4b18-a5e5-c87d11dc077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:47.442640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-dfdc0908-8fdb-4b18-a5e5-c87d11dc077d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:47.443945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-dfdc0908-8fdb-4b18-a5e5-c87d11dc077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:47.473148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 858/1717] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:47.475523 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc0908-8fdb-4b18-a5e5-c87d11dc077d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:47.487879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc0908-8fdb-4b18-a5e5-c87d11dc077d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:47.494242 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf56a0a-9699-42da-bf49-6ad2fc4f5839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:47.494936 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf56a0a-9699-42da-bf49-6ad2fc4f5839 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:47.495214 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf56a0a-9699-42da-bf49-6ad2fc4f5839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:47.495488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf56a0a-9699-42da-bf49-6ad2fc4f5839 admin admin] PATH_INFO: `/v3/projects/e19c4d554d734cb7affd9e89158ed21d/users/d46aaeb14bd241dea9bd3678b1db8a39/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:47.495790 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823cbce-58cc-4cdf-a50b-24313e1e25ed admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:47.510004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78000fb-fe3d-4407-8d4e-646a5a8aa0ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:47.511087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78000fb-fe3d-4407-8d4e-646a5a8aa0ff service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:47.511374 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78000fb-fe3d-4407-8d4e-646a5a8aa0ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:47.511984 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78000fb-fe3d-4407-8d4e-646a5a8aa0ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:47.514888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf56a0a-9699-42da-bf49-6ad2fc4f5839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19c4d554d734cb7affd9e89158ed21d, user_id=d46aaeb14bd241dea9bd3678b1db8a39, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:47.517776 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf56a0a-9699-42da-bf49-6ad2fc4f5839 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:47.535972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78000fb-fe3d-4407-8d4e-646a5a8aa0ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:47.537581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78000fb-fe3d-4407-8d4e-646a5a8aa0ff service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:47.540349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 859/1718] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:47 2022] PUT /identity/v3/projects/e19c4d554d734cb7affd9e89158ed21d/users/d46aaeb14bd241dea9bd3678b1db8a39/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:47.541582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf56a0a-9699-42da-bf49-6ad2fc4f5839 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:47.547091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-abf56a0a-9699-42da-bf49-6ad2fc4f5839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:47.567728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 860/1719] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:47.568661 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78000fb-fe3d-4407-8d4e-646a5a8aa0ff service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:47.591845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78000fb-fe3d-4407-8d4e-646a5a8aa0ff service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:47.668663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf56a0a-9699-42da-bf49-6ad2fc4f5839 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:47.679670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b9475-3f89-413a-9e15-fc41d92f6aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:47.680315 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b9475-3f89-413a-9e15-fc41d92f6aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:47.680595 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b9475-3f89-413a-9e15-fc41d92f6aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:47.680856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b9475-3f89-413a-9e15-fc41d92f6aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:47.699703 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b9475-3f89-413a-9e15-fc41d92f6aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:47.701550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b9475-3f89-413a-9e15-fc41d92f6aa1 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:47.720049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb048cb-d781-48cf-b2b0-4afe2a9512cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:47.720685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb048cb-d781-48cf-b2b0-4afe2a9512cc admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:47.720962 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb048cb-d781-48cf-b2b0-4afe2a9512cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:47.721231 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb048cb-d781-48cf-b2b0-4afe2a9512cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:47.721905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb048cb-d781-48cf-b2b0-4afe2a9512cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:02:47.722197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb048cb-d781-48cf-b2b0-4afe2a9512cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:47.724587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb048cb-d781-48cf-b2b0-4afe2a9512cc admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:47.724851 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 860/1720] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:47.725786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b9475-3f89-413a-9e15-fc41d92f6aa1 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:47.757283 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b9475-3f89-413a-9e15-fc41d92f6aa1 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:47.766044 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 861/1721] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:02:47.767903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb048cb-d781-48cf-b2b0-4afe2a9512cc admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:47.771490 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-deb048cb-d781-48cf-b2b0-4afe2a9512cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:47.778098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e145af7-4774-4b71-bd07-06b8ca20bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:47.778763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e145af7-4774-4b71-bd07-06b8ca20bb45 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:47.779041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e145af7-4774-4b71-bd07-06b8ca20bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:47.779311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e145af7-4774-4b71-bd07-06b8ca20bb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:47.779968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e145af7-4774-4b71-bd07-06b8ca20bb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:47.781595 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e145af7-4774-4b71-bd07-06b8ca20bb45 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:47.799391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:47.808813 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb048cb-d781-48cf-b2b0-4afe2a9512cc admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:47.819907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 861/1722] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:47.820773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e145af7-4774-4b71-bd07-06b8ca20bb45 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:47.874914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e145af7-4774-4b71-bd07-06b8ca20bb45 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:47.889123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dc645-c542-4e69-bfae-f2322682b965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:47.890470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dc645-c542-4e69-bfae-f2322682b965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:47.890995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dc645-c542-4e69-bfae-f2322682b965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:47.897704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dc645-c542-4e69-bfae-f2322682b965 admin admin] PATH_INFO: `/v3/users/07069c5644ce4e1b93afce0805187286` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:47.898682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9524d-c882-40a5-b7ba-d921178fdc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:47.899433 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9524d-c882-40a5-b7ba-d921178fdc69 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:47.899725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9524d-c882-40a5-b7ba-d921178fdc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:47.900000 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9524d-c882-40a5-b7ba-d921178fdc69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:47.900153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dc645-c542-4e69-bfae-f2322682b965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07069c5644ce4e1b93afce0805187286)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:47.900710 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9524d-c882-40a5-b7ba-d921178fdc69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:47.909158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9524d-c882-40a5-b7ba-d921178fdc69 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:47.911357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dc645-c542-4e69-bfae-f2322682b965 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:47.983349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 862/1723] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:47 2022] POST /identity/v3/projects => generated 367 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:47.988806 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9524d-c882-40a5-b7ba-d921178fdc69 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:48.024148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-f29dc645-c542-4e69-bfae-f2322682b965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07069c5644ce4e1b93afce0805187286'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:48.065850 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:48.080910 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-f29dc645-c542-4e69-bfae-f2322682b965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07069c5644ce4e1b93afce0805187286'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:48.097237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-f29dc645-c542-4e69-bfae-f2322682b965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07069c5644ce4e1b93afce0805187286'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:48.114027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-f29dc645-c542-4e69-bfae-f2322682b965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07069c5644ce4e1b93afce0805187286'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:48.114511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-f29dc645-c542-4e69-bfae-f2322682b965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07069c5644ce4e1b93afce0805187286'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:48.124900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 862/1724] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:02:47 2022] DELETE /identity/v3/users/07069c5644ce4e1b93afce0805187286 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:48.126130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dc645-c542-4e69-bfae-f2322682b965 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:48.135769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f29dc645-c542-4e69-bfae-f2322682b965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:48.161744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9524d-c882-40a5-b7ba-d921178fdc69 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:48.264845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091f678-da3f-4452-98b5-4782a6b89867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:48.265745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091f678-da3f-4452-98b5-4782a6b89867 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:48.266028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091f678-da3f-4452-98b5-4782a6b89867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:48.267057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091f678-da3f-4452-98b5-4782a6b89867 admin admin] PATH_INFO: `/v3/projects/e19c4d554d734cb7affd9e89158ed21d/users/d46aaeb14bd241dea9bd3678b1db8a39/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:48.273633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091f678-da3f-4452-98b5-4782a6b89867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19c4d554d734cb7affd9e89158ed21d, user_id=d46aaeb14bd241dea9bd3678b1db8a39, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:48.276542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091f678-da3f-4452-98b5-4782a6b89867 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:48.293199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 863/1725] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:47 2022] PUT /identity/v3/projects/e19c4d554d734cb7affd9e89158ed21d/users/d46aaeb14bd241dea9bd3678b1db8a39/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:48.305704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebfdde-0f66-433b-9d4a-bccb4aac008c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:48.305987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebfdde-0f66-433b-9d4a-bccb4aac008c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:48.306263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebfdde-0f66-433b-9d4a-bccb4aac008c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:48.307466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dc645-c542-4e69-bfae-f2322682b965 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:48.361585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-74ebfdde-0f66-433b-9d4a-bccb4aac008c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:48.363296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-74ebfdde-0f66-433b-9d4a-bccb4aac008c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:48.445012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be1ef9-aa7b-4677-b17c-d7d12aaa968c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:48.445659 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be1ef9-aa7b-4677-b17c-d7d12aaa968c admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:48.445938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be1ef9-aa7b-4677-b17c-d7d12aaa968c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:48.446209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be1ef9-aa7b-4677-b17c-d7d12aaa968c admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:48.447406 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be1ef9-aa7b-4677-b17c-d7d12aaa968c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:48.449151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be1ef9-aa7b-4677-b17c-d7d12aaa968c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:48.495288 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 863/1726] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:48 2022] POST /identity/v3/users => generated 284 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:48.496744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f0090-c7ed-4753-b9c4-b53e179dda1d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:48.497038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f0090-c7ed-4753-b9c4-b53e179dda1d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:48.497316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f0090-c7ed-4753-b9c4-b53e179dda1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:48.503481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 864/1727] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:48.504933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a88ca-6e59-4956-b839-1808e284315d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:48.505747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a88ca-6e59-4956-b839-1808e284315d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:48.505747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a88ca-6e59-4956-b839-1808e284315d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:48.593845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-a37f0090-c7ed-4753-b9c4-b53e179dda1d None None] MFA Rules not processed for user `b7794ab3ff764f8487dea0ade9a09ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:48.595212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a37f0090-c7ed-4753-b9c4-b53e179dda1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:48.600283 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-924a88ca-6e59-4956-b839-1808e284315d None None] MFA Rules not processed for user `d46aaeb14bd241dea9bd3678b1db8a39`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:48.601660 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-924a88ca-6e59-4956-b839-1808e284315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:48.636034 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:48.833500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 864/1728] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:48 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:48.833500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f0090-c7ed-4753-b9c4-b53e179dda1d None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:48.863577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 865/1729] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:48.865129 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a88ca-6e59-4956-b839-1808e284315d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:48.871054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-924a88ca-6e59-4956-b839-1808e284315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:48.877569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f0090-c7ed-4753-b9c4-b53e179dda1d None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:48.898651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e479e1-a9ed-4760-bf70-265c6c6e2de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:48.899905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e479e1-a9ed-4760-bf70-265c6c6e2de2 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:48.900412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e479e1-a9ed-4760-bf70-265c6c6e2de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:48.901160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e479e1-a9ed-4760-bf70-265c6c6e2de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:48.903953 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e479e1-a9ed-4760-bf70-265c6c6e2de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:48.905772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e479e1-a9ed-4760-bf70-265c6c6e2de2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:48.910028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:48.940584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 865/1730] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:48.948882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06efe1-2ab9-4339-8ca7-92b6ad9eb515 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:48.949186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06efe1-2ab9-4339-8ca7-92b6ad9eb515 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:48.949436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06efe1-2ab9-4339-8ca7-92b6ad9eb515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:49.046523 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-ba06efe1-2ab9-4339-8ca7-92b6ad9eb515 None None] MFA Rules not processed for user `4d3445e9462b42cd82ea10ed54193c89`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:49.047825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ba06efe1-2ab9-4339-8ca7-92b6ad9eb515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:49.066777 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a88ca-6e59-4956-b839-1808e284315d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:49.080934 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd319e6e-5af7-45b1-8300-38d7470db662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:49.085746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319e6e-5af7-45b1-8300-38d7470db662 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:49.086039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319e6e-5af7-45b1-8300-38d7470db662 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:49.087614 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319e6e-5af7-45b1-8300-38d7470db662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:49.131168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd319e6e-5af7-45b1-8300-38d7470db662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:49.132650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd319e6e-5af7-45b1-8300-38d7470db662 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:49.170284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 866/1731] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:49.172909 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd319e6e-5af7-45b1-8300-38d7470db662 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:49.174644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cd319e6e-5af7-45b1-8300-38d7470db662 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:49.204684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd319e6e-5af7-45b1-8300-38d7470db662 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:49.220833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8cbb8-de85-4348-be06-cfb7a025b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:49.221474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cbb8-de85-4348-be06-cfb7a025b7da admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:49.221753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cbb8-de85-4348-be06-cfb7a025b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:49.222036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cbb8-de85-4348-be06-cfb7a025b7da admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:49.222714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8cbb8-de85-4348-be06-cfb7a025b7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:49.238762 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8cbb8-de85-4348-be06-cfb7a025b7da admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:49.256794 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 866/1732] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:49.266378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06efe1-2ab9-4339-8ca7-92b6ad9eb515 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:49.268198 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ba06efe1-2ab9-4339-8ca7-92b6ad9eb515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:49.302915 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 867/1733] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:49 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:49.303741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8cbb8-de85-4348-be06-cfb7a025b7da admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:49.392780 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06efe1-2ab9-4339-8ca7-92b6ad9eb515 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:49.459632 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8cbb8-de85-4348-be06-cfb7a025b7da admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:49.476752 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3be09d-720c-4af2-b6e5-22e85f026cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:49.477700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3be09d-720c-4af2-b6e5-22e85f026cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:49.479041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3be09d-720c-4af2-b6e5-22e85f026cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:49.480766 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3be09d-720c-4af2-b6e5-22e85f026cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:49.483505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3be09d-720c-4af2-b6e5-22e85f026cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:49.492828 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3be09d-720c-4af2-b6e5-22e85f026cd8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:49.510382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c79e5-5b01-41d5-a24c-1e586276adf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:49.511299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c79e5-5b01-41d5-a24c-1e586276adf6 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:49.512655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c79e5-5b01-41d5-a24c-1e586276adf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:49.513547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c79e5-5b01-41d5-a24c-1e586276adf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:49.520996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 868/1734] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:49.525448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72382a1-08fa-4a18-bfdb-5564ca69f3ce None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:49.526237 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72382a1-08fa-4a18-bfdb-5564ca69f3ce None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:49.528073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72382a1-08fa-4a18-bfdb-5564ca69f3ce None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:49.529838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 869/1735] 10.222.0.77 () {54 vars in 961 bytes} [Mon Aug 22 16:02:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:02:49.533805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72382a1-08fa-4a18-bfdb-5564ca69f3ce None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:49.540750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a72382a1-08fa-4a18-bfdb-5564ca69f3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:49.582805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:49.601143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:49.617324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c79e5-5b01-41d5-a24c-1e586276adf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:49.619003 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c79e5-5b01-41d5-a24c-1e586276adf6 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:49.631358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 867/1736] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:49.632823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c79e5-5b01-41d5-a24c-1e586276adf6 service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:49.648275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c79e5-5b01-41d5-a24c-1e586276adf6 service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:49.656926 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ccf4f-7280-4c58-a2ef-d687716bcc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:49.657858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ccf4f-7280-4c58-a2ef-d687716bcc44 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:49.658271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ccf4f-7280-4c58-a2ef-d687716bcc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:49.659487 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ccf4f-7280-4c58-a2ef-d687716bcc44 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:49.660393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ccf4f-7280-4c58-a2ef-d687716bcc44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:49.664135 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ccf4f-7280-4c58-a2ef-d687716bcc44 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:49.673557 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72382a1-08fa-4a18-bfdb-5564ca69f3ce None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:49.680957 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed102ca-a5f4-471e-96d9-10221c3e2494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:49.681543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed102ca-a5f4-471e-96d9-10221c3e2494 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:49.681869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed102ca-a5f4-471e-96d9-10221c3e2494 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:49.682125 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed102ca-a5f4-471e-96d9-10221c3e2494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:49.705834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 868/1737] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:49 2022] POST /identity/v3/users => generated 308 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:49.705834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588308-77bd-4868-a40e-754206ca61d2 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:49.705834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588308-77bd-4868-a40e-754206ca61d2 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:49.705834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588308-77bd-4868-a40e-754206ca61d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:49.772542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed102ca-a5f4-471e-96d9-10221c3e2494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:49.774258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed102ca-a5f4-471e-96d9-10221c3e2494 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:49.782794 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-13588308-77bd-4868-a40e-754206ca61d2 None None] MFA Rules not processed for user `9c75b97977c2433fb27aa21e4f82ce2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:49.785094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-13588308-77bd-4868-a40e-754206ca61d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:49.803119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 870/1738] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:49.804335 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed102ca-a5f4-471e-96d9-10221c3e2494 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:49.827848 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed102ca-a5f4-471e-96d9-10221c3e2494 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:49.840286 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1b83a-7ce9-4ca4-9991-eecb1c4dfb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:49.841064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b83a-7ce9-4ca4-9991-eecb1c4dfb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:49.841422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b83a-7ce9-4ca4-9991-eecb1c4dfb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:49.841763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b83a-7ce9-4ca4-9991-eecb1c4dfb83 admin admin] PATH_INFO: `/v3/projects/4795b399d75c49008168fcf00f9ce483/users/f574cc1862284257bf16514d4c328f6a/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:49.887027 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1b83a-7ce9-4ca4-9991-eecb1c4dfb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4795b399d75c49008168fcf00f9ce483, user_id=f574cc1862284257bf16514d4c328f6a, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:49.890766 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1b83a-7ce9-4ca4-9991-eecb1c4dfb83 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:49.929197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 869/1739] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:49.929769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6413f-1544-4ea2-a548-1408998dea4b None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:49.929769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6413f-1544-4ea2-a548-1408998dea4b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:49.930273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6413f-1544-4ea2-a548-1408998dea4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:49.956558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 871/1740] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:49 2022] PUT /identity/v3/projects/4795b399d75c49008168fcf00f9ce483/users/f574cc1862284257bf16514d4c328f6a/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:49.958241 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1b83a-7ce9-4ca4-9991-eecb1c4dfb83 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:49.984902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-72b6413f-1544-4ea2-a548-1408998dea4b None None] MFA Rules not processed for user `4be9a664d10d438382b9e359b26ba86e`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:49.990111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-72b6413f-1544-4ea2-a548-1408998dea4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:50.119919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1b83a-7ce9-4ca4-9991-eecb1c4dfb83 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:50.140099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c898e-de12-490a-8902-ce4919b3e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:50.141241 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c898e-de12-490a-8902-ce4919b3e4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:50.143645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c898e-de12-490a-8902-ce4919b3e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:50.144336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c898e-de12-490a-8902-ce4919b3e4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:50.145554 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c898e-de12-490a-8902-ce4919b3e4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:50.150092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c898e-de12-490a-8902-ce4919b3e4f3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:50.197190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 870/1741] 10.222.0.77 () {58 vars in 1058 bytes} [Mon Aug 22 16:02:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:50.198627 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6413f-1544-4ea2-a548-1408998dea4b None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:50.201511 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 872/1742] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:50.202832 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c898e-de12-490a-8902-ce4919b3e4f3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:50.222853 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fb2c898e-de12-490a-8902-ce4919b3e4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:50.387799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:50.435823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6413f-1544-4ea2-a548-1408998dea4b None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:50.445877 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf0b18-c3f8-435b-b1b1-d045fa3b42a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:50.448717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf0b18-c3f8-435b-b1b1-d045fa3b42a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:50.450666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf0b18-c3f8-435b-b1b1-d045fa3b42a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:50.451522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf0b18-c3f8-435b-b1b1-d045fa3b42a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:50.456736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-43bf0b18-c3f8-435b-b1b1-d045fa3b42a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:50.479235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c898e-de12-490a-8902-ce4919b3e4f3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:50.487753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527fec7-c4b0-48d2-ac27-4493c8c3fa67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:50.492261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:50.495142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527fec7-c4b0-48d2-ac27-4493c8c3fa67 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:50.495726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527fec7-c4b0-48d2-ac27-4493c8c3fa67 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:50.496770 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527fec7-c4b0-48d2-ac27-4493c8c3fa67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:50.597583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf0b18-c3f8-435b-b1b1-d045fa3b42a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:50.607708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf0b18-c3f8-435b-b1b1-d045fa3b42a3 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:50.640893 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527fec7-c4b0-48d2-ac27-4493c8c3fa67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:50.642099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 871/1743] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:50.642629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527fec7-c4b0-48d2-ac27-4493c8c3fa67 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:50.644142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8201ec-4e4e-4ad6-a0ab-ecf917952f1c None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:50.644476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8201ec-4e4e-4ad6-a0ab-ecf917952f1c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:50.644973 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8201ec-4e4e-4ad6-a0ab-ecf917952f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:50.665610 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 873/1744] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:50.666364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527fec7-c4b0-48d2-ac27-4493c8c3fa67 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:50.670215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5527fec7-c4b0-48d2-ac27-4493c8c3fa67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:50.703306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527fec7-c4b0-48d2-ac27-4493c8c3fa67 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:50.710586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:50.711370 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:50.711651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:50.711929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] PATH_INFO: `/v3/projects/3638bcea20004b85ad05ba583867f566` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:50.716368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3638bcea20004b85ad05ba583867f566)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:50.718322 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:50.727495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-be8201ec-4e4e-4ad6-a0ab-ecf917952f1c None None] MFA Rules not processed for user `f574cc1862284257bf16514d4c328f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:50.728806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-be8201ec-4e4e-4ad6-a0ab-ecf917952f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:50.841943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3638bcea20004b85ad05ba583867f566', 'request_id': 'req-19cb9cca-938b-41af-b892-c9f04dc2d5e6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:50.858347 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3638bcea20004b85ad05ba583867f566', 'request_id': 'req-19cb9cca-938b-41af-b892-c9f04dc2d5e6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:50.872438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3638bcea20004b85ad05ba583867f566', 'request_id': 'req-19cb9cca-938b-41af-b892-c9f04dc2d5e6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:50.893894 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] The token cache is being invalidate because project 3638bcea20004b85ad05ba583867f566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:02:50.894191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:50.895242 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:50.899452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 872/1745] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:50.900638 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8201ec-4e4e-4ad6-a0ab-ecf917952f1c None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:50.916596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 874/1746] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:02:50 2022] DELETE /identity/v3/projects/3638bcea20004b85ad05ba583867f566 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:50.916596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:50.917396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:50.955008 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8201ec-4e4e-4ad6-a0ab-ecf917952f1c None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:51.118141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af018c25-b560-4c67-89d4-e50f13df955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:51.119059 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af018c25-b560-4c67-89d4-e50f13df955f admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:51.119349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af018c25-b560-4c67-89d4-e50f13df955f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:51.119645 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af018c25-b560-4c67-89d4-e50f13df955f admin admin] PATH_INFO: `/v3/projects/a23ab0b4093448c0a3162204de47b1eb/users/dbf205921eb94d229cb20aeb28960711/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:51.126248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:51.160348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af018c25-b560-4c67-89d4-e50f13df955f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23ab0b4093448c0a3162204de47b1eb, user_id=dbf205921eb94d229cb20aeb28960711, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:51.169743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af018c25-b560-4c67-89d4-e50f13df955f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:51.196152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 873/1747] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:50 2022] PUT /identity/v3/projects/a23ab0b4093448c0a3162204de47b1eb/users/dbf205921eb94d229cb20aeb28960711/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:51.200469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54a1e9-7132-4c06-a8f0-563f1fb195bc None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:51.201099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54a1e9-7132-4c06-a8f0-563f1fb195bc None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:51.201966 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54a1e9-7132-4c06-a8f0-563f1fb195bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:51.208780 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb9cca-938b-41af-b892-c9f04dc2d5e6 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:51.269173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-bb54a1e9-7132-4c06-a8f0-563f1fb195bc None None] MFA Rules not processed for user `0a01c075e69b49aa8f44968ed2cca1b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:51.270293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bb54a1e9-7132-4c06-a8f0-563f1fb195bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:51.311985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:51.409132 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37b99f-5e9c-4f74-8a62-fc2c04b6fb0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be9a664d10d438382b9e359b26ba86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:51.412480 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37b99f-5e9c-4f74-8a62-fc2c04b6fb0f service placement] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:51.414336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37b99f-5e9c-4f74-8a62-fc2c04b6fb0f service placement] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:51.414828 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37b99f-5e9c-4f74-8a62-fc2c04b6fb0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:51.418492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bc37b99f-5e9c-4f74-8a62-fc2c04b6fb0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:51.441407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37b99f-5e9c-4f74-8a62-fc2c04b6fb0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:51.443876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37b99f-5e9c-4f74-8a62-fc2c04b6fb0f service placement] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:51.459064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 875/1748] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:51.459772 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37b99f-5e9c-4f74-8a62-fc2c04b6fb0f service placement] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:51.461397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bc37b99f-5e9c-4f74-8a62-fc2c04b6fb0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:51.472887 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 874/1749] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:51.474100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54a1e9-7132-4c06-a8f0-563f1fb195bc None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:51.487516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bb54a1e9-7132-4c06-a8f0-563f1fb195bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:51.589574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37b99f-5e9c-4f74-8a62-fc2c04b6fb0f service placement] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:51.601158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506a725-5197-4235-98a5-3f654eb4487e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:51.602191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506a725-5197-4235-98a5-3f654eb4487e service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:51.602718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506a725-5197-4235-98a5-3f654eb4487e service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:51.603259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506a725-5197-4235-98a5-3f654eb4487e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:51.605661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8506a725-5197-4235-98a5-3f654eb4487e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:51.692731 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54a1e9-7132-4c06-a8f0-563f1fb195bc None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:51.704191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f18c0-bd91-410a-a739-dffcaa030d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:51.705210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f18c0-bd91-410a-a739-dffcaa030d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:51.705627 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f18c0-bd91-410a-a739-dffcaa030d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:51.706058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f18c0-bd91-410a-a739-dffcaa030d3b admin admin] PATH_INFO: `/v3/users/50832141e399411aafc18b91112d368c` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:51.709656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f18c0-bd91-410a-a739-dffcaa030d3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=50832141e399411aafc18b91112d368c)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:51.714545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f18c0-bd91-410a-a739-dffcaa030d3b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:51.819500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506a725-5197-4235-98a5-3f654eb4487e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:51.822495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506a725-5197-4235-98a5-3f654eb4487e service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:51.850186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ac7f18c0-bd91-410a-a739-dffcaa030d3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50832141e399411aafc18b91112d368c'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:51.853513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 876/1750] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:51.855723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506a725-5197-4235-98a5-3f654eb4487e service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:51.860074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8506a725-5197-4235-98a5-3f654eb4487e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:51.887153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ac7f18c0-bd91-410a-a739-dffcaa030d3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50832141e399411aafc18b91112d368c'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:51.897592 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506a725-5197-4235-98a5-3f654eb4487e service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:51.909682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ac7f18c0-bd91-410a-a739-dffcaa030d3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50832141e399411aafc18b91112d368c'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:51.911606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58858ed-54f0-4d49-ac82-2fb248500311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:51.912573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58858ed-54f0-4d49-ac82-2fb248500311 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:51.913739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58858ed-54f0-4d49-ac82-2fb248500311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:51.914123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58858ed-54f0-4d49-ac82-2fb248500311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:51.916263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58858ed-54f0-4d49-ac82-2fb248500311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:51.921739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58858ed-54f0-4d49-ac82-2fb248500311 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:51.921985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ac7f18c0-bd91-410a-a739-dffcaa030d3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50832141e399411aafc18b91112d368c'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:51.923427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ac7f18c0-bd91-410a-a739-dffcaa030d3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50832141e399411aafc18b91112d368c'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:51.942384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 875/1751] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:02:51 2022] DELETE /identity/v3/users/50832141e399411aafc18b91112d368c => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:51.948727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d175a20-ed80-478a-8341-ebb1362f949c None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:51.948727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d175a20-ed80-478a-8341-ebb1362f949c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:51.948727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d175a20-ed80-478a-8341-ebb1362f949c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:51.953780 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 877/1752] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:51.955218 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58858ed-54f0-4d49-ac82-2fb248500311 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:51.961038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b58858ed-54f0-4d49-ac82-2fb248500311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:51.990194 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58858ed-54f0-4d49-ac82-2fb248500311 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:52.009574 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-9d175a20-ed80-478a-8341-ebb1362f949c None None] MFA Rules not processed for user `0a01c075e69b49aa8f44968ed2cca1b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:52.013911 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9d175a20-ed80-478a-8341-ebb1362f949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:52.105217 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:52.109148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:52.188006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 876/1753] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:52.195453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d175a20-ed80-478a-8341-ebb1362f949c None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:52.196805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9d175a20-ed80-478a-8341-ebb1362f949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:52.266653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71210b61-720a-4ea9-851d-c91dc98659ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:52.267366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210b61-720a-4ea9-851d-c91dc98659ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:52.267648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210b61-720a-4ea9-851d-c91dc98659ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:52.268410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210b61-720a-4ea9-851d-c91dc98659ca admin admin] PATH_INFO: `/v3/projects/a23ab0b4093448c0a3162204de47b1eb/users/dbf205921eb94d229cb20aeb28960711/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:52.273717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71210b61-720a-4ea9-851d-c91dc98659ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23ab0b4093448c0a3162204de47b1eb, user_id=dbf205921eb94d229cb20aeb28960711, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:52.276544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71210b61-720a-4ea9-851d-c91dc98659ca admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:52.311808 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 878/1754] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:51 2022] PUT /identity/v3/projects/a23ab0b4093448c0a3162204de47b1eb/users/dbf205921eb94d229cb20aeb28960711/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:52.470835 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d175a20-ed80-478a-8341-ebb1362f949c None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:52.619829 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140ba15-be72-4722-a04a-c36262484c30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:52.620607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140ba15-be72-4722-a04a-c36262484c30 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:52.621045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140ba15-be72-4722-a04a-c36262484c30 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:52.621457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140ba15-be72-4722-a04a-c36262484c30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:52.625201 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0140ba15-be72-4722-a04a-c36262484c30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:52.918510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140ba15-be72-4722-a04a-c36262484c30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:52.921580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140ba15-be72-4722-a04a-c36262484c30 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:52.953894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 877/1755] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:53.296343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71210b61-720a-4ea9-851d-c91dc98659ca admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:53.300476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-71210b61-720a-4ea9-851d-c91dc98659ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:53.461699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71210b61-720a-4ea9-851d-c91dc98659ca admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:53.469013 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ed984-4592-40fd-8d47-ae4c70db74e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:53.471737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ed984-4592-40fd-8d47-ae4c70db74e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:53.472608 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ed984-4592-40fd-8d47-ae4c70db74e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:53.473143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ed984-4592-40fd-8d47-ae4c70db74e6 admin admin] PATH_INFO: `/v3/projects/8195cee699494f1a8eee645eb332b686` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:53.474918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ed984-4592-40fd-8d47-ae4c70db74e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8195cee699494f1a8eee645eb332b686)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:53.479899 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ed984-4592-40fd-8d47-ae4c70db74e6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:53.678186 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e92ed984-4592-40fd-8d47-ae4c70db74e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8195cee699494f1a8eee645eb332b686', 'request_id': 'req-e92ed984-4592-40fd-8d47-ae4c70db74e6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:53.717733 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e92ed984-4592-40fd-8d47-ae4c70db74e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8195cee699494f1a8eee645eb332b686', 'request_id': 'req-e92ed984-4592-40fd-8d47-ae4c70db74e6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:53.734884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e92ed984-4592-40fd-8d47-ae4c70db74e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8195cee699494f1a8eee645eb332b686', 'request_id': 'req-e92ed984-4592-40fd-8d47-ae4c70db74e6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:53.766541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e92ed984-4592-40fd-8d47-ae4c70db74e6 admin admin] The token cache is being invalidate because project 8195cee699494f1a8eee645eb332b686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:02:53.767235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e92ed984-4592-40fd-8d47-ae4c70db74e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:53.772852 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e92ed984-4592-40fd-8d47-ae4c70db74e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:02:53.779397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 879/1756] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:02:53 2022] DELETE /identity/v3/projects/8195cee699494f1a8eee645eb332b686 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:53.781094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac0e2e-0af8-40f5-ac1d-e5b626933f78 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:53.781961 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac0e2e-0af8-40f5-ac1d-e5b626933f78 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:53.782254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac0e2e-0af8-40f5-ac1d-e5b626933f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:53.854636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-d6ac0e2e-0af8-40f5-ac1d-e5b626933f78 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:53.858318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d6ac0e2e-0af8-40f5-ac1d-e5b626933f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:53.920097 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:54.174930 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 878/1757] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:54.176955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb8c9e-ae2f-4e0b-b131-814fac0ab67d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:54.177244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb8c9e-ae2f-4e0b-b131-814fac0ab67d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:54.177525 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb8c9e-ae2f-4e0b-b131-814fac0ab67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:54.259934 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a0fb8c9e-ae2f-4e0b-b131-814fac0ab67d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:54.261166 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a0fb8c9e-ae2f-4e0b-b131-814fac0ab67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:54.297664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 880/1758] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:54.303092 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac0e2e-0af8-40f5-ac1d-e5b626933f78 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:54.330086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac0e2e-0af8-40f5-ac1d-e5b626933f78 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:54.359399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26eef6-b1c0-4d6d-bb5f-85800c6feafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:54.364345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26eef6-b1c0-4d6d-bb5f-85800c6feafe admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:54.364655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26eef6-b1c0-4d6d-bb5f-85800c6feafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:54.364919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26eef6-b1c0-4d6d-bb5f-85800c6feafe admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:54.365620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26eef6-b1c0-4d6d-bb5f-85800c6feafe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:02:54.365917 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26eef6-b1c0-4d6d-bb5f-85800c6feafe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:54.371676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26eef6-b1c0-4d6d-bb5f-85800c6feafe admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:54.422511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 879/1759] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:02:54.424240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb8c9e-ae2f-4e0b-b131-814fac0ab67d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:54.435458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb8c9e-ae2f-4e0b-b131-814fac0ab67d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:54.458515 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7378e7-1e05-4994-a963-89306d533c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:54.461142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7378e7-1e05-4994-a963-89306d533c99 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:54.461364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7378e7-1e05-4994-a963-89306d533c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:54.466691 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7378e7-1e05-4994-a963-89306d533c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:54.467404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7378e7-1e05-4994-a963-89306d533c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:54.471441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7378e7-1e05-4994-a963-89306d533c99 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:54.545304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 881/1760] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:54 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:54.550143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26eef6-b1c0-4d6d-bb5f-85800c6feafe admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:54.618955 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26eef6-b1c0-4d6d-bb5f-85800c6feafe admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:54.760750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ec13c-8157-476f-b65d-50c6e608736c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:54.761177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ec13c-8157-476f-b65d-50c6e608736c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:54.761451 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ec13c-8157-476f-b65d-50c6e608736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:54.787083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21b05b-27fa-40cf-8c28-e4a230e20ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:54.788538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b05b-27fa-40cf-8c28-e4a230e20ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:54.788818 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b05b-27fa-40cf-8c28-e4a230e20ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:54.789092 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b05b-27fa-40cf-8c28-e4a230e20ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:54.792890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21b05b-27fa-40cf-8c28-e4a230e20ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:54.811150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21b05b-27fa-40cf-8c28-e4a230e20ee2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:54.826175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f87ec13c-8157-476f-b65d-50c6e608736c None None] MFA Rules not processed for user `4d3445e9462b42cd82ea10ed54193c89`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:54.838896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f87ec13c-8157-476f-b65d-50c6e608736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:54.907079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 880/1761] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:54 2022] POST /identity/v3/users => generated 289 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:54.910958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21b05b-27fa-40cf-8c28-e4a230e20ee2 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:54.914140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:54.943020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21b05b-27fa-40cf-8c28-e4a230e20ee2 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:54.956795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6baaf-5e46-4db1-a020-93fdcca05a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:54.957450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6baaf-5e46-4db1-a020-93fdcca05a41 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:54.958323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6baaf-5e46-4db1-a020-93fdcca05a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:54.958628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6baaf-5e46-4db1-a020-93fdcca05a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:54.959422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6baaf-5e46-4db1-a020-93fdcca05a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:54.960914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6baaf-5e46-4db1-a020-93fdcca05a41 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:54.993410 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 881/1762] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:54.994625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6baaf-5e46-4db1-a020-93fdcca05a41 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:55.019027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6baaf-5e46-4db1-a020-93fdcca05a41 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:55.045277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200241-9ca4-481b-a126-c4a2f814552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:55.045923 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200241-9ca4-481b-a126-c4a2f814552e admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:55.046203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200241-9ca4-481b-a126-c4a2f814552e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:55.046479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200241-9ca4-481b-a126-c4a2f814552e admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:55.047175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef200241-9ca4-481b-a126-c4a2f814552e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:55.048815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef200241-9ca4-481b-a126-c4a2f814552e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:55.097752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 882/1763] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:55.098770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200241-9ca4-481b-a126-c4a2f814552e admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:55.136335 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 882/1764] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:55.149149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200241-9ca4-481b-a126-c4a2f814552e admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:55.171554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030c4dc-b0aa-4889-a423-7473404752e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:55.172249 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030c4dc-b0aa-4889-a423-7473404752e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:55.172856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030c4dc-b0aa-4889-a423-7473404752e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:55.173136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030c4dc-b0aa-4889-a423-7473404752e7 admin admin] PATH_INFO: `/v3/projects/e0fdc151af594363919a7b7a072a467f/users/50c5ec32678644ec8beb6074d4736b42/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:55.208303 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030c4dc-b0aa-4889-a423-7473404752e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fdc151af594363919a7b7a072a467f, user_id=50c5ec32678644ec8beb6074d4736b42, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:55.211087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030c4dc-b0aa-4889-a423-7473404752e7 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:55.246522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 883/1765] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:55 2022] PUT /identity/v3/projects/e0fdc151af594363919a7b7a072a467f/users/50c5ec32678644ec8beb6074d4736b42/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:55.257102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ab05f-fd8a-480b-9a45-1036229478f4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:55.257382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ab05f-fd8a-480b-9a45-1036229478f4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:55.257656 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ab05f-fd8a-480b-9a45-1036229478f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:55.332298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2a9ab05f-fd8a-480b-9a45-1036229478f4 None None] MFA Rules not processed for user `50c5ec32678644ec8beb6074d4736b42`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:55.333877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2a9ab05f-fd8a-480b-9a45-1036229478f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:55.370568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f302f-a058-422d-8079-b5dcb1abec7f None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:55.371145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f302f-a058-422d-8079-b5dcb1abec7f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:55.371612 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f302f-a058-422d-8079-b5dcb1abec7f None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:55.373462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 884/1766] 10.222.0.77 () {54 vars in 912 bytes} [Mon Aug 22 16:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:02:55.379047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08189a50-5bef-4628-a305-696bb4174e93 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:55.379331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08189a50-5bef-4628-a305-696bb4174e93 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:55.379606 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08189a50-5bef-4628-a305-696bb4174e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:55.456971 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-08189a50-5bef-4628-a305-696bb4174e93 None None] MFA Rules not processed for user `104abc0b38524a2f95ffe96c5872362c`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:55.458793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-08189a50-5bef-4628-a305-696bb4174e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:55.512610 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 883/1767] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:55.514084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ab05f-fd8a-480b-9a45-1036229478f4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:55.582897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:55.606128 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 885/1768] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 16:02:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:02:55.632153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08189a50-5bef-4628-a305-696bb4174e93 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:55.633803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-08189a50-5bef-4628-a305-696bb4174e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:55.657757 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08189a50-5bef-4628-a305-696bb4174e93 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:55.664871 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27976f-daae-4c57-b2ae-98a20dde02d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:55.665698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27976f-daae-4c57-b2ae-98a20dde02d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:55.666021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27976f-daae-4c57-b2ae-98a20dde02d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:55.666623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27976f-daae-4c57-b2ae-98a20dde02d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:55.683586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ab05f-fd8a-480b-9a45-1036229478f4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:55.690017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94085c-c34c-4cb5-afc1-22c8df4d99bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:55.691185 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94085c-c34c-4cb5-afc1-22c8df4d99bf admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:55.691828 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94085c-c34c-4cb5-afc1-22c8df4d99bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:55.692373 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94085c-c34c-4cb5-afc1-22c8df4d99bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:55.693255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94085c-c34c-4cb5-afc1-22c8df4d99bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:55.696109 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27976f-daae-4c57-b2ae-98a20dde02d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:55.697089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94085c-c34c-4cb5-afc1-22c8df4d99bf admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:55.697847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27976f-daae-4c57-b2ae-98a20dde02d0 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:55.717800 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 886/1769] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:02:55.719240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175953-6793-402d-b646-ee8be789fea8 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:55.719521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175953-6793-402d-b646-ee8be789fea8 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:55.721365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175953-6793-402d-b646-ee8be789fea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:55.747769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 884/1770] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:55 2022] POST /identity/v3/projects => generated 379 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:55.750757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94085c-c34c-4cb5-afc1-22c8df4d99bf admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:55.818314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:55.845072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94085c-c34c-4cb5-afc1-22c8df4d99bf admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:55.850563 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9e302-2a43-4678-83f8-1fe6b9287d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:55.851645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9e302-2a43-4678-83f8-1fe6b9287d4c admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:55.851645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9e302-2a43-4678-83f8-1fe6b9287d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:55.852279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9e302-2a43-4678-83f8-1fe6b9287d4c admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:55.853468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9e302-2a43-4678-83f8-1fe6b9287d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:55.855634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9e302-2a43-4678-83f8-1fe6b9287d4c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:55.890952 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 885/1771] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:55 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:55.891164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-bd175953-6793-402d-b646-ee8be789fea8 None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:55.891164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bd175953-6793-402d-b646-ee8be789fea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:55.896116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9e302-2a43-4678-83f8-1fe6b9287d4c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:55.910278 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9e302-2a43-4678-83f8-1fe6b9287d4c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:55.919984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5f5ef-0613-4c3e-8e03-7e9fd8dd8740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:55.921117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5f5ef-0613-4c3e-8e03-7e9fd8dd8740 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:55.921711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5f5ef-0613-4c3e-8e03-7e9fd8dd8740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:55.922253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5f5ef-0613-4c3e-8e03-7e9fd8dd8740 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:55.923615 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5f5ef-0613-4c3e-8e03-7e9fd8dd8740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:55.926021 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5f5ef-0613-4c3e-8e03-7e9fd8dd8740 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:55.942130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 886/1772] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:55.945454 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5f5ef-0613-4c3e-8e03-7e9fd8dd8740 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:55.962205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5f5ef-0613-4c3e-8e03-7e9fd8dd8740 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:55.968457 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65348726-3b89-469b-929f-65b4c82ec51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:55.969163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65348726-3b89-469b-929f-65b4c82ec51a admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:55.969441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65348726-3b89-469b-929f-65b4c82ec51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:55.969721 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65348726-3b89-469b-929f-65b4c82ec51a admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:55.970376 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65348726-3b89-469b-929f-65b4c82ec51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:55.972544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65348726-3b89-469b-929f-65b4c82ec51a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:55.992243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 887/1773] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:55.993287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65348726-3b89-469b-929f-65b4c82ec51a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:56.009076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65348726-3b89-469b-929f-65b4c82ec51a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:56.026731 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b786cf-0adf-4e4a-b2b4-33aea5c888a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:56.028649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b786cf-0adf-4e4a-b2b4-33aea5c888a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:56.028937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b786cf-0adf-4e4a-b2b4-33aea5c888a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:56.029215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b786cf-0adf-4e4a-b2b4-33aea5c888a9 admin admin] PATH_INFO: `/v3/projects/8dae433d322d4a72bc534dd1f2d675ec/users/1a4d3403c7f84c2f889653510a23e37b/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:56.064697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 887/1774] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 16:02:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:56.076627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b786cf-0adf-4e4a-b2b4-33aea5c888a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dae433d322d4a72bc534dd1f2d675ec, user_id=1a4d3403c7f84c2f889653510a23e37b, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:56.082892 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b786cf-0adf-4e4a-b2b4-33aea5c888a9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:56.125518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 888/1775] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:55 2022] PUT /identity/v3/projects/8dae433d322d4a72bc534dd1f2d675ec/users/1a4d3403c7f84c2f889653510a23e37b/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:56.126485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98286b8-2f86-4038-88c9-74ec1e158c75 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:56.127810 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98286b8-2f86-4038-88c9-74ec1e158c75 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:56.128351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98286b8-2f86-4038-88c9-74ec1e158c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:56.240455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c98286b8-2f86-4038-88c9-74ec1e158c75 None None] MFA Rules not processed for user `1a4d3403c7f84c2f889653510a23e37b`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:56.245693 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c98286b8-2f86-4038-88c9-74ec1e158c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:56.378978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b786cf-0adf-4e4a-b2b4-33aea5c888a9 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:56.380929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-98b786cf-0adf-4e4a-b2b4-33aea5c888a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:56.411958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 888/1776] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:02:56.415792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98286b8-2f86-4038-88c9-74ec1e158c75 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:56.524598 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:56.584608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98286b8-2f86-4038-88c9-74ec1e158c75 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:56.597032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4774b-6034-4ff3-a679-435f1f0ac097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:56.599698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4774b-6034-4ff3-a679-435f1f0ac097 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:56.599986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4774b-6034-4ff3-a679-435f1f0ac097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:56.600259 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4774b-6034-4ff3-a679-435f1f0ac097 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:56.600907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4774b-6034-4ff3-a679-435f1f0ac097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:56.607529 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4774b-6034-4ff3-a679-435f1f0ac097 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:56.614654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b786cf-0adf-4e4a-b2b4-33aea5c888a9 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:56.625704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb8bb1-5cf3-4a4a-9374-9ac76d927263 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:56.626341 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb8bb1-5cf3-4a4a-9374-9ac76d927263 service swift] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:56.626646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb8bb1-5cf3-4a4a-9374-9ac76d927263 service swift] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:56.626914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb8bb1-5cf3-4a4a-9374-9ac76d927263 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:56.676662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 889/1777] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:02:56 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:02:56.681864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4774b-6034-4ff3-a679-435f1f0ac097 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:56.816294 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb8bb1-5cf3-4a4a-9374-9ac76d927263 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:56.818664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb8bb1-5cf3-4a4a-9374-9ac76d927263 service swift] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:56.865677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 889/1778] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:02:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:02:56.867098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21d3e9-a0ab-4487-8053-595c1a8166b1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:56.867438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21d3e9-a0ab-4487-8053-595c1a8166b1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:56.867643 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21d3e9-a0ab-4487-8053-595c1a8166b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:56.895713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:56.907245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4774b-6034-4ff3-a679-435f1f0ac097 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:56.926423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-fb21d3e9-a0ab-4487-8053-595c1a8166b1 None None] MFA Rules not processed for user `9c75b97977c2433fb27aa21e4f82ce2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:56.927715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fb21d3e9-a0ab-4487-8053-595c1a8166b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:56.929576 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd1ea0-7833-4507-a83b-60380efc3c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:56.930155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd1ea0-7833-4507-a83b-60380efc3c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:56.930470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd1ea0-7833-4507-a83b-60380efc3c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:56.931119 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd1ea0-7833-4507-a83b-60380efc3c03 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:56.931757 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd1ea0-7833-4507-a83b-60380efc3c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:56.934021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd1ea0-7833-4507-a83b-60380efc3c03 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:57.005665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 890/1779] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:02:56 2022] POST /identity/v3/users => generated 295 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:02:57.014398 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd1ea0-7833-4507-a83b-60380efc3c03 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:57.063951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd1ea0-7833-4507-a83b-60380efc3c03 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:57.101098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99b669-d49b-4049-944f-0bb2583c275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:57.101988 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99b669-d49b-4049-944f-0bb2583c275b admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:57.102347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99b669-d49b-4049-944f-0bb2583c275b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:57.102700 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99b669-d49b-4049-944f-0bb2583c275b admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:57.103468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99b669-d49b-4049-944f-0bb2583c275b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:57.105105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99b669-d49b-4049-944f-0bb2583c275b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:57.167418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 891/1780] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:57.173395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99b669-d49b-4049-944f-0bb2583c275b admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:57.178327 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 890/1781] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:57.204416 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8721499-0802-438f-8d12-09ec84375c9a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:57.205072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8721499-0802-438f-8d12-09ec84375c9a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:57.205725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8721499-0802-438f-8d12-09ec84375c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:57.210846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99b669-d49b-4049-944f-0bb2583c275b admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:57.227943 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542d58e-133f-4193-af82-b3ac56311048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:57.245761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d58e-133f-4193-af82-b3ac56311048 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:57.245761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d58e-133f-4193-af82-b3ac56311048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:57.245761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542d58e-133f-4193-af82-b3ac56311048 admin admin] PATH_INFO: `/v3/projects/db6380fb3ef945b39d5f5c02eb9b7c11/users/f37c8c039cc24231a899547a81835766/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:57.266913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f8721499-0802-438f-8d12-09ec84375c9a None None] MFA Rules not processed for user `104abc0b38524a2f95ffe96c5872362c`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:57.268162 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f8721499-0802-438f-8d12-09ec84375c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:57.315647 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542d58e-133f-4193-af82-b3ac56311048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6380fb3ef945b39d5f5c02eb9b7c11, user_id=f37c8c039cc24231a899547a81835766, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:57.333935 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542d58e-133f-4193-af82-b3ac56311048 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:57.371587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 892/1782] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:57 2022] PUT /identity/v3/projects/db6380fb3ef945b39d5f5c02eb9b7c11/users/f37c8c039cc24231a899547a81835766/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:57.377930 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7dbda-d911-4d72-8d41-8e284c0318b3 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:57.378972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7dbda-d911-4d72-8d41-8e284c0318b3 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:57.379317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7dbda-d911-4d72-8d41-8e284c0318b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:57.485758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 891/1783] 10.222.0.85 () {58 vars in 1015 bytes} [Mon Aug 22 16:02:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:57.486837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8721499-0802-438f-8d12-09ec84375c9a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:57.486954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-eab7dbda-d911-4d72-8d41-8e284c0318b3 None None] MFA Rules not processed for user `dbf205921eb94d229cb20aeb28960711`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:57.498172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-eab7dbda-d911-4d72-8d41-8e284c0318b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:57.508598 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8721499-0802-438f-8d12-09ec84375c9a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:57.663264 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6f27d-a267-4c7c-bbdb-65cf110ebbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:57.664718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6f27d-a267-4c7c-bbdb-65cf110ebbdc admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:57.665953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6f27d-a267-4c7c-bbdb-65cf110ebbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:57.667619 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6f27d-a267-4c7c-bbdb-65cf110ebbdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:57.669006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6f27d-a267-4c7c-bbdb-65cf110ebbdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:57.673098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6f27d-a267-4c7c-bbdb-65cf110ebbdc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:57.709958 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 892/1784] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:02:57.713387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6f27d-a267-4c7c-bbdb-65cf110ebbdc admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:57.735430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 893/1785] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:57 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:57.737540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7dbda-d911-4d72-8d41-8e284c0318b3 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:57.774553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7dbda-d911-4d72-8d41-8e284c0318b3 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:57.793025 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b20327-57ea-44db-8884-ba012bfaa39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:57.793688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b20327-57ea-44db-8884-ba012bfaa39b admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:57.793959 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b20327-57ea-44db-8884-ba012bfaa39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:57.794230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b20327-57ea-44db-8884-ba012bfaa39b admin admin] PATH_INFO: `/v3/projects/db6380fb3ef945b39d5f5c02eb9b7c11/users/f37c8c039cc24231a899547a81835766/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:57.804318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b20327-57ea-44db-8884-ba012bfaa39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6380fb3ef945b39d5f5c02eb9b7c11, user_id=f37c8c039cc24231a899547a81835766, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:57.809707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b20327-57ea-44db-8884-ba012bfaa39b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:57.836996 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:57.884398 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 894/1786] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:02:57 2022] PUT /identity/v3/projects/db6380fb3ef945b39d5f5c02eb9b7c11/users/f37c8c039cc24231a899547a81835766/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:02:57.888577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d124-6ec3-4767-9c66-a6b538f55a7c None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:57.888841 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d124-6ec3-4767-9c66-a6b538f55a7c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:57.889158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769d124-6ec3-4767-9c66-a6b538f55a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:57.929875 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6f27d-a267-4c7c-bbdb-65cf110ebbdc admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:57.960107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:02:57.967167 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-2769d124-6ec3-4767-9c66-a6b538f55a7c None None] MFA Rules not processed for user `f37c8c039cc24231a899547a81835766`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:02:57.968429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-2769d124-6ec3-4767-9c66-a6b538f55a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:58.052395 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67eef7b-3499-4179-af8b-448ead0049f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:58.066130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67eef7b-3499-4179-af8b-448ead0049f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:58.066896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67eef7b-3499-4179-af8b-448ead0049f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:58.067671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67eef7b-3499-4179-af8b-448ead0049f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:58.104981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67eef7b-3499-4179-af8b-448ead0049f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:58.112350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67eef7b-3499-4179-af8b-448ead0049f4 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:58.156962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 893/1787] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:58.212515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 895/1788] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:02:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:02:58.220638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67eef7b-3499-4179-af8b-448ead0049f4 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:58.222428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a67eef7b-3499-4179-af8b-448ead0049f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:02:58.462045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67eef7b-3499-4179-af8b-448ead0049f4 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:58.474500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c3ab9-b99e-4b4a-a90c-aa25ce58d2bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:58.475440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3ab9-b99e-4b4a-a90c-aa25ce58d2bb service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:58.475887 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3ab9-b99e-4b4a-a90c-aa25ce58d2bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:58.476450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3ab9-b99e-4b4a-a90c-aa25ce58d2bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:58.505664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c3ab9-b99e-4b4a-a90c-aa25ce58d2bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:58.513786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c3ab9-b99e-4b4a-a90c-aa25ce58d2bb service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:58.562475 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 894/1789] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:02:58.788759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769d124-6ec3-4767-9c66-a6b538f55a7c None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:02:58.819620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769d124-6ec3-4767-9c66-a6b538f55a7c None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:02:58.854767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3af27-c580-4b04-b963-f2aec39e55ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:02:58.864713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3af27-c580-4b04-b963-f2aec39e55ad service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:02:58.865095 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3af27-c580-4b04-b963-f2aec39e55ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:02:58.869153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3af27-c580-4b04-b963-f2aec39e55ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:02:59.206280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3af27-c580-4b04-b963-f2aec39e55ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:02:59.208685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3af27-c580-4b04-b963-f2aec39e55ad service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:02:59.243991 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 896/1790] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:02:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:00.211575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc8b34-5a3f-4408-bbe6-2c5a40877cde None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:00.212591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc8b34-5a3f-4408-bbe6-2c5a40877cde None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:00.213021 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc8b34-5a3f-4408-bbe6-2c5a40877cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:00.333271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-73cc8b34-5a3f-4408-bbe6-2c5a40877cde None None] MFA Rules not processed for user `0a01c075e69b49aa8f44968ed2cca1b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:00.335061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-73cc8b34-5a3f-4408-bbe6-2c5a40877cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:00.558973 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 895/1791] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:01.483738 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef5bd-4f84-4254-a112-347891b0ba98 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:01.484231 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef5bd-4f84-4254-a112-347891b0ba98 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:01.484678 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef5bd-4f84-4254-a112-347891b0ba98 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:01.486499 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 897/1792] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 22 16:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:03:01.556442 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f95c2-b211-402d-abe5-8cd0500f007a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:01.557986 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f95c2-b211-402d-abe5-8cd0500f007a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:01.557986 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f95c2-b211-402d-abe5-8cd0500f007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:01.665557 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9a2f95c2-b211-402d-abe5-8cd0500f007a None None] MFA Rules not processed for user `4be9a664d10d438382b9e359b26ba86e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:01.672682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9a2f95c2-b211-402d-abe5-8cd0500f007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:01.945210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:01.992477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 896/1793] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 22 16:03:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:02.051725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ef5bd-4f84-4254-a112-347891b0ba98 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:02.054269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7f7ef5bd-4f84-4254-a112-347891b0ba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:02.123524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ef5bd-4f84-4254-a112-347891b0ba98 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:02.169650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c5a5e-5ca9-41cb-b3fc-7cfab805374a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be9a664d10d438382b9e359b26ba86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:02.170382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c5a5e-5ca9-41cb-b3fc-7cfab805374a service placement] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:02.170781 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c5a5e-5ca9-41cb-b3fc-7cfab805374a service placement] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:02.170962 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c5a5e-5ca9-41cb-b3fc-7cfab805374a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:02.205983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c5a5e-5ca9-41cb-b3fc-7cfab805374a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:02.207747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c5a5e-5ca9-41cb-b3fc-7cfab805374a service placement] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:02.241321 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 898/1794] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:03.545412 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76481d03-ca7e-4b1e-9033-59579ab497f9 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:03.545998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76481d03-ca7e-4b1e-9033-59579ab497f9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:03.545998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76481d03-ca7e-4b1e-9033-59579ab497f9 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:03.560872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 897/1795] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 22 16:03:03 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:03:03.604893 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f38fa-721c-4f04-867a-ffac55b4f0f7 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:03.605528 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f38fa-721c-4f04-867a-ffac55b4f0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:03.605610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f38fa-721c-4f04-867a-ffac55b4f0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:03.707977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-a63f38fa-721c-4f04-867a-ffac55b4f0f7 None None] MFA Rules not processed for user `20e4a18ab77642baa9adb9a4b49fbcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:03.709237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a63f38fa-721c-4f04-867a-ffac55b4f0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:03.894589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:03.942454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 899/1796] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 22 16:03:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 22 16:03:04.632480 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76481d03-ca7e-4b1e-9033-59579ab497f9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:04.831103 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76481d03-ca7e-4b1e-9033-59579ab497f9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:04.851252 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4a159-872d-46ac-85e8-5f4a3c52c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:04.851712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a159-872d-46ac-85e8-5f4a3c52c222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:04.851993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a159-872d-46ac-85e8-5f4a3c52c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:04.852318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a159-872d-46ac-85e8-5f4a3c52c222 admin admin] PATH_INFO: `/v3/users/50c5ec32678644ec8beb6074d4736b42` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:04.856948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4a159-872d-46ac-85e8-5f4a3c52c222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c5ec32678644ec8beb6074d4736b42)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:04.863243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4a159-872d-46ac-85e8-5f4a3c52c222 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:04.973960 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-08c4a159-872d-46ac-85e8-5f4a3c52c222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c5ec32678644ec8beb6074d4736b42'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:04.986779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-08c4a159-872d-46ac-85e8-5f4a3c52c222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c5ec32678644ec8beb6074d4736b42'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:04.990000 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-08c4a159-872d-46ac-85e8-5f4a3c52c222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c5ec32678644ec8beb6074d4736b42'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:05.008669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-08c4a159-872d-46ac-85e8-5f4a3c52c222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c5ec32678644ec8beb6074d4736b42'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:05.047884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-08c4a159-872d-46ac-85e8-5f4a3c52c222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c5ec32678644ec8beb6074d4736b42'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:05.098350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 898/1797] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:04 2022] DELETE /identity/v3/users/50c5ec32678644ec8beb6074d4736b42 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:05.100556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee137a-5094-40a4-9f63-d4d91ef2eb6b None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:05.101287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee137a-5094-40a4-9f63-d4d91ef2eb6b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:05.101287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee137a-5094-40a4-9f63-d4d91ef2eb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:05.151571 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-54ee137a-5094-40a4-9f63-d4d91ef2eb6b None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:05.152841 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-54ee137a-5094-40a4-9f63-d4d91ef2eb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:05.472441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4a159-872d-46ac-85e8-5f4a3c52c222 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:05.473720 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-08c4a159-872d-46ac-85e8-5f4a3c52c222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:05.502654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 900/1798] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:05.530587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee137a-5094-40a4-9f63-d4d91ef2eb6b None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:05.532093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-54ee137a-5094-40a4-9f63-d4d91ef2eb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:05.771695 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee137a-5094-40a4-9f63-d4d91ef2eb6b None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:05.783387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880fd76-2413-4ede-9424-953051bf5e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:05.784040 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880fd76-2413-4ede-9424-953051bf5e19 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:05.784324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880fd76-2413-4ede-9424-953051bf5e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:05.784597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880fd76-2413-4ede-9424-953051bf5e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:05.788517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4a159-872d-46ac-85e8-5f4a3c52c222 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:05.814939 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a29693-85c6-4c94-984d-3a6c9dd1700c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:05.815587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a29693-85c6-4c94-984d-3a6c9dd1700c service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:05.815864 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a29693-85c6-4c94-984d-3a6c9dd1700c service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:05.816139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a29693-85c6-4c94-984d-3a6c9dd1700c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:05.819595 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-30a29693-85c6-4c94-984d-3a6c9dd1700c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:05.828514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880fd76-2413-4ede-9424-953051bf5e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:05.830054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880fd76-2413-4ede-9424-953051bf5e19 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:05.860400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 901/1799] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:03:05.863525 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a29693-85c6-4c94-984d-3a6c9dd1700c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:05.866674 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a29693-85c6-4c94-984d-3a6c9dd1700c service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:05.896052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 899/1800] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:06.871976 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880fd76-2413-4ede-9424-953051bf5e19 service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:06.873498 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f880fd76-2413-4ede-9424-953051bf5e19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:06.895751 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880fd76-2413-4ede-9424-953051bf5e19 service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:06.903530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242606f-0e87-4d40-826e-ff8009189a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:06.904485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242606f-0e87-4d40-826e-ff8009189a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:06.904912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242606f-0e87-4d40-826e-ff8009189a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:06.905995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242606f-0e87-4d40-826e-ff8009189a6e admin admin] PATH_INFO: `/v3/users/b7794ab3ff764f8487dea0ade9a09ef2` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:06.907550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242606f-0e87-4d40-826e-ff8009189a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7794ab3ff764f8487dea0ade9a09ef2)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:06.910872 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242606f-0e87-4d40-826e-ff8009189a6e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:07.040260 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-1242606f-0e87-4d40-826e-ff8009189a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7794ab3ff764f8487dea0ade9a09ef2'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:07.074671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-1242606f-0e87-4d40-826e-ff8009189a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7794ab3ff764f8487dea0ade9a09ef2'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:07.087279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-1242606f-0e87-4d40-826e-ff8009189a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7794ab3ff764f8487dea0ade9a09ef2'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:07.100386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-1242606f-0e87-4d40-826e-ff8009189a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7794ab3ff764f8487dea0ade9a09ef2'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:07.101873 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-1242606f-0e87-4d40-826e-ff8009189a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7794ab3ff764f8487dea0ade9a09ef2'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:07.111823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 902/1801] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:06 2022] DELETE /identity/v3/users/b7794ab3ff764f8487dea0ade9a09ef2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:07.745413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a29693-85c6-4c94-984d-3a6c9dd1700c service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:07.756656 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:07.782003 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a29693-85c6-4c94-984d-3a6c9dd1700c service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:08.100090 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:08.100799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:08.101198 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:08.101564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] PATH_INFO: `/v3/projects/a863e82461104a71a64e3094e138cf98` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:08.105089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a863e82461104a71a64e3094e138cf98)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:08.108964 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:08.256316 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a863e82461104a71a64e3094e138cf98', 'request_id': 'req-289788a5-459b-4de1-91e3-1749e3ebd9ad'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:08.263302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a863e82461104a71a64e3094e138cf98', 'request_id': 'req-289788a5-459b-4de1-91e3-1749e3ebd9ad'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:08.277340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a863e82461104a71a64e3094e138cf98', 'request_id': 'req-289788a5-459b-4de1-91e3-1749e3ebd9ad'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:08.306231 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] The token cache is being invalidate because project a863e82461104a71a64e3094e138cf98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:08.306531 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:08.310522 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:08.318815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 900/1802] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:07 2022] DELETE /identity/v3/projects/a863e82461104a71a64e3094e138cf98 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:08.320377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242606f-0e87-4d40-826e-ff8009189a6e admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:08.321912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1242606f-0e87-4d40-826e-ff8009189a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:08.361649 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242606f-0e87-4d40-826e-ff8009189a6e admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:08.393266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:08.604862 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f9bdc-8113-42ac-9ef0-1de56c59e3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:08.605866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9bdc-8113-42ac-9ef0-1de56c59e3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:08.606368 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9bdc-8113-42ac-9ef0-1de56c59e3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:08.607684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9bdc-8113-42ac-9ef0-1de56c59e3f5 admin admin] PATH_INFO: `/v3/users/dbf205921eb94d229cb20aeb28960711` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:08.610217 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f9bdc-8113-42ac-9ef0-1de56c59e3f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf205921eb94d229cb20aeb28960711)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:08.617371 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f9bdc-8113-42ac-9ef0-1de56c59e3f5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:08.799097 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-773f9bdc-8113-42ac-9ef0-1de56c59e3f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf205921eb94d229cb20aeb28960711'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:08.854547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-773f9bdc-8113-42ac-9ef0-1de56c59e3f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf205921eb94d229cb20aeb28960711'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:08.899445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-773f9bdc-8113-42ac-9ef0-1de56c59e3f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf205921eb94d229cb20aeb28960711'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:08.958044 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-773f9bdc-8113-42ac-9ef0-1de56c59e3f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf205921eb94d229cb20aeb28960711'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:08.964584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-773f9bdc-8113-42ac-9ef0-1de56c59e3f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf205921eb94d229cb20aeb28960711'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:08.990571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:08.993120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:09.009831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 903/1803] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:08 2022] DELETE /identity/v3/users/dbf205921eb94d229cb20aeb28960711 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:09.024568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289788a5-459b-4de1-91e3-1749e3ebd9ad admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:09.200314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:09.201413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:09.202207 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:09.202722 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] PATH_INFO: `/v3/projects/e0fdc151af594363919a7b7a072a467f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:09.208173 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fdc151af594363919a7b7a072a467f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:09.210226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:09.376424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:09.440316 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fdc151af594363919a7b7a072a467f', 'request_id': 'req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:09.456125 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fdc151af594363919a7b7a072a467f', 'request_id': 'req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:09.469358 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fdc151af594363919a7b7a072a467f', 'request_id': 'req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:09.499313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] The token cache is being invalidate because project e0fdc151af594363919a7b7a072a467f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:09.499629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:09.507135 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:09.512014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 901/1804] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:08 2022] DELETE /identity/v3/projects/e0fdc151af594363919a7b7a072a467f => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:09.513449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f9bdc-8113-42ac-9ef0-1de56c59e3f5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:09.516062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-773f9bdc-8113-42ac-9ef0-1de56c59e3f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:09.604996 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f9bdc-8113-42ac-9ef0-1de56c59e3f5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:09.847772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c49f2-3214-475a-9877-db98cf46160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:09.848197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c49f2-3214-475a-9877-db98cf46160c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:09.848637 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c49f2-3214-475a-9877-db98cf46160c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:09.854840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c49f2-3214-475a-9877-db98cf46160c admin admin] PATH_INFO: `/v3/users/1a4d3403c7f84c2f889653510a23e37b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:09.858100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c49f2-3214-475a-9877-db98cf46160c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a4d3403c7f84c2f889653510a23e37b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:09.860491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c49f2-3214-475a-9877-db98cf46160c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:09.947780 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:09.997142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8c5c49f2-3214-475a-9877-db98cf46160c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a4d3403c7f84c2f889653510a23e37b'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:10.078913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8c5c49f2-3214-475a-9877-db98cf46160c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a4d3403c7f84c2f889653510a23e37b'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:10.103065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8c5c49f2-3214-475a-9877-db98cf46160c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a4d3403c7f84c2f889653510a23e37b'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:10.124011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8c5c49f2-3214-475a-9877-db98cf46160c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a4d3403c7f84c2f889653510a23e37b'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:10.135799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8c5c49f2-3214-475a-9877-db98cf46160c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a4d3403c7f84c2f889653510a23e37b'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:10.156657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 904/1805] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:09 2022] DELETE /identity/v3/users/1a4d3403c7f84c2f889653510a23e37b => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:10.713517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:10.716580 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:10.748378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e3d89-57a9-4e08-a8dc-a5f22ad0e7ea admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:10.859687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b438c5-fc0d-4a3b-9093-c807ead71e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:10.860656 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b438c5-fc0d-4a3b-9093-c807ead71e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:10.860943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b438c5-fc0d-4a3b-9093-c807ead71e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:10.861205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b438c5-fc0d-4a3b-9093-c807ead71e19 admin admin] PATH_INFO: `/v3/projects/a23ab0b4093448c0a3162204de47b1eb` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:10.863377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b438c5-fc0d-4a3b-9093-c807ead71e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23ab0b4093448c0a3162204de47b1eb)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:10.865885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b438c5-fc0d-4a3b-9093-c807ead71e19 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:10.937475 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-40b438c5-fc0d-4a3b-9093-c807ead71e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23ab0b4093448c0a3162204de47b1eb', 'request_id': 'req-40b438c5-fc0d-4a3b-9093-c807ead71e19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:10.945927 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-40b438c5-fc0d-4a3b-9093-c807ead71e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23ab0b4093448c0a3162204de47b1eb', 'request_id': 'req-40b438c5-fc0d-4a3b-9093-c807ead71e19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:10.958476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-40b438c5-fc0d-4a3b-9093-c807ead71e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23ab0b4093448c0a3162204de47b1eb', 'request_id': 'req-40b438c5-fc0d-4a3b-9093-c807ead71e19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:11.014743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-40b438c5-fc0d-4a3b-9093-c807ead71e19 admin admin] The token cache is being invalidate because project a23ab0b4093448c0a3162204de47b1eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:11.015195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-40b438c5-fc0d-4a3b-9093-c807ead71e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:11.016169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-40b438c5-fc0d-4a3b-9093-c807ead71e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:11.018582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 902/1806] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:10 2022] DELETE /identity/v3/projects/a23ab0b4093448c0a3162204de47b1eb => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:11.025594 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215cc5c-30e7-4053-b06f-aa5d7ae80cc2 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:11.026751 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215cc5c-30e7-4053-b06f-aa5d7ae80cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:11.027568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215cc5c-30e7-4053-b06f-aa5d7ae80cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:11.055032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-3215cc5c-30e7-4053-b06f-aa5d7ae80cc2 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:11.056544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3215cc5c-30e7-4053-b06f-aa5d7ae80cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:11.164103 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 905/1807] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:11.171889 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725d5d3-1ec9-4ee6-9ee0-28d1a723e8a9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:11.172602 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725d5d3-1ec9-4ee6-9ee0-28d1a723e8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:11.173174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725d5d3-1ec9-4ee6-9ee0-28d1a723e8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:11.232017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3725d5d3-1ec9-4ee6-9ee0-28d1a723e8a9 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:11.233385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3725d5d3-1ec9-4ee6-9ee0-28d1a723e8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:11.266099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 903/1808] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:11.271587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215cc5c-30e7-4053-b06f-aa5d7ae80cc2 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:11.341087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215cc5c-30e7-4053-b06f-aa5d7ae80cc2 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:11.365434 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1f3c3-23c6-4537-90b5-eed131f12f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:11.366754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1f3c3-23c6-4537-90b5-eed131f12f22 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:11.369406 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1f3c3-23c6-4537-90b5-eed131f12f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:11.371178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1f3c3-23c6-4537-90b5-eed131f12f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:11.379162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1f3c3-23c6-4537-90b5-eed131f12f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:11.380108 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1f3c3-23c6-4537-90b5-eed131f12f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:11.385686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1f3c3-23c6-4537-90b5-eed131f12f22 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:11.473331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 906/1809] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:11.473607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725d5d3-1ec9-4ee6-9ee0-28d1a723e8a9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:11.486684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725d5d3-1ec9-4ee6-9ee0-28d1a723e8a9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:11.500473 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84b561-87c6-4414-bcdd-7a3380a2d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:11.501262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84b561-87c6-4414-bcdd-7a3380a2d400 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:11.501666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1f3c3-23c6-4537-90b5-eed131f12f22 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:11.501884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84b561-87c6-4414-bcdd-7a3380a2d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:11.503304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84b561-87c6-4414-bcdd-7a3380a2d400 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:11.504268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84b561-87c6-4414-bcdd-7a3380a2d400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:11.510741 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-cda1f3c3-23c6-4537-90b5-eed131f12f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:11.512066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84b561-87c6-4414-bcdd-7a3380a2d400 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:11.574568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1f3c3-23c6-4537-90b5-eed131f12f22 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:11.574568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:11.574568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:11.574568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:11.574936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] PATH_INFO: `/v3/projects/8dae433d322d4a72bc534dd1f2d675ec` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:11.582234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dae433d322d4a72bc534dd1f2d675ec)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:11.588262 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:11.611953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 904/1810] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:11 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:11.616482 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84b561-87c6-4414-bcdd-7a3380a2d400 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:11.673533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:11.738571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84b561-87c6-4414-bcdd-7a3380a2d400 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:11.741824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dae433d322d4a72bc534dd1f2d675ec', 'request_id': 'req-2899594e-6399-43a6-affe-8c183b1cfad9'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:11.761629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dae433d322d4a72bc534dd1f2d675ec', 'request_id': 'req-2899594e-6399-43a6-affe-8c183b1cfad9'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:11.783944 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dae433d322d4a72bc534dd1f2d675ec', 'request_id': 'req-2899594e-6399-43a6-affe-8c183b1cfad9'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:11.841008 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] The token cache is being invalidate because project 8dae433d322d4a72bc534dd1f2d675ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:11.841320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:11.842161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:11.848940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 907/1811] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:11 2022] DELETE /identity/v3/projects/8dae433d322d4a72bc534dd1f2d675ec => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:11.850028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:11.851691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:11.932457 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fc4c1-ff42-468b-bfa1-7c644715ad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:11.933321 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fc4c1-ff42-468b-bfa1-7c644715ad1d admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:11.933649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fc4c1-ff42-468b-bfa1-7c644715ad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:11.933996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fc4c1-ff42-468b-bfa1-7c644715ad1d admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:11.934770 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fc4c1-ff42-468b-bfa1-7c644715ad1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:11.936991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fc4c1-ff42-468b-bfa1-7c644715ad1d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:11.939840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:11.969793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 905/1812] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:11 2022] POST /identity/v3/users => generated 291 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:11.974358 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fc4c1-ff42-468b-bfa1-7c644715ad1d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:11.978534 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0d1fc4c1-ff42-468b-bfa1-7c644715ad1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:12.010228 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fc4c1-ff42-468b-bfa1-7c644715ad1d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:12.022843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053254a8-1448-411c-9312-842e783cc132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:12.024894 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053254a8-1448-411c-9312-842e783cc132 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:12.026121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053254a8-1448-411c-9312-842e783cc132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:12.026521 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053254a8-1448-411c-9312-842e783cc132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:12.027542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053254a8-1448-411c-9312-842e783cc132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:12.032424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053254a8-1448-411c-9312-842e783cc132 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:12.044269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899594e-6399-43a6-affe-8c183b1cfad9 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:12.055966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 906/1813] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:12.060054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053254a8-1448-411c-9312-842e783cc132 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:12.061155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69861e8e-1390-47b0-9c3a-a88ecad3b307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:12.063053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69861e8e-1390-47b0-9c3a-a88ecad3b307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:12.063468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69861e8e-1390-47b0-9c3a-a88ecad3b307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:12.063808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69861e8e-1390-47b0-9c3a-a88ecad3b307 admin admin] PATH_INFO: `/v3/users/f37c8c039cc24231a899547a81835766` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:12.065271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69861e8e-1390-47b0-9c3a-a88ecad3b307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37c8c039cc24231a899547a81835766)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:12.067833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69861e8e-1390-47b0-9c3a-a88ecad3b307 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:12.081018 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053254a8-1448-411c-9312-842e783cc132 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:12.092366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be66c1-d435-4a46-8dfe-1bc95dbecc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:12.093351 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be66c1-d435-4a46-8dfe-1bc95dbecc25 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:12.095471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be66c1-d435-4a46-8dfe-1bc95dbecc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:12.095832 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be66c1-d435-4a46-8dfe-1bc95dbecc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:12.096801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be66c1-d435-4a46-8dfe-1bc95dbecc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:12.101130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be66c1-d435-4a46-8dfe-1bc95dbecc25 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:12.133241 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 907/1814] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:12.140188 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be66c1-d435-4a46-8dfe-1bc95dbecc25 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:12.158920 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be66c1-d435-4a46-8dfe-1bc95dbecc25 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:12.172690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888355b-6b59-41f5-a5cf-e26312b413d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:12.173391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888355b-6b59-41f5-a5cf-e26312b413d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:12.173734 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888355b-6b59-41f5-a5cf-e26312b413d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:12.174018 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888355b-6b59-41f5-a5cf-e26312b413d8 admin admin] PATH_INFO: `/v3/projects/3959a12225ac42e3aed564c5d7b1eac9/users/20da31bada9747588f3e93ea21d20d3f/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:12.177447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-69861e8e-1390-47b0-9c3a-a88ecad3b307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37c8c039cc24231a899547a81835766'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:12.230941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888355b-6b59-41f5-a5cf-e26312b413d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3959a12225ac42e3aed564c5d7b1eac9, user_id=20da31bada9747588f3e93ea21d20d3f, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:12.234664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888355b-6b59-41f5-a5cf-e26312b413d8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:12.235363 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-69861e8e-1390-47b0-9c3a-a88ecad3b307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37c8c039cc24231a899547a81835766'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:12.259194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-69861e8e-1390-47b0-9c3a-a88ecad3b307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37c8c039cc24231a899547a81835766'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:12.259500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 908/1815] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:12 2022] PUT /identity/v3/projects/3959a12225ac42e3aed564c5d7b1eac9/users/20da31bada9747588f3e93ea21d20d3f/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:12.274465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff42fb5-84a2-4f58-b65a-b34cf0003a4a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:12.275034 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff42fb5-84a2-4f58-b65a-b34cf0003a4a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:12.275432 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff42fb5-84a2-4f58-b65a-b34cf0003a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:12.288401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-69861e8e-1390-47b0-9c3a-a88ecad3b307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37c8c039cc24231a899547a81835766'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:12.291961 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-69861e8e-1390-47b0-9c3a-a88ecad3b307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37c8c039cc24231a899547a81835766'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:12.304982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 908/1816] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:11 2022] DELETE /identity/v3/users/f37c8c039cc24231a899547a81835766 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:12.336034 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8ff42fb5-84a2-4f58-b65a-b34cf0003a4a None None] MFA Rules not processed for user `20da31bada9747588f3e93ea21d20d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:12.337527 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8ff42fb5-84a2-4f58-b65a-b34cf0003a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:12.484542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 909/1817] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:12.489718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69861e8e-1390-47b0-9c3a-a88ecad3b307 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:12.491454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-69861e8e-1390-47b0-9c3a-a88ecad3b307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:12.608974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff42fb5-84a2-4f58-b65a-b34cf0003a4a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:12.610412 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8ff42fb5-84a2-4f58-b65a-b34cf0003a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:12.611659 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69861e8e-1390-47b0-9c3a-a88ecad3b307 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:12.619777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c2c2b-a8f5-4684-9f4d-f9249ac96453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:12.620934 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c2c2b-a8f5-4684-9f4d-f9249ac96453 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:12.621547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c2c2b-a8f5-4684-9f4d-f9249ac96453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:12.622582 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c2c2b-a8f5-4684-9f4d-f9249ac96453 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:12.623763 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c2c2b-a8f5-4684-9f4d-f9249ac96453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:12.625674 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:12.629187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c2c2b-a8f5-4684-9f4d-f9249ac96453 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:12.641557 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff42fb5-84a2-4f58-b65a-b34cf0003a4a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:12.648107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740a0d1-a1c6-4600-a107-30c73243045e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:12.649092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a0d1-a1c6-4600-a107-30c73243045e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:12.649667 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a0d1-a1c6-4600-a107-30c73243045e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:12.650159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a0d1-a1c6-4600-a107-30c73243045e admin admin] PATH_INFO: `/v3/users/f574cc1862284257bf16514d4c328f6a` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:12.651836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740a0d1-a1c6-4600-a107-30c73243045e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f574cc1862284257bf16514d4c328f6a)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:12.654961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740a0d1-a1c6-4600-a107-30c73243045e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:12.680199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 909/1818] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:12 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:12.686351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c2c2b-a8f5-4684-9f4d-f9249ac96453 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:12.761638 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:12.792217 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2740a0d1-a1c6-4600-a107-30c73243045e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f574cc1862284257bf16514d4c328f6a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:12.793160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2740a0d1-a1c6-4600-a107-30c73243045e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f574cc1862284257bf16514d4c328f6a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:12.793983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2740a0d1-a1c6-4600-a107-30c73243045e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f574cc1862284257bf16514d4c328f6a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:12.813546 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2740a0d1-a1c6-4600-a107-30c73243045e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f574cc1862284257bf16514d4c328f6a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:12.819406 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c2c2b-a8f5-4684-9f4d-f9249ac96453 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:12.827734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed431d-f894-45b4-bac2-6d5244cc92e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:12.828392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed431d-f894-45b4-bac2-6d5244cc92e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:12.828741 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed431d-f894-45b4-bac2-6d5244cc92e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:12.828914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed431d-f894-45b4-bac2-6d5244cc92e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:12.829699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed431d-f894-45b4-bac2-6d5244cc92e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:12.832589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed431d-f894-45b4-bac2-6d5244cc92e7 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:12.836536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2740a0d1-a1c6-4600-a107-30c73243045e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f574cc1862284257bf16514d4c328f6a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:12.886672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 910/1819] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:12 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:12.890424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed431d-f894-45b4-bac2-6d5244cc92e7 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:12.893427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c7ed431d-f894-45b4-bac2-6d5244cc92e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:12.901787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 910/1820] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:12 2022] DELETE /identity/v3/users/f574cc1862284257bf16514d4c328f6a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:12.904954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe03af-6953-4db6-b8b7-d0523e7e9fa0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:12.905774 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe03af-6953-4db6-b8b7-d0523e7e9fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:12.906438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe03af-6953-4db6-b8b7-d0523e7e9fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:12.929691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed431d-f894-45b4-bac2-6d5244cc92e7 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:12.955627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5ffe03af-6953-4db6-b8b7-d0523e7e9fa0 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:12.959228 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5ffe03af-6953-4db6-b8b7-d0523e7e9fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:13.063383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b5227-5be8-414b-ac94-3cf56029874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:13.064829 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5227-5be8-414b-ac94-3cf56029874b admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:13.066644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5227-5be8-414b-ac94-3cf56029874b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:13.067645 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5227-5be8-414b-ac94-3cf56029874b admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:13.068585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b5227-5be8-414b-ac94-3cf56029874b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:13.071431 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b5227-5be8-414b-ac94-3cf56029874b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:13.095174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 911/1821] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:13.103385 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 911/1822] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:13.107326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe03af-6953-4db6-b8b7-d0523e7e9fa0 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:13.125981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe03af-6953-4db6-b8b7-d0523e7e9fa0 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:13.132579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5a9b5-9d77-4d49-a373-f7dc507137f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:13.136138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5a9b5-9d77-4d49-a373-f7dc507137f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:13.136138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5a9b5-9d77-4d49-a373-f7dc507137f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:13.136138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5a9b5-9d77-4d49-a373-f7dc507137f6 admin admin] PATH_INFO: `/v3/projects/740823ca72894f7da6507fdac163de79/users/92a29dd7ba2c42159cbb88eefabddb26/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:13.152669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b5227-5be8-414b-ac94-3cf56029874b admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:13.155718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9c9b5227-5be8-414b-ac94-3cf56029874b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:13.161943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5a9b5-9d77-4d49-a373-f7dc507137f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=740823ca72894f7da6507fdac163de79, user_id=92a29dd7ba2c42159cbb88eefabddb26, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:13.166006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5a9b5-9d77-4d49-a373-f7dc507137f6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:13.192253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 912/1823] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:13 2022] PUT /identity/v3/projects/740823ca72894f7da6507fdac163de79/users/92a29dd7ba2c42159cbb88eefabddb26/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:13.197578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5a9b5-9d77-4d49-a373-f7dc507137f6 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:13.270713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b5227-5be8-414b-ac94-3cf56029874b admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:13.289815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:13.305332 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5a9b5-9d77-4d49-a373-f7dc507137f6 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:13.318635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029103c-89fd-40e5-9862-3942897ed378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:13.320609 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029103c-89fd-40e5-9862-3942897ed378 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:13.322153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029103c-89fd-40e5-9862-3942897ed378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:13.323338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029103c-89fd-40e5-9862-3942897ed378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:13.324562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029103c-89fd-40e5-9862-3942897ed378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:13.328581 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029103c-89fd-40e5-9862-3942897ed378 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:13.355081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 913/1824] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:13.359216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029103c-89fd-40e5-9862-3942897ed378 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:13.378627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029103c-89fd-40e5-9862-3942897ed378 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:13.385560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e12b0d-1d25-4362-bf50-3d7e9911f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:13.387385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e12b0d-1d25-4362-bf50-3d7e9911f744 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:13.387877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e12b0d-1d25-4362-bf50-3d7e9911f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:13.388520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e12b0d-1d25-4362-bf50-3d7e9911f744 admin admin] PATH_INFO: `/v3/projects/740823ca72894f7da6507fdac163de79/users/92a29dd7ba2c42159cbb88eefabddb26/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:13.392179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e12b0d-1d25-4362-bf50-3d7e9911f744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=740823ca72894f7da6507fdac163de79, user_id=92a29dd7ba2c42159cbb88eefabddb26, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:13.402752 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e12b0d-1d25-4362-bf50-3d7e9911f744 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:13.420277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead235b-bbd6-417f-80be-8d928b4e85e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:13.421433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead235b-bbd6-417f-80be-8d928b4e85e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:13.421433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead235b-bbd6-417f-80be-8d928b4e85e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:13.421726 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead235b-bbd6-417f-80be-8d928b4e85e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:13.424385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 914/1825] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:13 2022] PUT /identity/v3/projects/740823ca72894f7da6507fdac163de79/users/92a29dd7ba2c42159cbb88eefabddb26/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:13.441876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6e3c7-6fb2-4bea-b8da-10a0872fc0a2 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:13.443747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6e3c7-6fb2-4bea-b8da-10a0872fc0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:13.444330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6e3c7-6fb2-4bea-b8da-10a0872fc0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:13.447974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead235b-bbd6-417f-80be-8d928b4e85e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:13.453874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead235b-bbd6-417f-80be-8d928b4e85e2 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:13.490058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 912/1826] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:13.498351 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-52c6e3c7-6fb2-4bea-b8da-10a0872fc0a2 None None] MFA Rules not processed for user `92a29dd7ba2c42159cbb88eefabddb26`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:13.499862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-52c6e3c7-6fb2-4bea-b8da-10a0872fc0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:13.623860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 915/1827] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:13.639937 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead235b-bbd6-417f-80be-8d928b4e85e2 service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:13.642008 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-dead235b-bbd6-417f-80be-8d928b4e85e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:13.661648 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:13.751509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead235b-bbd6-417f-80be-8d928b4e85e2 service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:13.778630 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6e3c7-6fb2-4bea-b8da-10a0872fc0a2 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:13.780139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-52c6e3c7-6fb2-4bea-b8da-10a0872fc0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:13.840836 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479475c-72c9-498b-b924-5cfd0d57c609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:13.842364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479475c-72c9-498b-b924-5cfd0d57c609 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:13.844206 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479475c-72c9-498b-b924-5cfd0d57c609 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:13.844369 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479475c-72c9-498b-b924-5cfd0d57c609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:13.866965 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479475c-72c9-498b-b924-5cfd0d57c609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:13.868473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479475c-72c9-498b-b924-5cfd0d57c609 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:13.881486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 913/1828] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:13.893247 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6e3c7-6fb2-4bea-b8da-10a0872fc0a2 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:13.898142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3f983-f12b-4626-a76e-fd21ec6ac90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:13.898968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3f983-f12b-4626-a76e-fd21ec6ac90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:13.899315 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3f983-f12b-4626-a76e-fd21ec6ac90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:13.899677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3f983-f12b-4626-a76e-fd21ec6ac90d admin admin] PATH_INFO: `/v3/users/cca60fde7818417385653103062fc18f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:13.901072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3f983-f12b-4626-a76e-fd21ec6ac90d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca60fde7818417385653103062fc18f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:13.903152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3f983-f12b-4626-a76e-fd21ec6ac90d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:14.011049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-eeb3f983-f12b-4626-a76e-fd21ec6ac90d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca60fde7818417385653103062fc18f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:14.012713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-eeb3f983-f12b-4626-a76e-fd21ec6ac90d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca60fde7818417385653103062fc18f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:14.013746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-eeb3f983-f12b-4626-a76e-fd21ec6ac90d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca60fde7818417385653103062fc18f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:14.033394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-eeb3f983-f12b-4626-a76e-fd21ec6ac90d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca60fde7818417385653103062fc18f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:14.066732 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-eeb3f983-f12b-4626-a76e-fd21ec6ac90d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca60fde7818417385653103062fc18f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:14.068236 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:14.142779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 916/1829] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:13 2022] DELETE /identity/v3/users/cca60fde7818417385653103062fc18f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:14.149380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c0525-b06a-4eba-8ea9-59a6ce73bc11 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:14.150504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c0525-b06a-4eba-8ea9-59a6ce73bc11 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:14.151193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c0525-b06a-4eba-8ea9-59a6ce73bc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:14.180639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-6b8c0525-b06a-4eba-8ea9-59a6ce73bc11 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:14.182346 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-6b8c0525-b06a-4eba-8ea9-59a6ce73bc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:14.317783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 914/1830] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:14.366838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3f983-f12b-4626-a76e-fd21ec6ac90d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:14.368373 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-eeb3f983-f12b-4626-a76e-fd21ec6ac90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:14.395592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c0525-b06a-4eba-8ea9-59a6ce73bc11 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:14.397560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-6b8c0525-b06a-4eba-8ea9-59a6ce73bc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:14.425618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c0525-b06a-4eba-8ea9-59a6ce73bc11 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:14.438708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680b082-8f91-4bcc-8957-09c6e71d83d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:14.439345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680b082-8f91-4bcc-8957-09c6e71d83d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:14.439710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680b082-8f91-4bcc-8957-09c6e71d83d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:14.439991 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680b082-8f91-4bcc-8957-09c6e71d83d2 admin admin] PATH_INFO: `/v3/projects/db6380fb3ef945b39d5f5c02eb9b7c11` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:14.441376 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680b082-8f91-4bcc-8957-09c6e71d83d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6380fb3ef945b39d5f5c02eb9b7c11)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:14.444453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680b082-8f91-4bcc-8957-09c6e71d83d2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:14.463096 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3f983-f12b-4626-a76e-fd21ec6ac90d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:14.468355 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58253c9a-f95c-41ae-93cf-5b746e273445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:14.469296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253c9a-f95c-41ae-93cf-5b746e273445 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:14.469827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253c9a-f95c-41ae-93cf-5b746e273445 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:14.470963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253c9a-f95c-41ae-93cf-5b746e273445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:14.485262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58253c9a-f95c-41ae-93cf-5b746e273445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:14.487804 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58253c9a-f95c-41ae-93cf-5b746e273445 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:14.501824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 917/1831] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:14.550906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8680b082-8f91-4bcc-8957-09c6e71d83d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6380fb3ef945b39d5f5c02eb9b7c11', 'request_id': 'req-8680b082-8f91-4bcc-8957-09c6e71d83d2'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:14.565829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58253c9a-f95c-41ae-93cf-5b746e273445 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:14.567866 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-58253c9a-f95c-41ae-93cf-5b746e273445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:14.581100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8680b082-8f91-4bcc-8957-09c6e71d83d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6380fb3ef945b39d5f5c02eb9b7c11', 'request_id': 'req-8680b082-8f91-4bcc-8957-09c6e71d83d2'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:14.607040 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8680b082-8f91-4bcc-8957-09c6e71d83d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6380fb3ef945b39d5f5c02eb9b7c11', 'request_id': 'req-8680b082-8f91-4bcc-8957-09c6e71d83d2'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:14.612494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:14.628661 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8680b082-8f91-4bcc-8957-09c6e71d83d2 admin admin] The token cache is being invalidate because project db6380fb3ef945b39d5f5c02eb9b7c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:14.631881 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8680b082-8f91-4bcc-8957-09c6e71d83d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:14.633084 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8680b082-8f91-4bcc-8957-09c6e71d83d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:14.637916 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 915/1832] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:14 2022] DELETE /identity/v3/projects/db6380fb3ef945b39d5f5c02eb9b7c11 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:14.644285 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0fe6b-9348-4e80-8f56-79eaa3fd2f27 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:14.644820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0fe6b-9348-4e80-8f56-79eaa3fd2f27 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:14.645392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0fe6b-9348-4e80-8f56-79eaa3fd2f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:14.694893 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-13d0fe6b-9348-4e80-8f56-79eaa3fd2f27 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:14.697802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-13d0fe6b-9348-4e80-8f56-79eaa3fd2f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:14.753613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58253c9a-f95c-41ae-93cf-5b746e273445 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:14.851820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797c157-dcb8-42b1-a496-e81b362cd30f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92a29dd7ba2c42159cbb88eefabddb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '740823ca72894f7da6507fdac163de79', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:14.853584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797c157-dcb8-42b1-a496-e81b362cd30f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:14.854099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797c157-dcb8-42b1-a496-e81b362cd30f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:14.854621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797c157-dcb8-42b1-a496-e81b362cd30f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:14.857503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797c157-dcb8-42b1-a496-e81b362cd30f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:14.858317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797c157-dcb8-42b1-a496-e81b362cd30f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:14.862400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b797c157-dcb8-42b1-a496-e81b362cd30f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:14.885015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 918/1833] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:03:14.890283 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797c157-dcb8-42b1-a496-e81b362cd30f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:14.893980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b797c157-dcb8-42b1-a496-e81b362cd30f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:14.913375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797c157-dcb8-42b1-a496-e81b362cd30f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:14.920713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76009a-b97a-4b24-8773-52c0b61bade3 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92a29dd7ba2c42159cbb88eefabddb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '740823ca72894f7da6507fdac163de79', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:14.921908 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76009a-b97a-4b24-8773-52c0b61bade3 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:14.922421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76009a-b97a-4b24-8773-52c0b61bade3 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:14.922941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76009a-b97a-4b24-8773-52c0b61bade3 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:14.924827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76009a-b97a-4b24-8773-52c0b61bade3 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:14.927377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76009a-b97a-4b24-8773-52c0b61bade3 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:14.936027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 916/1834] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:14.937556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becae9-394d-4686-a30b-1a9282508617 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:14.937839 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becae9-394d-4686-a30b-1a9282508617 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:14.938110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becae9-394d-4686-a30b-1a9282508617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:14.971755 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-b8becae9-394d-4686-a30b-1a9282508617 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:14.974001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-b8becae9-394d-4686-a30b-1a9282508617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:14.983143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 919/1835] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:14 2022] POST /identity/v3/projects => generated 352 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:14.988083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51bc72-7a09-408d-bcbe-ab8e600fdf54 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:14.988884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51bc72-7a09-408d-bcbe-ab8e600fdf54 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:14.990647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51bc72-7a09-408d-bcbe-ab8e600fdf54 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:14.996551 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 920/1836] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 22 16:03:14 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:03:14.998915 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51bc72-7a09-408d-bcbe-ab8e600fdf54 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:15.014110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:15.103142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 917/1837] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:15.103745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5664618-051a-4640-969e-fc8c1791c419 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:15.104026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5664618-051a-4640-969e-fc8c1791c419 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:15.104302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5664618-051a-4640-969e-fc8c1791c419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:15.132151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-b5664618-051a-4640-969e-fc8c1791c419 None None] MFA Rules not processed for user `20e4a18ab77642baa9adb9a4b49fbcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:15.133565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-b5664618-051a-4640-969e-fc8c1791c419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:15.166036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51bc72-7a09-408d-bcbe-ab8e600fdf54 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:15.171760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c53a85-254b-4580-99c1-9d9e72ea2c10 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92a29dd7ba2c42159cbb88eefabddb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '740823ca72894f7da6507fdac163de79', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:15.172538 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53a85-254b-4580-99c1-9d9e72ea2c10 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:15.172928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53a85-254b-4580-99c1-9d9e72ea2c10 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:15.173703 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53a85-254b-4580-99c1-9d9e72ea2c10 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:15.174395 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c53a85-254b-4580-99c1-9d9e72ea2c10 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:15.174879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c53a85-254b-4580-99c1-9d9e72ea2c10 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:15.176959 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c53a85-254b-4580-99c1-9d9e72ea2c10 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:15.191546 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 921/1838] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:15.192826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c53a85-254b-4580-99c1-9d9e72ea2c10 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:15.208294 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c53a85-254b-4580-99c1-9d9e72ea2c10 tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:15.216892 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e077a-deef-4770-8883-27b5bc0eb953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:15.218070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e077a-deef-4770-8883-27b5bc0eb953 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:15.218799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e077a-deef-4770-8883-27b5bc0eb953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:15.219150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e077a-deef-4770-8883-27b5bc0eb953 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:15.219956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e077a-deef-4770-8883-27b5bc0eb953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:15.220328 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e077a-deef-4770-8883-27b5bc0eb953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:15.222424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e077a-deef-4770-8883-27b5bc0eb953 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:15.233554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 918/1839] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 22 16:03:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:15.247594 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 922/1840] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:15.250007 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5664618-051a-4640-969e-fc8c1791c419 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:15.250738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e077a-deef-4770-8883-27b5bc0eb953 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:15.267293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e077a-deef-4770-8883-27b5bc0eb953 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:15.268583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5664618-051a-4640-969e-fc8c1791c419 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:15.280349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92a29dd7ba2c42159cbb88eefabddb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '740823ca72894f7da6507fdac163de79', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:15.282271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:15.283682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:15.285205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] PATH_INFO: `/v3/projects/5ce65821ae294f4f8b16851ad227c5cc` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:15.287848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3ac3d-5467-4d49-8a48-5ee3fecd6aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:15.288821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5ce65821ae294f4f8b16851ad227c5cc)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:15.291689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ac3d-5467-4d49-8a48-5ee3fecd6aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:15.292017 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ac3d-5467-4d49-8a48-5ee3fecd6aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:15.292289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3ac3d-5467-4d49-8a48-5ee3fecd6aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:15.293632 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:15.294112 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3ac3d-5467-4d49-8a48-5ee3fecd6aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:15.301695 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3ac3d-5467-4d49-8a48-5ee3fecd6aa8 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:15.357986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 919/1841] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:15 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:15.359290 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3ac3d-5467-4d49-8a48-5ee3fecd6aa8 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:15.361466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-43a3ac3d-5467-4d49-8a48-5ee3fecd6aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:15.371442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:15.375937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ce65821ae294f4f8b16851ad227c5cc', 'request_id': 'req-e3a10f15-f827-4e31-a18a-f183f7239b9f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.387781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ce65821ae294f4f8b16851ad227c5cc', 'request_id': 'req-e3a10f15-f827-4e31-a18a-f183f7239b9f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.399009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ce65821ae294f4f8b16851ad227c5cc', 'request_id': 'req-e3a10f15-f827-4e31-a18a-f183f7239b9f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.421836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] The token cache is being invalidate because project 5ce65821ae294f4f8b16851ad227c5cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:15.422131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.423104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.431677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 923/1842] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:15 2022] DELETE /identity/v3/projects/5ce65821ae294f4f8b16851ad227c5cc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:15.432653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:15.442232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:15.471424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3ac3d-5467-4d49-8a48-5ee3fecd6aa8 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:15.477956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:15.477956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:15.477956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:15.478327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] PATH_INFO: `/v3/projects/4795b399d75c49008168fcf00f9ce483` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:15.480068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4795b399d75c49008168fcf00f9ce483)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:15.482202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:15.549852 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a10f15-f827-4e31-a18a-f183f7239b9f tempest-VolumeQuotaClassesTest-1058778944 tempest-VolumeQuotaClassesTest-1058778944-project-admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:15.551671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4795b399d75c49008168fcf00f9ce483', 'request_id': 'req-d91ac8fa-9678-42dc-934d-7cfc52971a03'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.564600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:15.571608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4795b399d75c49008168fcf00f9ce483', 'request_id': 'req-d91ac8fa-9678-42dc-934d-7cfc52971a03'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.580528 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4795b399d75c49008168fcf00f9ce483', 'request_id': 'req-d91ac8fa-9678-42dc-934d-7cfc52971a03'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.596522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] The token cache is being invalidate because project 4795b399d75c49008168fcf00f9ce483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:15.596822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.597492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.603026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 920/1843] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:15 2022] DELETE /identity/v3/projects/4795b399d75c49008168fcf00f9ce483 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:15.603026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:15.604406 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:15.639605 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a8e1c-c59d-4550-b22c-7bc36d6b91c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:15.640242 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a8e1c-c59d-4550-b22c-7bc36d6b91c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:15.640524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a8e1c-c59d-4550-b22c-7bc36d6b91c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:15.640801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a8e1c-c59d-4550-b22c-7bc36d6b91c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:15.641469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a8e1c-c59d-4550-b22c-7bc36d6b91c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:15.643775 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a8e1c-c59d-4550-b22c-7bc36d6b91c9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:15.674175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 924/1844] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:15 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:15.674175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a8e1c-c59d-4550-b22c-7bc36d6b91c9 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:15.674901 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-af7a8e1c-c59d-4550-b22c-7bc36d6b91c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:15.687149 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a8e1c-c59d-4550-b22c-7bc36d6b91c9 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:15.693281 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:15.694083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:15.694368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:15.694718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] PATH_INFO: `/v3/projects/3760d9c63dc14f8baa7813c3b2fe095c` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:15.696232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3760d9c63dc14f8baa7813c3b2fe095c)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:15.698363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:15.717876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ac8fa-9678-42dc-934d-7cfc52971a03 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:15.724640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bf0de-0212-4b07-a8e6-0f0074f1c0d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:15.725764 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bf0de-0212-4b07-a8e6-0f0074f1c0d8 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:15.726284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bf0de-0212-4b07-a8e6-0f0074f1c0d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:15.726783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bf0de-0212-4b07-a8e6-0f0074f1c0d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:15.729315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7e0bf0de-0212-4b07-a8e6-0f0074f1c0d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:15.747011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bf0de-0212-4b07-a8e6-0f0074f1c0d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:15.749005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bf0de-0212-4b07-a8e6-0f0074f1c0d8 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:15.770619 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3760d9c63dc14f8baa7813c3b2fe095c', 'request_id': 'req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.770806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 921/1845] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:15.770806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f297e-25aa-46fe-b4a8-cc5803b018f2 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:15.770806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f297e-25aa-46fe-b4a8-cc5803b018f2 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:15.770806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f297e-25aa-46fe-b4a8-cc5803b018f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:15.771326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3760d9c63dc14f8baa7813c3b2fe095c', 'request_id': 'req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.775924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3760d9c63dc14f8baa7813c3b2fe095c', 'request_id': 'req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.788904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] The token cache is being invalidate because project 3760d9c63dc14f8baa7813c3b2fe095c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:15.789195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.789876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.791725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 925/1846] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:15 2022] DELETE /identity/v3/projects/3760d9c63dc14f8baa7813c3b2fe095c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:15.792185 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:15.792649 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-de8f297e-25aa-46fe-b4a8-cc5803b018f2 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:15.793483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:15.793823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-de8f297e-25aa-46fe-b4a8-cc5803b018f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:15.809021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:15.862358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 922/1847] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:15.863830 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f297e-25aa-46fe-b4a8-cc5803b018f2 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:15.864931 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-de8f297e-25aa-46fe-b4a8-cc5803b018f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:15.866530 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c61893-ad4b-4eeb-a8ff-2ef092fd05d4 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:15.872528 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cef4e1-5352-481e-83db-0f5372e5b4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:15.873154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cef4e1-5352-481e-83db-0f5372e5b4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:15.873453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cef4e1-5352-481e-83db-0f5372e5b4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:15.873729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cef4e1-5352-481e-83db-0f5372e5b4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:15.874444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cef4e1-5352-481e-83db-0f5372e5b4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:15.876070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cef4e1-5352-481e-83db-0f5372e5b4b0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:15.878467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f297e-25aa-46fe-b4a8-cc5803b018f2 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:15.883946 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5f1fe-2e79-4c27-adcb-0042e3ec48d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:15.884708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f1fe-2e79-4c27-adcb-0042e3ec48d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:15.884993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f1fe-2e79-4c27-adcb-0042e3ec48d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:15.885264 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f1fe-2e79-4c27-adcb-0042e3ec48d6 admin admin] PATH_INFO: `/v3/users/20da31bada9747588f3e93ea21d20d3f` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:15.889060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 926/1848] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:15.890021 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cef4e1-5352-481e-83db-0f5372e5b4b0 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:15.891941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-23cef4e1-5352-481e-83db-0f5372e5b4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:15.902814 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5f1fe-2e79-4c27-adcb-0042e3ec48d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20da31bada9747588f3e93ea21d20d3f)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:15.904817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5f1fe-2e79-4c27-adcb-0042e3ec48d6 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:15.905676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cef4e1-5352-481e-83db-0f5372e5b4b0 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:15.911135 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a5ac3-7b47-47a8-809e-0a1f947942a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:15.911852 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a5ac3-7b47-47a8-809e-0a1f947942a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:15.912230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a5ac3-7b47-47a8-809e-0a1f947942a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:15.912575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a5ac3-7b47-47a8-809e-0a1f947942a4 admin admin] PATH_INFO: `/v3/users/d46aaeb14bd241dea9bd3678b1db8a39` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:15.913827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a5ac3-7b47-47a8-809e-0a1f947942a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d46aaeb14bd241dea9bd3678b1db8a39)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:15.915909 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a5ac3-7b47-47a8-809e-0a1f947942a4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:15.937996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:15.987262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fb7a5ac3-7b47-47a8-809e-0a1f947942a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd46aaeb14bd241dea9bd3678b1db8a39'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.988665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fb7a5ac3-7b47-47a8-809e-0a1f947942a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd46aaeb14bd241dea9bd3678b1db8a39'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.989155 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fb7a5ac3-7b47-47a8-809e-0a1f947942a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd46aaeb14bd241dea9bd3678b1db8a39'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:15.999330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fb7a5ac3-7b47-47a8-809e-0a1f947942a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd46aaeb14bd241dea9bd3678b1db8a39'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:16.004177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-19f5f1fe-2e79-4c27-adcb-0042e3ec48d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20da31bada9747588f3e93ea21d20d3f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:16.013741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fb7a5ac3-7b47-47a8-809e-0a1f947942a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd46aaeb14bd241dea9bd3678b1db8a39'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:16.034334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-19f5f1fe-2e79-4c27-adcb-0042e3ec48d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20da31bada9747588f3e93ea21d20d3f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:16.048041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-19f5f1fe-2e79-4c27-adcb-0042e3ec48d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20da31bada9747588f3e93ea21d20d3f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:16.051892 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 927/1849] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:15 2022] DELETE /identity/v3/users/d46aaeb14bd241dea9bd3678b1db8a39 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:16.053684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0f1f4-c38d-424d-83db-672c96854cad None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.055824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0f1f4-c38d-424d-83db-672c96854cad None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.056193 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0f1f4-c38d-424d-83db-672c96854cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.060431 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-19f5f1fe-2e79-4c27-adcb-0042e3ec48d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20da31bada9747588f3e93ea21d20d3f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:16.061171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-19f5f1fe-2e79-4c27-adcb-0042e3ec48d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20da31bada9747588f3e93ea21d20d3f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:16.075587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 923/1850] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:15 2022] DELETE /identity/v3/users/20da31bada9747588f3e93ea21d20d3f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:16.079608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5f1fe-2e79-4c27-adcb-0042e3ec48d6 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:16.081595 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4ff0f1f4-c38d-424d-83db-672c96854cad None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:16.082886 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4ff0f1f4-c38d-424d-83db-672c96854cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:16.083833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-19f5f1fe-2e79-4c27-adcb-0042e3ec48d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:16.157104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 928/1851] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:16.158982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf158b8c-d3b9-4bbe-b381-e296f83e34d6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.159095 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf158b8c-d3b9-4bbe-b381-e296f83e34d6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.159330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf158b8c-d3b9-4bbe-b381-e296f83e34d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.181512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-bf158b8c-d3b9-4bbe-b381-e296f83e34d6 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:16.182900 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bf158b8c-d3b9-4bbe-b381-e296f83e34d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:16.203884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 929/1852] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:16.207277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf158b8c-d3b9-4bbe-b381-e296f83e34d6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:16.221236 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf158b8c-d3b9-4bbe-b381-e296f83e34d6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:16.226589 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb0791-4569-49e2-9dd8-67ca68ae5b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:16.228740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb0791-4569-49e2-9dd8-67ca68ae5b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.229028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb0791-4569-49e2-9dd8-67ca68ae5b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.229307 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb0791-4569-49e2-9dd8-67ca68ae5b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.229983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb0791-4569-49e2-9dd8-67ca68ae5b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:16.230286 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb0791-4569-49e2-9dd8-67ca68ae5b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:16.232216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb0791-4569-49e2-9dd8-67ca68ae5b12 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:16.238178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5f1fe-2e79-4c27-adcb-0042e3ec48d6 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:16.247567 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 930/1853] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:16.249589 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f514e-cdd0-43f5-a2a4-8ed2b4354c75 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.249880 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f514e-cdd0-43f5-a2a4-8ed2b4354c75 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.250163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f514e-cdd0-43f5-a2a4-8ed2b4354c75 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.250511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230967b-5b5f-4b37-93bd-c9f2f62a8943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:16.251168 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230967b-5b5f-4b37-93bd-c9f2f62a8943 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.251446 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230967b-5b5f-4b37-93bd-c9f2f62a8943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.251716 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230967b-5b5f-4b37-93bd-c9f2f62a8943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.251938 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 931/1854] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 22 16:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:03:16.252370 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230967b-5b5f-4b37-93bd-c9f2f62a8943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:16.252676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f514e-cdd0-43f5-a2a4-8ed2b4354c75 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:16.253997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230967b-5b5f-4b37-93bd-c9f2f62a8943 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:16.254379 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b24f514e-cdd0-43f5-a2a4-8ed2b4354c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:16.277520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 924/1855] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:16.278404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230967b-5b5f-4b37-93bd-c9f2f62a8943 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:16.309092 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230967b-5b5f-4b37-93bd-c9f2f62a8943 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:16.322132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5de8d-902d-45fc-84ab-bd9fd28f8f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:16.323288 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5de8d-902d-45fc-84ab-bd9fd28f8f00 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.323765 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5de8d-902d-45fc-84ab-bd9fd28f8f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.324587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5de8d-902d-45fc-84ab-bd9fd28f8f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.325430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5de8d-902d-45fc-84ab-bd9fd28f8f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:16.328007 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5de8d-902d-45fc-84ab-bd9fd28f8f00 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:16.334671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f514e-cdd0-43f5-a2a4-8ed2b4354c75 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:16.338319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c826876-c550-47d4-a3bf-223f72176ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:16.339147 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c826876-c550-47d4-a3bf-223f72176ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.339432 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c826876-c550-47d4-a3bf-223f72176ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.339707 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c826876-c550-47d4-a3bf-223f72176ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.350966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c826876-c550-47d4-a3bf-223f72176ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:16.352888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c826876-c550-47d4-a3bf-223f72176ac8 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:16.364705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 932/1856] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:16.365577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c826876-c550-47d4-a3bf-223f72176ac8 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:16.377163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c826876-c550-47d4-a3bf-223f72176ac8 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:16.383458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7912c-b33a-49c5-9174-64e7292e67c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:16.384331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7912c-b33a-49c5-9174-64e7292e67c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.384741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7912c-b33a-49c5-9174-64e7292e67c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.385022 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7912c-b33a-49c5-9174-64e7292e67c2 admin admin] PATH_INFO: `/v3/projects/0ac1b25e461845b5bf66ba4867b82973/users/77aaf72a2ac04194b3b5267dae7bff46/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.395157 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 925/1857] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:16 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:16.404706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7912c-b33a-49c5-9174-64e7292e67c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac1b25e461845b5bf66ba4867b82973, user_id=77aaf72a2ac04194b3b5267dae7bff46, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:16.406152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5de8d-902d-45fc-84ab-bd9fd28f8f00 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:16.407761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7912c-b33a-49c5-9174-64e7292e67c2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:16.410535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:16.425632 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:16.442443 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 933/1858] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:16 2022] PUT /identity/v3/projects/0ac1b25e461845b5bf66ba4867b82973/users/77aaf72a2ac04194b3b5267dae7bff46/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:16.447339 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10835614-deb2-4fa9-a73a-48de6648edd1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.447633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10835614-deb2-4fa9-a73a-48de6648edd1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.447912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10835614-deb2-4fa9-a73a-48de6648edd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.486456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-10835614-deb2-4fa9-a73a-48de6648edd1 None None] MFA Rules not processed for user `20e4a18ab77642baa9adb9a4b49fbcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:16.486456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-10835614-deb2-4fa9-a73a-48de6648edd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:16.581246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5de8d-902d-45fc-84ab-bd9fd28f8f00 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:16.614166 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 934/1859] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 22 16:03:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:16.615964 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6011ee3-d905-4de6-b86e-fde4e347f0a6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.616394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6011ee3-d905-4de6-b86e-fde4e347f0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.617014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6011ee3-d905-4de6-b86e-fde4e347f0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.661100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e6011ee3-d905-4de6-b86e-fde4e347f0a6 None None] MFA Rules not processed for user `77aaf72a2ac04194b3b5267dae7bff46`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:16.662634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e6011ee3-d905-4de6-b86e-fde4e347f0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:16.676100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e54a90-623e-422d-8fa8-2095bb83ab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:16.676830 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e54a90-623e-422d-8fa8-2095bb83ab42 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.677514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e54a90-623e-422d-8fa8-2095bb83ab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.677867 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e54a90-623e-422d-8fa8-2095bb83ab42 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.678813 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e54a90-623e-422d-8fa8-2095bb83ab42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:16.681171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e54a90-623e-422d-8fa8-2095bb83ab42 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:16.714811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 926/1860] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:16 2022] POST /identity/v3/users => generated 287 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:16.719681 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e54a90-623e-422d-8fa8-2095bb83ab42 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:16.751021 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 935/1861] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:16.755412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e54a90-623e-422d-8fa8-2095bb83ab42 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:16.765474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6011ee3-d905-4de6-b86e-fde4e347f0a6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:16.768665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ce393-d45a-458a-a585-5aca793fe5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:16.769513 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ce393-d45a-458a-a585-5aca793fe5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.770011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ce393-d45a-458a-a585-5aca793fe5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.770358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ce393-d45a-458a-a585-5aca793fe5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.770481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e6011ee3-d905-4de6-b86e-fde4e347f0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:16.771943 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ce393-d45a-458a-a585-5aca793fe5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:16.773691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ce393-d45a-458a-a585-5aca793fe5f5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:16.790164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 927/1862] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:16.791242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ce393-d45a-458a-a585-5aca793fe5f5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:16.809784 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ce393-d45a-458a-a585-5aca793fe5f5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:16.825256 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd3107-b948-42c8-af2b-bdb9e59b45f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:16.827036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd3107-b948-42c8-af2b-bdb9e59b45f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.830154 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd3107-b948-42c8-af2b-bdb9e59b45f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.830828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd3107-b948-42c8-af2b-bdb9e59b45f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.832702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd3107-b948-42c8-af2b-bdb9e59b45f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:16.837487 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd3107-b948-42c8-af2b-bdb9e59b45f3 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:16.853363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6011ee3-d905-4de6-b86e-fde4e347f0a6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:16.857661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a87773-9925-4209-af88-ceebbd3f623b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:16.858279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a87773-9925-4209-af88-ceebbd3f623b service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.858699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a87773-9925-4209-af88-ceebbd3f623b service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.858982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a87773-9925-4209-af88-ceebbd3f623b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.864414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 928/1863] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:16.877704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a87773-9925-4209-af88-ceebbd3f623b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:16.877935 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd3107-b948-42c8-af2b-bdb9e59b45f3 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:16.878049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a87773-9925-4209-af88-ceebbd3f623b service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:16.882385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 936/1864] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:16.887450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a87773-9925-4209-af88-ceebbd3f623b service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:16.896682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-24a87773-9925-4209-af88-ceebbd3f623b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:16.912010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd3107-b948-42c8-af2b-bdb9e59b45f3 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:16.923059 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d38ccd-9a2f-4907-a813-434f01a19a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:16.923742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d38ccd-9a2f-4907-a813-434f01a19a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.924024 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d38ccd-9a2f-4907-a813-434f01a19a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.924353 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d38ccd-9a2f-4907-a813-434f01a19a3b admin admin] PATH_INFO: `/v3/projects/a1bb560431b845a7adc69fa741579121/users/0c4177393c6b4f31990a02d459560271/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.933423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a87773-9925-4209-af88-ceebbd3f623b service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:16.945569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfb8d8-1ff1-4efe-82cf-528ec15fd2b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:16.949707 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfb8d8-1ff1-4efe-82cf-528ec15fd2b7 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:16.951030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfb8d8-1ff1-4efe-82cf-528ec15fd2b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:16.951829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfb8d8-1ff1-4efe-82cf-528ec15fd2b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:16.963306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d38ccd-9a2f-4907-a813-434f01a19a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1bb560431b845a7adc69fa741579121, user_id=0c4177393c6b4f31990a02d459560271, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:16.966572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfb8d8-1ff1-4efe-82cf-528ec15fd2b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:16.968549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfb8d8-1ff1-4efe-82cf-528ec15fd2b7 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:16.968681 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d38ccd-9a2f-4907-a813-434f01a19a3b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:16.983513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 937/1865] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:16.984487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfb8d8-1ff1-4efe-82cf-528ec15fd2b7 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:16.986059 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b8dfb8d8-1ff1-4efe-82cf-528ec15fd2b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:16.997941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:17.002961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfb8d8-1ff1-4efe-82cf-528ec15fd2b7 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:17.013711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 929/1866] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:16 2022] PUT /identity/v3/projects/a1bb560431b845a7adc69fa741579121/users/0c4177393c6b4f31990a02d459560271/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:17.014669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d38ccd-9a2f-4907-a813-434f01a19a3b admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:17.087527 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7907c6-b373-4dc1-a587-0a937eafd388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:17.088669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7907c6-b373-4dc1-a587-0a937eafd388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:17.089186 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7907c6-b373-4dc1-a587-0a937eafd388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:17.089559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7907c6-b373-4dc1-a587-0a937eafd388 admin admin] PATH_INFO: `/v3/projects/e19c4d554d734cb7affd9e89158ed21d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:17.091677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7907c6-b373-4dc1-a587-0a937eafd388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19c4d554d734cb7affd9e89158ed21d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:17.095058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7907c6-b373-4dc1-a587-0a937eafd388 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:17.149961 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:17.156458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d38ccd-9a2f-4907-a813-434f01a19a3b admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:17.174921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a3f9a-3cac-48a7-a00b-a2389948adc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:17.175974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3f9a-3cac-48a7-a00b-a2389948adc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:17.176258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3f9a-3cac-48a7-a00b-a2389948adc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:17.176531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3f9a-3cac-48a7-a00b-a2389948adc3 admin admin] PATH_INFO: `/v3/users/77aaf72a2ac04194b3b5267dae7bff46` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:17.177821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a3f9a-3cac-48a7-a00b-a2389948adc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77aaf72a2ac04194b3b5267dae7bff46)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:17.179832 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a3f9a-3cac-48a7-a00b-a2389948adc3 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:17.189481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ae7907c6-b373-4dc1-a587-0a937eafd388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19c4d554d734cb7affd9e89158ed21d', 'request_id': 'req-ae7907c6-b373-4dc1-a587-0a937eafd388'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.197111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ae7907c6-b373-4dc1-a587-0a937eafd388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19c4d554d734cb7affd9e89158ed21d', 'request_id': 'req-ae7907c6-b373-4dc1-a587-0a937eafd388'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.207536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ae7907c6-b373-4dc1-a587-0a937eafd388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19c4d554d734cb7affd9e89158ed21d', 'request_id': 'req-ae7907c6-b373-4dc1-a587-0a937eafd388'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.223403 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ae7907c6-b373-4dc1-a587-0a937eafd388 admin admin] The token cache is being invalidate because project e19c4d554d734cb7affd9e89158ed21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:17.223902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ae7907c6-b373-4dc1-a587-0a937eafd388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.224540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ae7907c6-b373-4dc1-a587-0a937eafd388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.231110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 938/1867] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:16 2022] DELETE /identity/v3/projects/e19c4d554d734cb7affd9e89158ed21d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:17.231110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3750c88-aec2-47fa-9cdc-0c2e6a330026 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:17.231110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3750c88-aec2-47fa-9cdc-0c2e6a330026 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:17.231110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3750c88-aec2-47fa-9cdc-0c2e6a330026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:17.244879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-398a3f9a-3cac-48a7-a00b-a2389948adc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77aaf72a2ac04194b3b5267dae7bff46'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.260072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-398a3f9a-3cac-48a7-a00b-a2389948adc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77aaf72a2ac04194b3b5267dae7bff46'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.265852 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c3750c88-aec2-47fa-9cdc-0c2e6a330026 None None] MFA Rules not processed for user `0c4177393c6b4f31990a02d459560271`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:17.267060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c3750c88-aec2-47fa-9cdc-0c2e6a330026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:17.269854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-398a3f9a-3cac-48a7-a00b-a2389948adc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77aaf72a2ac04194b3b5267dae7bff46'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.278938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-398a3f9a-3cac-48a7-a00b-a2389948adc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77aaf72a2ac04194b3b5267dae7bff46'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.279670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-398a3f9a-3cac-48a7-a00b-a2389948adc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77aaf72a2ac04194b3b5267dae7bff46'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.286654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 930/1868] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:17 2022] DELETE /identity/v3/users/77aaf72a2ac04194b3b5267dae7bff46 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:17.288340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d4700-8564-4136-9d37-2b06656dca9f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:17.288340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d4700-8564-4136-9d37-2b06656dca9f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:17.288340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d4700-8564-4136-9d37-2b06656dca9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:17.315120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-8f5d4700-8564-4136-9d37-2b06656dca9f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:17.316287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8f5d4700-8564-4136-9d37-2b06656dca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:17.363625 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 939/1869] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:17.368178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39d88-6ad6-4869-8c02-7f5659307a02 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:17.368397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39d88-6ad6-4869-8c02-7f5659307a02 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:17.368675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e39d88-6ad6-4869-8c02-7f5659307a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:17.388399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-69e39d88-6ad6-4869-8c02-7f5659307a02 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:17.389621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-69e39d88-6ad6-4869-8c02-7f5659307a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:17.398712 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 931/1870] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:17.399595 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d4700-8564-4136-9d37-2b06656dca9f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:17.400909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8f5d4700-8564-4136-9d37-2b06656dca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:17.413294 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d4700-8564-4136-9d37-2b06656dca9f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:17.413690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:17.418414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964cbff-1d98-4650-a345-b3145cb31e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:17.419086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964cbff-1d98-4650-a345-b3145cb31e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:17.419367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964cbff-1d98-4650-a345-b3145cb31e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:17.419653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964cbff-1d98-4650-a345-b3145cb31e46 admin admin] PATH_INFO: `/v3/projects/3959a12225ac42e3aed564c5d7b1eac9` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:17.420791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964cbff-1d98-4650-a345-b3145cb31e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3959a12225ac42e3aed564c5d7b1eac9)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:17.422762 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964cbff-1d98-4650-a345-b3145cb31e46 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:17.462130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 940/1871] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:17.463882 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39d88-6ad6-4869-8c02-7f5659307a02 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:17.465906 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-69e39d88-6ad6-4869-8c02-7f5659307a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:17.477101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b964cbff-1d98-4650-a345-b3145cb31e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3959a12225ac42e3aed564c5d7b1eac9', 'request_id': 'req-b964cbff-1d98-4650-a345-b3145cb31e46'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.483480 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e39d88-6ad6-4869-8c02-7f5659307a02 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:17.486695 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b964cbff-1d98-4650-a345-b3145cb31e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3959a12225ac42e3aed564c5d7b1eac9', 'request_id': 'req-b964cbff-1d98-4650-a345-b3145cb31e46'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.494258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b964cbff-1d98-4650-a345-b3145cb31e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3959a12225ac42e3aed564c5d7b1eac9', 'request_id': 'req-b964cbff-1d98-4650-a345-b3145cb31e46'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.501603 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:17.505416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b964cbff-1d98-4650-a345-b3145cb31e46 admin admin] The token cache is being invalidate because project 3959a12225ac42e3aed564c5d7b1eac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:17.505707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b964cbff-1d98-4650-a345-b3145cb31e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.506608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b964cbff-1d98-4650-a345-b3145cb31e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.508423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 932/1872] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:17 2022] DELETE /identity/v3/projects/3959a12225ac42e3aed564c5d7b1eac9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:17.509725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb6fa4-cf23-446f-b3ba-bb8a50703288 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:17.510441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb6fa4-cf23-446f-b3ba-bb8a50703288 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:17.510713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb6fa4-cf23-446f-b3ba-bb8a50703288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:17.533858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1efb6fa4-cf23-446f-b3ba-bb8a50703288 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:17.535863 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1efb6fa4-cf23-446f-b3ba-bb8a50703288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:17.548464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072e016-2197-4315-981a-925e2ecbc5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:17.549089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072e016-2197-4315-981a-925e2ecbc5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:17.549675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072e016-2197-4315-981a-925e2ecbc5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:17.549857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072e016-2197-4315-981a-925e2ecbc5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:17.550529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072e016-2197-4315-981a-925e2ecbc5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:17.552495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072e016-2197-4315-981a-925e2ecbc5d9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:17.616230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 941/1873] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:17 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:17.618433 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072e016-2197-4315-981a-925e2ecbc5d9 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:17.622404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9072e016-2197-4315-981a-925e2ecbc5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:17.624041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 933/1874] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:17.624702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb6fa4-cf23-446f-b3ba-bb8a50703288 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:17.626176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1efb6fa4-cf23-446f-b3ba-bb8a50703288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:17.640771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb6fa4-cf23-446f-b3ba-bb8a50703288 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:17.712238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7288d72-a1fa-4dab-9059-e5b9069b2553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:17.713845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7288d72-a1fa-4dab-9059-e5b9069b2553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:17.714298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7288d72-a1fa-4dab-9059-e5b9069b2553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:17.714578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7288d72-a1fa-4dab-9059-e5b9069b2553 admin admin] PATH_INFO: `/v3/users/92a29dd7ba2c42159cbb88eefabddb26` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:17.715895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7288d72-a1fa-4dab-9059-e5b9069b2553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92a29dd7ba2c42159cbb88eefabddb26)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:17.718500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7288d72-a1fa-4dab-9059-e5b9069b2553 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:17.720312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072e016-2197-4315-981a-925e2ecbc5d9 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:17.726089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997961ad-fbe6-4310-81bc-dc75d8b58adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:17.728166 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997961ad-fbe6-4310-81bc-dc75d8b58adb service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:17.728658 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997961ad-fbe6-4310-81bc-dc75d8b58adb service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:17.729099 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997961ad-fbe6-4310-81bc-dc75d8b58adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:17.732131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-997961ad-fbe6-4310-81bc-dc75d8b58adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:17.751570 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997961ad-fbe6-4310-81bc-dc75d8b58adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:17.754402 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997961ad-fbe6-4310-81bc-dc75d8b58adb service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:17.772502 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 942/1875] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:17.774319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997961ad-fbe6-4310-81bc-dc75d8b58adb service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:17.777856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-997961ad-fbe6-4310-81bc-dc75d8b58adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:17.784110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a7288d72-a1fa-4dab-9059-e5b9069b2553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92a29dd7ba2c42159cbb88eefabddb26'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.801295 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a7288d72-a1fa-4dab-9059-e5b9069b2553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92a29dd7ba2c42159cbb88eefabddb26'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.805396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997961ad-fbe6-4310-81bc-dc75d8b58adb service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:17.816650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2666204-62dc-49f2-9509-b9b1b8b92b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:17.817707 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2666204-62dc-49f2-9509-b9b1b8b92b2f admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:17.818293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2666204-62dc-49f2-9509-b9b1b8b92b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:17.819196 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2666204-62dc-49f2-9509-b9b1b8b92b2f admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:17.821613 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a7288d72-a1fa-4dab-9059-e5b9069b2553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92a29dd7ba2c42159cbb88eefabddb26'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.822073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2666204-62dc-49f2-9509-b9b1b8b92b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:17.825895 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2666204-62dc-49f2-9509-b9b1b8b92b2f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:17.829925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a7288d72-a1fa-4dab-9059-e5b9069b2553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92a29dd7ba2c42159cbb88eefabddb26'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.830491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a7288d72-a1fa-4dab-9059-e5b9069b2553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92a29dd7ba2c42159cbb88eefabddb26'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:17.847968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 934/1876] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:17 2022] DELETE /identity/v3/users/92a29dd7ba2c42159cbb88eefabddb26 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:17.847968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7288d72-a1fa-4dab-9059-e5b9069b2553 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:17.850186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a7288d72-a1fa-4dab-9059-e5b9069b2553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:17.908049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 943/1877] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:17 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:17.909338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2666204-62dc-49f2-9509-b9b1b8b92b2f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:17.914932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:17.917813 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f2666204-62dc-49f2-9509-b9b1b8b92b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:17.953737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2666204-62dc-49f2-9509-b9b1b8b92b2f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:18.007840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7288d72-a1fa-4dab-9059-e5b9069b2553 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:18.010028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:18.021801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d7ca5-de76-4f99-9888-ff3fd77c6f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:18.022378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d7ca5-de76-4f99-9888-ff3fd77c6f6c admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:18.022682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d7ca5-de76-4f99-9888-ff3fd77c6f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:18.022954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d7ca5-de76-4f99-9888-ff3fd77c6f6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:18.024290 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d7ca5-de76-4f99-9888-ff3fd77c6f6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:18.024474 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d7ca5-de76-4f99-9888-ff3fd77c6f6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:18.026086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d7ca5-de76-4f99-9888-ff3fd77c6f6c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:18.053324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 935/1878] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:18.057998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d7ca5-de76-4f99-9888-ff3fd77c6f6c admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:18.066391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b49c8-b128-4a0f-ba04-986b67d318de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:18.067091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b49c8-b128-4a0f-ba04-986b67d318de admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:18.067372 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b49c8-b128-4a0f-ba04-986b67d318de admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:18.067644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b49c8-b128-4a0f-ba04-986b67d318de admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:18.069945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b49c8-b128-4a0f-ba04-986b67d318de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:18.072180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b49c8-b128-4a0f-ba04-986b67d318de admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:18.075013 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d7ca5-de76-4f99-9888-ff3fd77c6f6c admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:18.081616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de7e4c-7ef1-4384-9e8e-944de68d9fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:18.082423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de7e4c-7ef1-4384-9e8e-944de68d9fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:18.082832 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de7e4c-7ef1-4384-9e8e-944de68d9fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:18.083893 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de7e4c-7ef1-4384-9e8e-944de68d9fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:18.085003 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de7e4c-7ef1-4384-9e8e-944de68d9fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:18.087654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de7e4c-7ef1-4384-9e8e-944de68d9fd5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:18.097700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 944/1879] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:18.098939 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b49c8-b128-4a0f-ba04-986b67d318de admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:18.118973 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b49c8-b128-4a0f-ba04-986b67d318de admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:18.124117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2ff07-7732-48c8-9a8c-58430229dc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:18.124809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ff07-7732-48c8-9a8c-58430229dc7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:18.125092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ff07-7732-48c8-9a8c-58430229dc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:18.125371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2ff07-7732-48c8-9a8c-58430229dc7c admin admin] PATH_INFO: `/v3/projects/1c94e683255d48adaea7e1ca550f59cd/users/b61973bd3faa425895ebc8f57790c876/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:18.133138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 936/1880] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:18 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:18.139739 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de7e4c-7ef1-4384-9e8e-944de68d9fd5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:18.177582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2ff07-7732-48c8-9a8c-58430229dc7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c94e683255d48adaea7e1ca550f59cd, user_id=b61973bd3faa425895ebc8f57790c876, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:18.180762 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2ff07-7732-48c8-9a8c-58430229dc7c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:18.215594 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 945/1881] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:18 2022] PUT /identity/v3/projects/1c94e683255d48adaea7e1ca550f59cd/users/b61973bd3faa425895ebc8f57790c876/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:18.218167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2ff07-7732-48c8-9a8c-58430229dc7c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:18.345865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de7e4c-7ef1-4384-9e8e-944de68d9fd5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:18.426240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2ff07-7732-48c8-9a8c-58430229dc7c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:18.435259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17e084-fd2f-42f4-903e-3d3966a4e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:18.437114 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e084-fd2f-42f4-903e-3d3966a4e592 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:18.440053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e084-fd2f-42f4-903e-3d3966a4e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:18.440401 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e084-fd2f-42f4-903e-3d3966a4e592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:18.441093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17e084-fd2f-42f4-903e-3d3966a4e592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:18.442799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17e084-fd2f-42f4-903e-3d3966a4e592 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:18.465395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa87d5-c9e7-4552-bc3c-5c009608cdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:18.466245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa87d5-c9e7-4552-bc3c-5c009608cdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:18.466534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa87d5-c9e7-4552-bc3c-5c009608cdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:18.466856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa87d5-c9e7-4552-bc3c-5c009608cdb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:18.470616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa87d5-c9e7-4552-bc3c-5c009608cdb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:18.470755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 946/1882] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:18.470852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa87d5-c9e7-4552-bc3c-5c009608cdb9 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:18.471740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17e084-fd2f-42f4-903e-3d3966a4e592 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:18.495857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17e084-fd2f-42f4-903e-3d3966a4e592 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:18.502304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707d58c-842c-4624-9f5c-6ae5dd9ba277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:18.503043 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707d58c-842c-4624-9f5c-6ae5dd9ba277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:18.503317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707d58c-842c-4624-9f5c-6ae5dd9ba277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:18.503596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707d58c-842c-4624-9f5c-6ae5dd9ba277 admin admin] PATH_INFO: `/v3/projects/1c94e683255d48adaea7e1ca550f59cd/users/b61973bd3faa425895ebc8f57790c876/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:18.505594 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707d58c-842c-4624-9f5c-6ae5dd9ba277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c94e683255d48adaea7e1ca550f59cd, user_id=b61973bd3faa425895ebc8f57790c876, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:18.507844 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 937/1883] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:18 2022] POST /identity/v3/users => generated 294 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:18.511789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa87d5-c9e7-4552-bc3c-5c009608cdb9 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:18.522565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa87d5-c9e7-4552-bc3c-5c009608cdb9 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:18.527734 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707d58c-842c-4624-9f5c-6ae5dd9ba277 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:18.531580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd925623-727b-46cd-930b-cad267a4da76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:18.533381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd925623-727b-46cd-930b-cad267a4da76 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:18.534296 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd925623-727b-46cd-930b-cad267a4da76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:18.534582 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd925623-727b-46cd-930b-cad267a4da76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:18.535728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd925623-727b-46cd-930b-cad267a4da76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:18.538540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd925623-727b-46cd-930b-cad267a4da76 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:18.561375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 947/1884] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:18 2022] PUT /identity/v3/projects/1c94e683255d48adaea7e1ca550f59cd/users/b61973bd3faa425895ebc8f57790c876/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:18.561840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 938/1885] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:18.562330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707d58c-842c-4624-9f5c-6ae5dd9ba277 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:18.572867 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640df57-f17b-4f61-a9ab-459ec591cd4f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:18.573153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640df57-f17b-4f61-a9ab-459ec591cd4f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:18.573434 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640df57-f17b-4f61-a9ab-459ec591cd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:18.642036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-4640df57-f17b-4f61-a9ab-459ec591cd4f None None] MFA Rules not processed for user `b61973bd3faa425895ebc8f57790c876`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:18.643812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4640df57-f17b-4f61-a9ab-459ec591cd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:18.650773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:18.680031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707d58c-842c-4624-9f5c-6ae5dd9ba277 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:18.694280 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaa97a-795f-420d-9a38-1b399cb286d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:18.695564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaa97a-795f-420d-9a38-1b399cb286d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:18.695856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaa97a-795f-420d-9a38-1b399cb286d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:18.696136 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaa97a-795f-420d-9a38-1b399cb286d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:18.696809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aaa97a-795f-420d-9a38-1b399cb286d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:18.705568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aaa97a-795f-420d-9a38-1b399cb286d9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:18.731007 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 948/1886] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:18.735495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaa97a-795f-420d-9a38-1b399cb286d9 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:18.757702 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaa97a-795f-420d-9a38-1b399cb286d9 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:18.768739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccaea3-6fb6-4628-ae2d-9f784b2bc58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:18.769994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccaea3-6fb6-4628-ae2d-9f784b2bc58c admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:18.770275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccaea3-6fb6-4628-ae2d-9f784b2bc58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:18.770619 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccaea3-6fb6-4628-ae2d-9f784b2bc58c admin admin] PATH_INFO: `/v3/projects/f0c704cc27fd44478d523f4dcc5c930b/users/0cc1b8878d6545caac1ee36fd02de584/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:18.775495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 939/1887] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:18.785466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640df57-f17b-4f61-a9ab-459ec591cd4f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:18.786919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4640df57-f17b-4f61-a9ab-459ec591cd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:18.815365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccaea3-6fb6-4628-ae2d-9f784b2bc58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c704cc27fd44478d523f4dcc5c930b, user_id=0cc1b8878d6545caac1ee36fd02de584, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:18.821190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccaea3-6fb6-4628-ae2d-9f784b2bc58c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:18.853584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 949/1888] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:18 2022] PUT /identity/v3/projects/f0c704cc27fd44478d523f4dcc5c930b/users/0cc1b8878d6545caac1ee36fd02de584/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:18.853728 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccaea3-6fb6-4628-ae2d-9f784b2bc58c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:18.859984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4bccaea3-6fb6-4628-ae2d-9f784b2bc58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:18.868776 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:18.904637 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640df57-f17b-4f61-a9ab-459ec591cd4f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:18.968972 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccaea3-6fb6-4628-ae2d-9f784b2bc58c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:18.973706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:18.974349 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:18.974657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:18.974857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1506e84-5f39-451a-9d63-565fc975c10e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:18.974963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] PATH_INFO: `/v3/projects/740823ca72894f7da6507fdac163de79` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:18.975483 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1506e84-5f39-451a-9d63-565fc975c10e service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:18.975760 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1506e84-5f39-451a-9d63-565fc975c10e service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:18.976029 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1506e84-5f39-451a-9d63-565fc975c10e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:18.976115 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=740823ca72894f7da6507fdac163de79)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:18.978029 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:19.025370 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '740823ca72894f7da6507fdac163de79', 'request_id': 'req-3fc956c3-0e4c-4255-a32d-530ec6a355fe'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:19.031158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '740823ca72894f7da6507fdac163de79', 'request_id': 'req-3fc956c3-0e4c-4255-a32d-530ec6a355fe'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:19.038636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1506e84-5f39-451a-9d63-565fc975c10e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:19.039918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '740823ca72894f7da6507fdac163de79', 'request_id': 'req-3fc956c3-0e4c-4255-a32d-530ec6a355fe'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:19.040148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1506e84-5f39-451a-9d63-565fc975c10e service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:19.050393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 940/1889] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:19.051549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24deb589-155d-49a7-a22c-d5bd1774b4c5 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.051835 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24deb589-155d-49a7-a22c-d5bd1774b4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.052112 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24deb589-155d-49a7-a22c-d5bd1774b4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.058080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] The token cache is being invalidate because project 740823ca72894f7da6507fdac163de79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:19.058375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:19.059100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:19.060633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 950/1890] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:18 2022] DELETE /identity/v3/projects/740823ca72894f7da6507fdac163de79 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:19.061399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:19.065242 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:19.072809 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:19.083480 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-24deb589-155d-49a7-a22c-d5bd1774b4c5 None None] MFA Rules not processed for user `0cc1b8878d6545caac1ee36fd02de584`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:19.084698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-24deb589-155d-49a7-a22c-d5bd1774b4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:19.157292 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc956c3-0e4c-4255-a32d-530ec6a355fe admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:19.165697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 941/1891] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:19.165870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:19.165870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.165870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.165870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] PATH_INFO: `/v3/projects/0ac1b25e461845b5bf66ba4867b82973` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.166155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12480889-42d6-4ec7-ab1c-8744cb13fda7 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.166155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12480889-42d6-4ec7-ab1c-8744cb13fda7 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.166155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12480889-42d6-4ec7-ab1c-8744cb13fda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.167299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac1b25e461845b5bf66ba4867b82973)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:19.169352 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:19.198156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-12480889-42d6-4ec7-ab1c-8744cb13fda7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:19.200377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-12480889-42d6-4ec7-ab1c-8744cb13fda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:19.219387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 942/1892] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:19.220313 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12480889-42d6-4ec7-ab1c-8744cb13fda7 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:19.221926 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-12480889-42d6-4ec7-ab1c-8744cb13fda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:19.222564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:19.243271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac1b25e461845b5bf66ba4867b82973', 'request_id': 'req-739880d2-5b38-4c6d-b1bf-8b96220ffae8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:19.250116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac1b25e461845b5bf66ba4867b82973', 'request_id': 'req-739880d2-5b38-4c6d-b1bf-8b96220ffae8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:19.259946 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac1b25e461845b5bf66ba4867b82973', 'request_id': 'req-739880d2-5b38-4c6d-b1bf-8b96220ffae8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:19.274524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] The token cache is being invalidate because project 0ac1b25e461845b5bf66ba4867b82973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:19.275168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:19.276200 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:19.278344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 951/1893] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:19 2022] DELETE /identity/v3/projects/0ac1b25e461845b5bf66ba4867b82973 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:19.279549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:19.281179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:19.289934 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12480889-42d6-4ec7-ab1c-8744cb13fda7 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:19.348615 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd917c-278b-4d57-91ed-7b2ea56f5dd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:19.349990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd917c-278b-4d57-91ed-7b2ea56f5dd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.350581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd917c-278b-4d57-91ed-7b2ea56f5dd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.351046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd917c-278b-4d57-91ed-7b2ea56f5dd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.353326 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f6fd917c-278b-4d57-91ed-7b2ea56f5dd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:19.361809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739880d2-5b38-4c6d-b1bf-8b96220ffae8 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:19.368522 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4936a20-e657-444e-b574-55a8daab91d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:19.369318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4936a20-e657-444e-b574-55a8daab91d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.369602 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4936a20-e657-444e-b574-55a8daab91d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.369875 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4936a20-e657-444e-b574-55a8daab91d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.370542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4936a20-e657-444e-b574-55a8daab91d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:19.372718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4936a20-e657-444e-b574-55a8daab91d5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:19.406979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 952/1894] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:19 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:19.406979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae86be-d239-4650-9016-c44cf3b0ba85 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.406979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae86be-d239-4650-9016-c44cf3b0ba85 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.406979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae86be-d239-4650-9016-c44cf3b0ba85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.431746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4aae86be-d239-4650-9016-c44cf3b0ba85 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:19.433086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4aae86be-d239-4650-9016-c44cf3b0ba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:19.453804 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd917c-278b-4d57-91ed-7b2ea56f5dd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:19.455307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd917c-278b-4d57-91ed-7b2ea56f5dd6 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:19.468105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 943/1895] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:19.469557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8ff43-464d-4b0d-8307-71068cda3b17 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.469732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8ff43-464d-4b0d-8307-71068cda3b17 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.470004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8ff43-464d-4b0d-8307-71068cda3b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.478100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:19.494196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-66d8ff43-464d-4b0d-8307-71068cda3b17 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:19.495486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-66d8ff43-464d-4b0d-8307-71068cda3b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:19.514550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 953/1896] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:19.517895 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae86be-d239-4650-9016-c44cf3b0ba85 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:19.535982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae86be-d239-4650-9016-c44cf3b0ba85 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:19.551784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc45fce-8943-44b1-9d99-b597c12e3f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:19.552556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc45fce-8943-44b1-9d99-b597c12e3f6c admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.554383 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc45fce-8943-44b1-9d99-b597c12e3f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.555156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc45fce-8943-44b1-9d99-b597c12e3f6c admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.555792 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc45fce-8943-44b1-9d99-b597c12e3f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:19.557702 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc45fce-8943-44b1-9d99-b597c12e3f6c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:19.592531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 944/1897] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:19.598354 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8ff43-464d-4b0d-8307-71068cda3b17 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:19.604477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 954/1898] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:19 2022] POST /identity/v3/users => generated 301 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:19.604477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91876700-ec3c-4587-88f5-d6eb3988042c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.604477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91876700-ec3c-4587-88f5-d6eb3988042c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.604477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91876700-ec3c-4587-88f5-d6eb3988042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.625310 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8ff43-464d-4b0d-8307-71068cda3b17 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:19.636432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac8656-0a31-410c-a73c-8a0adc4bbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:19.637140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac8656-0a31-410c-a73c-8a0adc4bbdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.637332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac8656-0a31-410c-a73c-8a0adc4bbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.637607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac8656-0a31-410c-a73c-8a0adc4bbdc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.638277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac8656-0a31-410c-a73c-8a0adc4bbdc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:19.638585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac8656-0a31-410c-a73c-8a0adc4bbdc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:19.640661 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac8656-0a31-410c-a73c-8a0adc4bbdc6 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:19.650391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-91876700-ec3c-4587-88f5-d6eb3988042c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:19.662623 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-91876700-ec3c-4587-88f5-d6eb3988042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:19.667140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 945/1899] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:19.668093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac8656-0a31-410c-a73c-8a0adc4bbdc6 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:19.679658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac8656-0a31-410c-a73c-8a0adc4bbdc6 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:19.683663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 955/1900] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:19.684655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91876700-ec3c-4587-88f5-d6eb3988042c None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:19.691634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb94696-9fb8-4c25-a1d8-a1c5e5e09503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:19.693283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94696-9fb8-4c25-a1d8-a1c5e5e09503 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.693580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94696-9fb8-4c25-a1d8-a1c5e5e09503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.693850 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94696-9fb8-4c25-a1d8-a1c5e5e09503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.695128 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb94696-9fb8-4c25-a1d8-a1c5e5e09503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:19.696838 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb94696-9fb8-4c25-a1d8-a1c5e5e09503 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:19.697076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91876700-ec3c-4587-88f5-d6eb3988042c None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:19.705344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdf823-b1c3-4866-8718-bf5bbd1de96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:19.705974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdf823-b1c3-4866-8718-bf5bbd1de96d admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.707485 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdf823-b1c3-4866-8718-bf5bbd1de96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.707485 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdf823-b1c3-4866-8718-bf5bbd1de96d admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.707485 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bdf823-b1c3-4866-8718-bf5bbd1de96d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:19.709636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bdf823-b1c3-4866-8718-bf5bbd1de96d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:19.715607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 946/1901] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:19.715607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb94696-9fb8-4c25-a1d8-a1c5e5e09503 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:19.729943 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb94696-9fb8-4c25-a1d8-a1c5e5e09503 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:19.736877 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d309b-8f38-4ed3-a6d5-1ede94f1812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:19.737530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d309b-8f38-4ed3-a6d5-1ede94f1812a admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.738439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d309b-8f38-4ed3-a6d5-1ede94f1812a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.738439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d309b-8f38-4ed3-a6d5-1ede94f1812a admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.738819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d309b-8f38-4ed3-a6d5-1ede94f1812a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:19.739189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d309b-8f38-4ed3-a6d5-1ede94f1812a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:19.740993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d309b-8f38-4ed3-a6d5-1ede94f1812a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:19.754436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 947/1902] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:19.755596 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d309b-8f38-4ed3-a6d5-1ede94f1812a admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:19.764855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 956/1903] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:19 2022] POST /identity/v3/projects => generated 393 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:19.765971 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdf823-b1c3-4866-8718-bf5bbd1de96d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:19.774019 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d309b-8f38-4ed3-a6d5-1ede94f1812a admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:19.775214 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=5,keystone:SELECT=89,keystone:INSERT=6 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:19.833820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ec518-8939-4f37-8294-0ebfc2f00850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:19.834418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ec518-8939-4f37-8294-0ebfc2f00850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.834741 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ec518-8939-4f37-8294-0ebfc2f00850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.835014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ec518-8939-4f37-8294-0ebfc2f00850 admin admin] PATH_INFO: `/v3/projects/b2b08cd9c08c4cc5ae5766db8c17ead9/users/0ffd49b9ce1f4e76ab3f01268af40f89/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.838848 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdf823-b1c3-4866-8718-bf5bbd1de96d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:19.844144 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496796a6-d995-4b20-ba46-12c465be1276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:19.844765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496796a6-d995-4b20-ba46-12c465be1276 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:19.845041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496796a6-d995-4b20-ba46-12c465be1276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:19.845310 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496796a6-d995-4b20-ba46-12c465be1276 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:19.845957 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496796a6-d995-4b20-ba46-12c465be1276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:19.847920 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496796a6-d995-4b20-ba46-12c465be1276 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:19.849885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ec518-8939-4f37-8294-0ebfc2f00850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b08cd9c08c4cc5ae5766db8c17ead9, user_id=0ffd49b9ce1f4e76ab3f01268af40f89, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:19.852929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ec518-8939-4f37-8294-0ebfc2f00850 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:19.871340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 948/1904] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:19 2022] PUT /identity/v3/projects/b2b08cd9c08c4cc5ae5766db8c17ead9/users/0ffd49b9ce1f4e76ab3f01268af40f89/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:19.871340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ec518-8939-4f37-8294-0ebfc2f00850 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:19.886197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 957/1905] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:19 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:19.891506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496796a6-d995-4b20-ba46-12c465be1276 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:19.925885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:19.957516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ec518-8939-4f37-8294-0ebfc2f00850 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:20.034016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb43f3-79ba-4e2c-a338-7f4a0f62d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:20.034769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb43f3-79ba-4e2c-a338-7f4a0f62d942 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.035110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb43f3-79ba-4e2c-a338-7f4a0f62d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.035591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb43f3-79ba-4e2c-a338-7f4a0f62d942 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.036499 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb43f3-79ba-4e2c-a338-7f4a0f62d942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:20.038580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb43f3-79ba-4e2c-a338-7f4a0f62d942 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:20.055993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496796a6-d995-4b20-ba46-12c465be1276 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:20.065815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c893018-aeeb-4bcb-80c7-10a69c63a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:20.069874 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c893018-aeeb-4bcb-80c7-10a69c63a467 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.070235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c893018-aeeb-4bcb-80c7-10a69c63a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.070684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c893018-aeeb-4bcb-80c7-10a69c63a467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.071357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c893018-aeeb-4bcb-80c7-10a69c63a467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:20.077480 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 949/1906] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:19 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:20.078094 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c893018-aeeb-4bcb-80c7-10a69c63a467 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:20.078793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb43f3-79ba-4e2c-a338-7f4a0f62d942 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:20.102200 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 958/1907] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:20.102200 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c893018-aeeb-4bcb-80c7-10a69c63a467 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:20.102465 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb43f3-79ba-4e2c-a338-7f4a0f62d942 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:20.114086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99753304-8e26-4c2c-9eb2-b0566a4e80b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:20.115117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99753304-8e26-4c2c-9eb2-b0566a4e80b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.116752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99753304-8e26-4c2c-9eb2-b0566a4e80b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.117243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99753304-8e26-4c2c-9eb2-b0566a4e80b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.118139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99753304-8e26-4c2c-9eb2-b0566a4e80b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:20.120673 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99753304-8e26-4c2c-9eb2-b0566a4e80b1 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:20.126768 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c893018-aeeb-4bcb-80c7-10a69c63a467 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:20.136288 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7783f2-0fd0-486a-921f-3c6d341994bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:20.136925 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7783f2-0fd0-486a-921f-3c6d341994bb admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.137194 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7783f2-0fd0-486a-921f-3c6d341994bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.137469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7783f2-0fd0-486a-921f-3c6d341994bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.138126 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7783f2-0fd0-486a-921f-3c6d341994bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:20.144091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7783f2-0fd0-486a-921f-3c6d341994bb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:20.172078 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 959/1908] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:20.173326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7783f2-0fd0-486a-921f-3c6d341994bb admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:20.181126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 950/1909] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:20 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:20.181126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99753304-8e26-4c2c-9eb2-b0566a4e80b1 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:20.198662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99753304-8e26-4c2c-9eb2-b0566a4e80b1 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:20.198868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7783f2-0fd0-486a-921f-3c6d341994bb admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:20.209130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0094a5-ef50-4b2d-863b-ac603cc7305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:20.210756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0094a5-ef50-4b2d-863b-ac603cc7305a admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.211834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0094a5-ef50-4b2d-863b-ac603cc7305a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.212602 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0094a5-ef50-4b2d-863b-ac603cc7305a admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.213487 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0094a5-ef50-4b2d-863b-ac603cc7305a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:20.213677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545864dc-f620-4868-8d7d-615151cb0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:20.214399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545864dc-f620-4868-8d7d-615151cb0acb admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.216166 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545864dc-f620-4868-8d7d-615151cb0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.216439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545864dc-f620-4868-8d7d-615151cb0acb admin admin] PATH_INFO: `/v3/projects/b2b08cd9c08c4cc5ae5766db8c17ead9/users/0ffd49b9ce1f4e76ab3f01268af40f89/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.217969 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0094a5-ef50-4b2d-863b-ac603cc7305a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:20.222478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545864dc-f620-4868-8d7d-615151cb0acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b08cd9c08c4cc5ae5766db8c17ead9, user_id=0ffd49b9ce1f4e76ab3f01268af40f89, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:20.229567 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545864dc-f620-4868-8d7d-615151cb0acb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:20.253349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 951/1910] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:20.253349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0094a5-ef50-4b2d-863b-ac603cc7305a admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:20.261584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 960/1911] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:20 2022] PUT /identity/v3/projects/b2b08cd9c08c4cc5ae5766db8c17ead9/users/0ffd49b9ce1f4e76ab3f01268af40f89/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:20.262520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545864dc-f620-4868-8d7d-615151cb0acb admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:20.275921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0094a5-ef50-4b2d-863b-ac603cc7305a admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:20.359566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc59c10-8a88-4e37-8c02-66163a478ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:20.365921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc59c10-8a88-4e37-8c02-66163a478ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.366233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc59c10-8a88-4e37-8c02-66163a478ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.366644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc59c10-8a88-4e37-8c02-66163a478ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.367892 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc59c10-8a88-4e37-8c02-66163a478ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:20.369830 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc59c10-8a88-4e37-8c02-66163a478ccf admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:20.395046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 952/1912] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:20.396488 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ffb00-d1cf-4b1a-bc81-d01d57d661ac None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.396778 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ffb00-d1cf-4b1a-bc81-d01d57d661ac None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.397042 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ffb00-d1cf-4b1a-bc81-d01d57d661ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.425670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545864dc-f620-4868-8d7d-615151cb0acb admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:20.431615 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d48cd4-1fc3-4801-93b9-53bd46616cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:20.432585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48cd4-1fc3-4801-93b9-53bd46616cde admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.433071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48cd4-1fc3-4801-93b9-53bd46616cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.433549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d48cd4-1fc3-4801-93b9-53bd46616cde admin admin] PATH_INFO: `/v3/projects/ea0f88f85f3b4cbf814c4bdfb1394fd1/users/7fc140e93af24752b697d9ce50cbd16e/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.437016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:20.443286 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-811ffb00-d1cf-4b1a-bc81-d01d57d661ac None None] MFA Rules not processed for user `0ffd49b9ce1f4e76ab3f01268af40f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:20.445914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-811ffb00-d1cf-4b1a-bc81-d01d57d661ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:20.470280 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d48cd4-1fc3-4801-93b9-53bd46616cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0f88f85f3b4cbf814c4bdfb1394fd1, user_id=7fc140e93af24752b697d9ce50cbd16e, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:20.475489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d48cd4-1fc3-4801-93b9-53bd46616cde admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:20.532060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 961/1913] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:20 2022] PUT /identity/v3/projects/ea0f88f85f3b4cbf814c4bdfb1394fd1/users/7fc140e93af24752b697d9ce50cbd16e/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:20.532060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d48cd4-1fc3-4801-93b9-53bd46616cde admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:20.535450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:20.592780 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 953/1914] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:20.595392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ef1cd-91b5-49c3-a0ca-171fc951f0ff None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.605817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ef1cd-91b5-49c3-a0ca-171fc951f0ff None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.606546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ef1cd-91b5-49c3-a0ca-171fc951f0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.656657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-0b8ef1cd-91b5-49c3-a0ca-171fc951f0ff None None] MFA Rules not processed for user `7fc140e93af24752b697d9ce50cbd16e`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:20.657916 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0b8ef1cd-91b5-49c3-a0ca-171fc951f0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:20.678284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d48cd4-1fc3-4801-93b9-53bd46616cde admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:20.683474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b747097-fa42-4e8d-a851-91a63782ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:20.684177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b747097-fa42-4e8d-a851-91a63782ef93 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.684464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b747097-fa42-4e8d-a851-91a63782ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.684738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b747097-fa42-4e8d-a851-91a63782ef93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.685541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b747097-fa42-4e8d-a851-91a63782ef93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:20.687261 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b747097-fa42-4e8d-a851-91a63782ef93 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:20.707839 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 962/1915] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:20.708740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b747097-fa42-4e8d-a851-91a63782ef93 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:20.714017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1b747097-fa42-4e8d-a851-91a63782ef93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:20.755518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 954/1916] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:20.755518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ef1cd-91b5-49c3-a0ca-171fc951f0ff None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:20.771036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ef1cd-91b5-49c3-a0ca-171fc951f0ff None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:20.778481 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846e0b0-9879-4542-aaaf-422ba61f2689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:20.779206 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e0b0-9879-4542-aaaf-422ba61f2689 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.779977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e0b0-9879-4542-aaaf-422ba61f2689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.780260 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e0b0-9879-4542-aaaf-422ba61f2689 admin admin] PATH_INFO: `/v3/projects/cd9964fbdaa64c07be7228c03e56a586/users/0193257811054ed295449a1f79891f61/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.807686 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b747097-fa42-4e8d-a851-91a63782ef93 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:20.812580 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fbf60-cec4-4d9e-bcb9-70ed83f2237b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:20.813222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fbf60-cec4-4d9e-bcb9-70ed83f2237b service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.813504 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fbf60-cec4-4d9e-bcb9-70ed83f2237b service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.813778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fbf60-cec4-4d9e-bcb9-70ed83f2237b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.822690 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846e0b0-9879-4542-aaaf-422ba61f2689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9964fbdaa64c07be7228c03e56a586, user_id=0193257811054ed295449a1f79891f61, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:20.825825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846e0b0-9879-4542-aaaf-422ba61f2689 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:20.853352 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 955/1917] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:20 2022] PUT /identity/v3/projects/cd9964fbdaa64c07be7228c03e56a586/users/0193257811054ed295449a1f79891f61/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:20.853998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846e0b0-9879-4542-aaaf-422ba61f2689 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:20.903135 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fbf60-cec4-4d9e-bcb9-70ed83f2237b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:20.904613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fbf60-cec4-4d9e-bcb9-70ed83f2237b service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:20.917428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 963/1918] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:20 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:20.919294 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337b35-fddb-4c29-ad91-c3e1b07ec348 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:20.919590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337b35-fddb-4c29-ad91-c3e1b07ec348 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:20.919870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94337b35-fddb-4c29-ad91-c3e1b07ec348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:20.962865 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-94337b35-fddb-4c29-ad91-c3e1b07ec348 None None] MFA Rules not processed for user `0193257811054ed295449a1f79891f61`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:20.964626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-94337b35-fddb-4c29-ad91-c3e1b07ec348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:20.986411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:21.047860 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846e0b0-9879-4542-aaaf-422ba61f2689 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:21.063100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd464126-0b73-41cd-9523-85e3d1ad59f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:21.063815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd464126-0b73-41cd-9523-85e3d1ad59f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:21.063988 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd464126-0b73-41cd-9523-85e3d1ad59f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:21.064263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd464126-0b73-41cd-9523-85e3d1ad59f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:21.064901 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd464126-0b73-41cd-9523-85e3d1ad59f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:21.069617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd464126-0b73-41cd-9523-85e3d1ad59f1 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:21.091547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 964/1919] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:21.129302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337b35-fddb-4c29-ad91-c3e1b07ec348 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:21.144148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 956/1920] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:20 2022] POST /identity/v3/projects => generated 393 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:21.148442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd464126-0b73-41cd-9523-85e3d1ad59f1 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:21.197391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:21.224359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94337b35-fddb-4c29-ad91-c3e1b07ec348 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:21.236828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd464126-0b73-41cd-9523-85e3d1ad59f1 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:21.244949 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfe0b5-32e8-4f66-8a2b-5a1f7e173eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:21.245616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfe0b5-32e8-4f66-8a2b-5a1f7e173eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:21.246066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfe0b5-32e8-4f66-8a2b-5a1f7e173eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:21.246312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfe0b5-32e8-4f66-8a2b-5a1f7e173eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:21.247043 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfe0b5-32e8-4f66-8a2b-5a1f7e173eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:21.249287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfe0b5-32e8-4f66-8a2b-5a1f7e173eb9 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:21.285166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 957/1921] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:21 2022] POST /identity/v3/users => generated 303 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:21.289927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfe0b5-32e8-4f66-8a2b-5a1f7e173eb9 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:21.320856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfe0b5-32e8-4f66-8a2b-5a1f7e173eb9 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:21.346653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69747ce5-614f-4a84-bd95-ba55feee011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:21.346653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69747ce5-614f-4a84-bd95-ba55feee011e admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:21.346653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69747ce5-614f-4a84-bd95-ba55feee011e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:21.346653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69747ce5-614f-4a84-bd95-ba55feee011e admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:21.347400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69747ce5-614f-4a84-bd95-ba55feee011e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:21.347400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69747ce5-614f-4a84-bd95-ba55feee011e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:21.355770 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e06aa-3c8c-4877-98c6-1ae82ebc6293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:21.356666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e06aa-3c8c-4877-98c6-1ae82ebc6293 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:21.357530 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e06aa-3c8c-4877-98c6-1ae82ebc6293 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:21.357968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e06aa-3c8c-4877-98c6-1ae82ebc6293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:21.366775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 958/1922] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:21.371452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69747ce5-614f-4a84-bd95-ba55feee011e admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:21.395007 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69747ce5-614f-4a84-bd95-ba55feee011e admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:21.422991 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69afa-5f14-44b0-b900-4f33c919f651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:21.423944 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69afa-5f14-44b0-b900-4f33c919f651 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:21.424379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69afa-5f14-44b0-b900-4f33c919f651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:21.424922 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69afa-5f14-44b0-b900-4f33c919f651 admin admin] PATH_INFO: `/v3/projects/2de3652ba12f4914a57274ad387d66d4/users/36e66085dcfa42d0a017af1f2a13a7e1/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:21.451121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e06aa-3c8c-4877-98c6-1ae82ebc6293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:21.453490 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e06aa-3c8c-4877-98c6-1ae82ebc6293 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:21.454156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe69afa-5f14-44b0-b900-4f33c919f651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de3652ba12f4914a57274ad387d66d4, user_id=36e66085dcfa42d0a017af1f2a13a7e1, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:21.461840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe69afa-5f14-44b0-b900-4f33c919f651 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:21.466415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 965/1923] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:21.467671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e06aa-3c8c-4877-98c6-1ae82ebc6293 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:21.506622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e06aa-3c8c-4877-98c6-1ae82ebc6293 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:21.513295 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 959/1924] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:21 2022] PUT /identity/v3/projects/2de3652ba12f4914a57274ad387d66d4/users/36e66085dcfa42d0a017af1f2a13a7e1/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:21.514581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69afa-5f14-44b0-b900-4f33c919f651 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:21.541953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:21.589958 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628e95e-50ff-4ec2-b4ce-8bb74c8a9d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:21.591036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628e95e-50ff-4ec2-b4ce-8bb74c8a9d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:21.592170 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628e95e-50ff-4ec2-b4ce-8bb74c8a9d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:21.592749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628e95e-50ff-4ec2-b4ce-8bb74c8a9d87 admin admin] PATH_INFO: `/v3/users/0cc1b8878d6545caac1ee36fd02de584` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:21.595810 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628e95e-50ff-4ec2-b4ce-8bb74c8a9d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc1b8878d6545caac1ee36fd02de584)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:21.600230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628e95e-50ff-4ec2-b4ce-8bb74c8a9d87 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:21.642464 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69afa-5f14-44b0-b900-4f33c919f651 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:21.657320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801dcc1-edde-4002-95be-e0d548f577e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:21.658286 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801dcc1-edde-4002-95be-e0d548f577e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:21.658541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801dcc1-edde-4002-95be-e0d548f577e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:21.658975 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801dcc1-edde-4002-95be-e0d548f577e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:21.659555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801dcc1-edde-4002-95be-e0d548f577e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:21.661293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801dcc1-edde-4002-95be-e0d548f577e9 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:21.689864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 960/1925] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:21.691806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801dcc1-edde-4002-95be-e0d548f577e9 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:21.698867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0628e95e-50ff-4ec2-b4ce-8bb74c8a9d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc1b8878d6545caac1ee36fd02de584'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:21.700592 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0628e95e-50ff-4ec2-b4ce-8bb74c8a9d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc1b8878d6545caac1ee36fd02de584'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:21.701657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0628e95e-50ff-4ec2-b4ce-8bb74c8a9d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc1b8878d6545caac1ee36fd02de584'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:21.721937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0628e95e-50ff-4ec2-b4ce-8bb74c8a9d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc1b8878d6545caac1ee36fd02de584'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:21.731425 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801dcc1-edde-4002-95be-e0d548f577e9 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:21.737230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7b3db-632f-45f2-8fc9-9a64a8b0e708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:21.737397 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7b3db-632f-45f2-8fc9-9a64a8b0e708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:21.737621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7b3db-632f-45f2-8fc9-9a64a8b0e708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:21.737908 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7b3db-632f-45f2-8fc9-9a64a8b0e708 admin admin] PATH_INFO: `/v3/projects/2de3652ba12f4914a57274ad387d66d4/users/36e66085dcfa42d0a017af1f2a13a7e1/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:21.740145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7b3db-632f-45f2-8fc9-9a64a8b0e708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de3652ba12f4914a57274ad387d66d4, user_id=36e66085dcfa42d0a017af1f2a13a7e1, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:21.743136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7b3db-632f-45f2-8fc9-9a64a8b0e708 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:21.759348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 961/1926] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:21 2022] PUT /identity/v3/projects/2de3652ba12f4914a57274ad387d66d4/users/36e66085dcfa42d0a017af1f2a13a7e1/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:21.768739 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9decce4-c5ff-467c-b564-2b68b063cc8d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:21.768945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9decce4-c5ff-467c-b564-2b68b063cc8d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:21.769338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0628e95e-50ff-4ec2-b4ce-8bb74c8a9d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc1b8878d6545caac1ee36fd02de584'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:21.769455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9decce4-c5ff-467c-b564-2b68b063cc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:21.793477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 966/1927] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:21 2022] DELETE /identity/v3/users/0cc1b8878d6545caac1ee36fd02de584 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:21.797887 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7fb56-c8b7-40a4-8d81-2f7bdd39434b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:21.798174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7fb56-c8b7-40a4-8d81-2f7bdd39434b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:21.798447 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7fb56-c8b7-40a4-8d81-2f7bdd39434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:21.803968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-d9decce4-c5ff-467c-b564-2b68b063cc8d None None] MFA Rules not processed for user `36e66085dcfa42d0a017af1f2a13a7e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:21.805426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d9decce4-c5ff-467c-b564-2b68b063cc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:21.821144 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7ac7fb56-c8b7-40a4-8d81-2f7bdd39434b None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:21.822363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7ac7fb56-c8b7-40a4-8d81-2f7bdd39434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:21.877359 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:21.902306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 967/1928] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:21.902748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 962/1929] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:21.910824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7fb56-c8b7-40a4-8d81-2f7bdd39434b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:21.912924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7ac7fb56-c8b7-40a4-8d81-2f7bdd39434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:21.919615 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9decce4-c5ff-467c-b564-2b68b063cc8d None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:21.921929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d9decce4-c5ff-467c-b564-2b68b063cc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:21.987766 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:21.992616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7fb56-c8b7-40a4-8d81-2f7bdd39434b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:21.999389 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a71e2-3de2-469e-94b4-ff64b9f9026b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:22.000403 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a71e2-3de2-469e-94b4-ff64b9f9026b service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:22.000868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a71e2-3de2-469e-94b4-ff64b9f9026b service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:22.001587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a71e2-3de2-469e-94b4-ff64b9f9026b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:22.004817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9decce4-c5ff-467c-b564-2b68b063cc8d None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:22.010236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5de91-535a-4b07-88bf-ef5ed66cbbe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:22.011121 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5de91-535a-4b07-88bf-ef5ed66cbbe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:22.011538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5de91-535a-4b07-88bf-ef5ed66cbbe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:22.011820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5de91-535a-4b07-88bf-ef5ed66cbbe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:22.016722 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a71e2-3de2-469e-94b4-ff64b9f9026b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:22.019123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a71e2-3de2-469e-94b4-ff64b9f9026b service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:22.023769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5de91-535a-4b07-88bf-ef5ed66cbbe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:22.025231 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5de91-535a-4b07-88bf-ef5ed66cbbe1 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:22.031237 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 968/1930] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:22.035583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 963/1931] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:03:22.095491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a71e2-3de2-469e-94b4-ff64b9f9026b service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:22.097653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9a5a71e2-3de2-469e-94b4-ff64b9f9026b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:22.111600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a71e2-3de2-469e-94b4-ff64b9f9026b service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:22.115537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed565db-05d6-4e35-be47-3d26ba952eea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:22.116240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed565db-05d6-4e35-be47-3d26ba952eea service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:22.116583 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed565db-05d6-4e35-be47-3d26ba952eea service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:22.116920 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed565db-05d6-4e35-be47-3d26ba952eea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:22.119136 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1ed565db-05d6-4e35-be47-3d26ba952eea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:22.201131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed565db-05d6-4e35-be47-3d26ba952eea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:22.202699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed565db-05d6-4e35-be47-3d26ba952eea service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:22.214914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 969/1932] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:22.452824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5de91-535a-4b07-88bf-ef5ed66cbbe1 service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:22.455675 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9cf5de91-535a-4b07-88bf-ef5ed66cbbe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:22.476230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5de91-535a-4b07-88bf-ef5ed66cbbe1 service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:22.486358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:22.488323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:22.488843 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:22.489547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] PATH_INFO: `/v3/projects/f0c704cc27fd44478d523f4dcc5c930b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:22.491442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c704cc27fd44478d523f4dcc5c930b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:22.494242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:22.608986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c704cc27fd44478d523f4dcc5c930b', 'request_id': 'req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:22.625117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c704cc27fd44478d523f4dcc5c930b', 'request_id': 'req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:22.639438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c704cc27fd44478d523f4dcc5c930b', 'request_id': 'req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:22.677423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] The token cache is being invalidate because project f0c704cc27fd44478d523f4dcc5c930b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:22.677725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:22.678413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:22.685416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 964/1933] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:22 2022] DELETE /identity/v3/projects/f0c704cc27fd44478d523f4dcc5c930b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:22.686738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed565db-05d6-4e35-be47-3d26ba952eea service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:22.715745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed565db-05d6-4e35-be47-3d26ba952eea service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:22.880441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d58603-de2a-4e29-9511-1bd86f9229fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:22.880879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d58603-de2a-4e29-9511-1bd86f9229fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:22.881239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d58603-de2a-4e29-9511-1bd86f9229fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:22.881590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d58603-de2a-4e29-9511-1bd86f9229fa admin admin] PATH_INFO: `/v3/users/0ffd49b9ce1f4e76ab3f01268af40f89` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:22.884974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d58603-de2a-4e29-9511-1bd86f9229fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ffd49b9ce1f4e76ab3f01268af40f89)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:22.890856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d58603-de2a-4e29-9511-1bd86f9229fa admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:22.986068 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b8d58603-de2a-4e29-9511-1bd86f9229fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ffd49b9ce1f4e76ab3f01268af40f89'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:22.988006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b8d58603-de2a-4e29-9511-1bd86f9229fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ffd49b9ce1f4e76ab3f01268af40f89'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:22.988809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b8d58603-de2a-4e29-9511-1bd86f9229fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ffd49b9ce1f4e76ab3f01268af40f89'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:23.006115 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b8d58603-de2a-4e29-9511-1bd86f9229fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ffd49b9ce1f4e76ab3f01268af40f89'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:23.021784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b8d58603-de2a-4e29-9511-1bd86f9229fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ffd49b9ce1f4e76ab3f01268af40f89'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:23.069277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 970/1934] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:22 2022] DELETE /identity/v3/users/0ffd49b9ce1f4e76ab3f01268af40f89 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:23.628902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:23.630707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:23.660307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf954de-7c5f-4bf1-a3fc-f3068c53b038 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:23.773663 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1ef21-337c-431f-be4b-c9188c52c549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:23.775152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1ef21-337c-431f-be4b-c9188c52c549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:23.775699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1ef21-337c-431f-be4b-c9188c52c549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:23.776415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1ef21-337c-431f-be4b-c9188c52c549 admin admin] PATH_INFO: `/v3/projects/b2b08cd9c08c4cc5ae5766db8c17ead9` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:23.779112 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1ef21-337c-431f-be4b-c9188c52c549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b08cd9c08c4cc5ae5766db8c17ead9)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:23.781397 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1ef21-337c-431f-be4b-c9188c52c549 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:23.803806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:23.833231 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c0d1ef21-337c-431f-be4b-c9188c52c549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b08cd9c08c4cc5ae5766db8c17ead9', 'request_id': 'req-c0d1ef21-337c-431f-be4b-c9188c52c549'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:23.842027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c0d1ef21-337c-431f-be4b-c9188c52c549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b08cd9c08c4cc5ae5766db8c17ead9', 'request_id': 'req-c0d1ef21-337c-431f-be4b-c9188c52c549'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:23.849497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c0d1ef21-337c-431f-be4b-c9188c52c549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b08cd9c08c4cc5ae5766db8c17ead9', 'request_id': 'req-c0d1ef21-337c-431f-be4b-c9188c52c549'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:23.866869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c0d1ef21-337c-431f-be4b-c9188c52c549 admin admin] The token cache is being invalidate because project b2b08cd9c08c4cc5ae5766db8c17ead9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:23.867250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c0d1ef21-337c-431f-be4b-c9188c52c549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:23.867858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c0d1ef21-337c-431f-be4b-c9188c52c549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:23.872977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 965/1935] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:23 2022] DELETE /identity/v3/projects/b2b08cd9c08c4cc5ae5766db8c17ead9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:23.874509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd132920-ee97-490c-b8cd-f6a56c2c08b1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:23.875013 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd132920-ee97-490c-b8cd-f6a56c2c08b1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:23.875180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd132920-ee97-490c-b8cd-f6a56c2c08b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:23.898497 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-bd132920-ee97-490c-b8cd-f6a56c2c08b1 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:23.899837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bd132920-ee97-490c-b8cd-f6a56c2c08b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:23.904712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:23.978900 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 971/1936] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:23.981294 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f44844-677c-4061-982d-ad23a124b374 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:23.981581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f44844-677c-4061-982d-ad23a124b374 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:23.981851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f44844-677c-4061-982d-ad23a124b374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:24.006708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-26f44844-677c-4061-982d-ad23a124b374 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:24.008376 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-26f44844-677c-4061-982d-ad23a124b374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:24.024122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 966/1937] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:24.025300 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd132920-ee97-490c-b8cd-f6a56c2c08b1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:24.037683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd132920-ee97-490c-b8cd-f6a56c2c08b1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:24.047789 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0029ab0-6fac-4b99-bc85-84f698d7bae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:24.048654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0029ab0-6fac-4b99-bc85-84f698d7bae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:24.049133 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0029ab0-6fac-4b99-bc85-84f698d7bae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:24.049729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0029ab0-6fac-4b99-bc85-84f698d7bae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:24.050402 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0029ab0-6fac-4b99-bc85-84f698d7bae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:24.050745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0029ab0-6fac-4b99-bc85-84f698d7bae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:24.052427 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0029ab0-6fac-4b99-bc85-84f698d7bae5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:24.070648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 972/1938] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:24.072280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f44844-677c-4061-982d-ad23a124b374 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:24.082670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f44844-677c-4061-982d-ad23a124b374 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:24.089407 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8403ded-af8d-4c03-8500-9d2b59e8057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:24.090058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8403ded-af8d-4c03-8500-9d2b59e8057b admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:24.090468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8403ded-af8d-4c03-8500-9d2b59e8057b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:24.090776 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8403ded-af8d-4c03-8500-9d2b59e8057b admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:24.091495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8403ded-af8d-4c03-8500-9d2b59e8057b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:24.101195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8403ded-af8d-4c03-8500-9d2b59e8057b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:24.133537 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 967/1939] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:24 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:24.139368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0029ab0-6fac-4b99-bc85-84f698d7bae5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:24.149839 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0029ab0-6fac-4b99-bc85-84f698d7bae5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:24.218301 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ece115-9b27-4c3e-9e72-1d46a9f52b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:24.218956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ece115-9b27-4c3e-9e72-1d46a9f52b6b admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:24.219238 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ece115-9b27-4c3e-9e72-1d46a9f52b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:24.219513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ece115-9b27-4c3e-9e72-1d46a9f52b6b admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:24.220148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ece115-9b27-4c3e-9e72-1d46a9f52b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:24.222074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ece115-9b27-4c3e-9e72-1d46a9f52b6b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:24.257230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 973/1940] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:24 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:24.259134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8403ded-af8d-4c03-8500-9d2b59e8057b admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:24.270836 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8403ded-af8d-4c03-8500-9d2b59e8057b admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:24.289597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d836d-8056-48de-8b80-85abccc97d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:24.290938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d836d-8056-48de-8b80-85abccc97d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:24.291210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d836d-8056-48de-8b80-85abccc97d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:24.291484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d836d-8056-48de-8b80-85abccc97d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:24.292150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d836d-8056-48de-8b80-85abccc97d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:24.293898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d836d-8056-48de-8b80-85abccc97d0c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:24.305952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 968/1941] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:24.309868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ece115-9b27-4c3e-9e72-1d46a9f52b6b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:24.323571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ece115-9b27-4c3e-9e72-1d46a9f52b6b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:24.347807 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15121c-5a8b-469b-a122-1fd6dfba335b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:24.348671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15121c-5a8b-469b-a122-1fd6dfba335b admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:24.349168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15121c-5a8b-469b-a122-1fd6dfba335b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:24.349815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15121c-5a8b-469b-a122-1fd6dfba335b admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:24.351186 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15121c-5a8b-469b-a122-1fd6dfba335b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:24.353478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15121c-5a8b-469b-a122-1fd6dfba335b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:24.367866 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 974/1942] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:24.371955 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d836d-8056-48de-8b80-85abccc97d0c admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:24.383066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d836d-8056-48de-8b80-85abccc97d0c admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:24.388252 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51e86b-d097-429e-8846-8954fe1c8df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:24.389001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51e86b-d097-429e-8846-8954fe1c8df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:24.389340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51e86b-d097-429e-8846-8954fe1c8df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:24.389687 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51e86b-d097-429e-8846-8954fe1c8df7 admin admin] PATH_INFO: `/v3/projects/33779b761f50481a86041cdc1952b7f2/users/c520ee45e9b54e9da2ec876b32ff22aa/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:24.416405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51e86b-d097-429e-8846-8954fe1c8df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33779b761f50481a86041cdc1952b7f2, user_id=c520ee45e9b54e9da2ec876b32ff22aa, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:24.419900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51e86b-d097-429e-8846-8954fe1c8df7 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:24.440157 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 969/1943] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:24 2022] PUT /identity/v3/projects/33779b761f50481a86041cdc1952b7f2/users/c520ee45e9b54e9da2ec876b32ff22aa/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:24.452083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c464c35-08ea-409b-9114-ab074775af4a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:24.452382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c464c35-08ea-409b-9114-ab074775af4a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:24.452644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c464c35-08ea-409b-9114-ab074775af4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:24.484734 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8c464c35-08ea-409b-9114-ab074775af4a None None] MFA Rules not processed for user `c520ee45e9b54e9da2ec876b32ff22aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:24.485990 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8c464c35-08ea-409b-9114-ab074775af4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:24.562871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 975/1944] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:24.672511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51e86b-d097-429e-8846-8954fe1c8df7 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:24.674666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5f51e86b-d097-429e-8846-8954fe1c8df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:24.747597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51e86b-d097-429e-8846-8954fe1c8df7 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:24.752697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e781e-ae43-4ef1-9f80-0e32f501cdea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:24.753990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e781e-ae43-4ef1-9f80-0e32f501cdea service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:24.754806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e781e-ae43-4ef1-9f80-0e32f501cdea service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:24.755370 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e781e-ae43-4ef1-9f80-0e32f501cdea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:24.768364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e781e-ae43-4ef1-9f80-0e32f501cdea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:24.770397 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e781e-ae43-4ef1-9f80-0e32f501cdea service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:24.786737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 970/1945] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:26.721150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c464c35-08ea-409b-9114-ab074775af4a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:26.722368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8c464c35-08ea-409b-9114-ab074775af4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:26.729549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:26.803612 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c464c35-08ea-409b-9114-ab074775af4a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:26.808420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e56b54-2cc2-47d5-b224-3371e9f8a1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:26.809060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56b54-2cc2-47d5-b224-3371e9f8a1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:26.809335 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56b54-2cc2-47d5-b224-3371e9f8a1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:26.809606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e56b54-2cc2-47d5-b224-3371e9f8a1fa admin admin] PATH_INFO: `/v3/users/7fc140e93af24752b697d9ce50cbd16e` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:26.810795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e56b54-2cc2-47d5-b224-3371e9f8a1fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc140e93af24752b697d9ce50cbd16e)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:26.812717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e56b54-2cc2-47d5-b224-3371e9f8a1fa admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:26.865961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8e56b54-2cc2-47d5-b224-3371e9f8a1fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc140e93af24752b697d9ce50cbd16e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:26.866650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8e56b54-2cc2-47d5-b224-3371e9f8a1fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc140e93af24752b697d9ce50cbd16e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:26.867329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8e56b54-2cc2-47d5-b224-3371e9f8a1fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc140e93af24752b697d9ce50cbd16e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:26.874913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8e56b54-2cc2-47d5-b224-3371e9f8a1fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc140e93af24752b697d9ce50cbd16e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:26.885495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8e56b54-2cc2-47d5-b224-3371e9f8a1fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc140e93af24752b697d9ce50cbd16e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:26.906403 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 976/1946] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:26 2022] DELETE /identity/v3/users/7fc140e93af24752b697d9ce50cbd16e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:26.911306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b12d2-8aaf-4eb3-8e9e-76e29beed2ec None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:26.911775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b12d2-8aaf-4eb3-8e9e-76e29beed2ec None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:26.911934 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b12d2-8aaf-4eb3-8e9e-76e29beed2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:26.932046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-f43b12d2-8aaf-4eb3-8e9e-76e29beed2ec None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:26.933263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f43b12d2-8aaf-4eb3-8e9e-76e29beed2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:26.975114 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:26.997482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 971/1947] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:27.008938 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e56b54-2cc2-47d5-b224-3371e9f8a1fa admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:27.015607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e8e56b54-2cc2-47d5-b224-3371e9f8a1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:27.088965 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e56b54-2cc2-47d5-b224-3371e9f8a1fa admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:27.093487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5cd47-b5c5-47f6-aadb-875bbfa97dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:27.094036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5cd47-b5c5-47f6-aadb-875bbfa97dac service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:27.094376 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5cd47-b5c5-47f6-aadb-875bbfa97dac service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:27.094664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5cd47-b5c5-47f6-aadb-875bbfa97dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:27.106179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5cd47-b5c5-47f6-aadb-875bbfa97dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:27.107447 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5cd47-b5c5-47f6-aadb-875bbfa97dac service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:27.126197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 977/1948] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:27.461040 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b12d2-8aaf-4eb3-8e9e-76e29beed2ec None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:27.462681 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f43b12d2-8aaf-4eb3-8e9e-76e29beed2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:27.478210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b12d2-8aaf-4eb3-8e9e-76e29beed2ec None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:27.484507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:27.485597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:27.485963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:27.486454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] PATH_INFO: `/v3/projects/ea0f88f85f3b4cbf814c4bdfb1394fd1` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:27.488039 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea0f88f85f3b4cbf814c4bdfb1394fd1)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:27.490722 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:27.541628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea0f88f85f3b4cbf814c4bdfb1394fd1', 'request_id': 'req-72696ec8-a37d-46c0-b68a-c770a1d53137'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:27.549708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea0f88f85f3b4cbf814c4bdfb1394fd1', 'request_id': 'req-72696ec8-a37d-46c0-b68a-c770a1d53137'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:27.556280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea0f88f85f3b4cbf814c4bdfb1394fd1', 'request_id': 'req-72696ec8-a37d-46c0-b68a-c770a1d53137'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:27.566696 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] The token cache is being invalidate because project ea0f88f85f3b4cbf814c4bdfb1394fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:27.566990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:27.567709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:27.569342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 972/1949] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:27 2022] DELETE /identity/v3/projects/ea0f88f85f3b4cbf814c4bdfb1394fd1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:27.573647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5cd47-b5c5-47f6-aadb-875bbfa97dac service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:27.584438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5cd47-b5c5-47f6-aadb-875bbfa97dac service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:27.613046 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:27.654080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3dcce-dd38-4376-a09c-815fd7c65a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:27.654787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3dcce-dd38-4376-a09c-815fd7c65a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:27.655060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3dcce-dd38-4376-a09c-815fd7c65a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:27.655333 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3dcce-dd38-4376-a09c-815fd7c65a01 admin admin] PATH_INFO: `/v3/users/36e66085dcfa42d0a017af1f2a13a7e1` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:27.656502 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3dcce-dd38-4376-a09c-815fd7c65a01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e66085dcfa42d0a017af1f2a13a7e1)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:27.658532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3dcce-dd38-4376-a09c-815fd7c65a01 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:27.743093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8c3dcce-dd38-4376-a09c-815fd7c65a01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e66085dcfa42d0a017af1f2a13a7e1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:27.744603 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8c3dcce-dd38-4376-a09c-815fd7c65a01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e66085dcfa42d0a017af1f2a13a7e1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:27.746723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8c3dcce-dd38-4376-a09c-815fd7c65a01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e66085dcfa42d0a017af1f2a13a7e1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:27.774016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8c3dcce-dd38-4376-a09c-815fd7c65a01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e66085dcfa42d0a017af1f2a13a7e1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:27.786274 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8c3dcce-dd38-4376-a09c-815fd7c65a01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e66085dcfa42d0a017af1f2a13a7e1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:27.819119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 978/1950] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:27 2022] DELETE /identity/v3/users/36e66085dcfa42d0a017af1f2a13a7e1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:28.345889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:28.348292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:28.385182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72696ec8-a37d-46c0-b68a-c770a1d53137 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:28.466969 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcca78-fd91-4a19-b270-766929eb0fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:28.467728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcca78-fd91-4a19-b270-766929eb0fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:28.468070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcca78-fd91-4a19-b270-766929eb0fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:28.468409 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcca78-fd91-4a19-b270-766929eb0fc8 admin admin] PATH_INFO: `/v3/projects/2de3652ba12f4914a57274ad387d66d4` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:28.472162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcca78-fd91-4a19-b270-766929eb0fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de3652ba12f4914a57274ad387d66d4)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:28.474362 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcca78-fd91-4a19-b270-766929eb0fc8 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:28.565946 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3dcce-dd38-4376-a09c-815fd7c65a01 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:28.567811 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e8c3dcce-dd38-4376-a09c-815fd7c65a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:28.584914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d3fcca78-fd91-4a19-b270-766929eb0fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de3652ba12f4914a57274ad387d66d4', 'request_id': 'req-d3fcca78-fd91-4a19-b270-766929eb0fc8'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:28.590360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3dcce-dd38-4376-a09c-815fd7c65a01 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:28.605741 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d3fcca78-fd91-4a19-b270-766929eb0fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de3652ba12f4914a57274ad387d66d4', 'request_id': 'req-d3fcca78-fd91-4a19-b270-766929eb0fc8'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:28.621219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d3fcca78-fd91-4a19-b270-766929eb0fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de3652ba12f4914a57274ad387d66d4', 'request_id': 'req-d3fcca78-fd91-4a19-b270-766929eb0fc8'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:28.642086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:28.652654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d3fcca78-fd91-4a19-b270-766929eb0fc8 admin admin] The token cache is being invalidate because project 2de3652ba12f4914a57274ad387d66d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:28.653293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d3fcca78-fd91-4a19-b270-766929eb0fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:28.656289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d3fcca78-fd91-4a19-b270-766929eb0fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:28.663489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 973/1951] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:28 2022] DELETE /identity/v3/projects/2de3652ba12f4914a57274ad387d66d4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:28.670688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab725ee-0cc0-4692-913c-e064e700d3cd None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:28.670961 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab725ee-0cc0-4692-913c-e064e700d3cd None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:28.671347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab725ee-0cc0-4692-913c-e064e700d3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:28.708257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1ab725ee-0cc0-4692-913c-e064e700d3cd None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:28.709455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1ab725ee-0cc0-4692-913c-e064e700d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:28.725468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afbc70-1a1d-4729-aaa9-3b0993dd3d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:28.726079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afbc70-1a1d-4729-aaa9-3b0993dd3d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:28.726400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afbc70-1a1d-4729-aaa9-3b0993dd3d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:28.726701 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afbc70-1a1d-4729-aaa9-3b0993dd3d1a admin admin] PATH_INFO: `/v3/users/0193257811054ed295449a1f79891f61` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:28.728153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afbc70-1a1d-4729-aaa9-3b0993dd3d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0193257811054ed295449a1f79891f61)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:28.731042 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afbc70-1a1d-4729-aaa9-3b0993dd3d1a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:28.804651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5afbc70-1a1d-4729-aaa9-3b0993dd3d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0193257811054ed295449a1f79891f61'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:28.806197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5afbc70-1a1d-4729-aaa9-3b0993dd3d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0193257811054ed295449a1f79891f61'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:28.807448 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 974/1952] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:28.807822 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5afbc70-1a1d-4729-aaa9-3b0993dd3d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0193257811054ed295449a1f79891f61'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:28.809425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:28.815924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401def53-0b81-4680-8a5a-36d4550aa06f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:28.816218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401def53-0b81-4680-8a5a-36d4550aa06f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:28.816483 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401def53-0b81-4680-8a5a-36d4550aa06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:28.821141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5afbc70-1a1d-4729-aaa9-3b0993dd3d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0193257811054ed295449a1f79891f61'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:28.831514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5afbc70-1a1d-4729-aaa9-3b0993dd3d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0193257811054ed295449a1f79891f61'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:28.840752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-401def53-0b81-4680-8a5a-36d4550aa06f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:28.842021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-401def53-0b81-4680-8a5a-36d4550aa06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:28.859176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 975/1953] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:28.861876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401def53-0b81-4680-8a5a-36d4550aa06f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:28.872757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 979/1954] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:28 2022] DELETE /identity/v3/users/0193257811054ed295449a1f79891f61 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:28.877090 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d08f54-5821-41d5-ba2e-c0907964ebaf None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:28.877373 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d08f54-5821-41d5-ba2e-c0907964ebaf None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:28.877649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d08f54-5821-41d5-ba2e-c0907964ebaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:28.881530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401def53-0b81-4680-8a5a-36d4550aa06f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:28.900477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b8d08f54-5821-41d5-ba2e-c0907964ebaf None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:28.902342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b8d08f54-5821-41d5-ba2e-c0907964ebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:29.071654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb63bb-dfe6-4249-8cab-1deedcef489a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:29.072575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb63bb-dfe6-4249-8cab-1deedcef489a admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:29.073163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb63bb-dfe6-4249-8cab-1deedcef489a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:29.073357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb63bb-dfe6-4249-8cab-1deedcef489a admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:29.074986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb63bb-dfe6-4249-8cab-1deedcef489a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:29.075297 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb63bb-dfe6-4249-8cab-1deedcef489a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:29.077018 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 980/1955] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:29.077940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb63bb-dfe6-4249-8cab-1deedcef489a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:29.088620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d08f54-5821-41d5-ba2e-c0907964ebaf None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:29.090536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b8d08f54-5821-41d5-ba2e-c0907964ebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:29.095384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 976/1956] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:29.099607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb63bb-dfe6-4249-8cab-1deedcef489a admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:29.113462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb63bb-dfe6-4249-8cab-1deedcef489a admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:29.120217 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43656d7-1166-467d-9039-c23c45dea0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:29.121439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43656d7-1166-467d-9039-c23c45dea0ba admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:29.122016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43656d7-1166-467d-9039-c23c45dea0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:29.122537 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43656d7-1166-467d-9039-c23c45dea0ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:29.123399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43656d7-1166-467d-9039-c23c45dea0ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:29.125870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43656d7-1166-467d-9039-c23c45dea0ba admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:29.173275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d08f54-5821-41d5-ba2e-c0907964ebaf None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:29.181305 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 977/1957] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:29 2022] POST /identity/v3/projects => generated 401 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:29.182313 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43656d7-1166-467d-9039-c23c45dea0ba admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:29.279985 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e5f47-a735-42f9-9561-d7f7efd5f542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:29.280651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e5f47-a735-42f9-9561-d7f7efd5f542 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:29.280932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e5f47-a735-42f9-9561-d7f7efd5f542 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:29.281203 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e5f47-a735-42f9-9561-d7f7efd5f542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:29.288374 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43656d7-1166-467d-9039-c23c45dea0ba admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:29.294131 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b44e3-b37a-4f36-bc56-4b36b4855cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:29.299445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b44e3-b37a-4f36-bc56-4b36b4855cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:29.300325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e5f47-a735-42f9-9561-d7f7efd5f542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:29.301945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b44e3-b37a-4f36-bc56-4b36b4855cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:29.302224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b44e3-b37a-4f36-bc56-4b36b4855cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:29.304813 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e5f47-a735-42f9-9561-d7f7efd5f542 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:29.305215 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b44e3-b37a-4f36-bc56-4b36b4855cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:29.307762 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b44e3-b37a-4f36-bc56-4b36b4855cf0 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:29.319469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 981/1958] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:29.322449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:29.348330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e5f47-a735-42f9-9561-d7f7efd5f542 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:29.352017 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 978/1959] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:29 2022] POST /identity/v3/users => generated 301 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:29.366016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e5f47-a735-42f9-9561-d7f7efd5f542 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:29.371062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b39ae-1c02-4e49-8d4f-3a90f879a50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:29.371773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b39ae-1c02-4e49-8d4f-3a90f879a50c admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:29.371962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b39ae-1c02-4e49-8d4f-3a90f879a50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:29.372233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b39ae-1c02-4e49-8d4f-3a90f879a50c admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:29.372890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b39ae-1c02-4e49-8d4f-3a90f879a50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:29.374690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b39ae-1c02-4e49-8d4f-3a90f879a50c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:29.389336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 982/1960] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:29.391464 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b44e3-b37a-4f36-bc56-4b36b4855cf0 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:29.404032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b44e3-b37a-4f36-bc56-4b36b4855cf0 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:29.411445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271440e-1249-411d-97a1-3841333435ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:29.412378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271440e-1249-411d-97a1-3841333435ab admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:29.412839 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271440e-1249-411d-97a1-3841333435ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:29.413314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271440e-1249-411d-97a1-3841333435ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:29.414229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271440e-1249-411d-97a1-3841333435ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:29.416261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271440e-1249-411d-97a1-3841333435ab admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:29.429325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 979/1961] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:29.434230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b39ae-1c02-4e49-8d4f-3a90f879a50c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:29.446332 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b39ae-1c02-4e49-8d4f-3a90f879a50c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:29.451811 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413ac3a-9fc3-49d9-9d7e-f97f51c410ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:29.453583 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413ac3a-9fc3-49d9-9d7e-f97f51c410ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:29.454045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413ac3a-9fc3-49d9-9d7e-f97f51c410ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:29.454458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413ac3a-9fc3-49d9-9d7e-f97f51c410ca admin admin] PATH_INFO: `/v3/projects/e39ce1f48a55416ea165b44d21c0c12e/users/1365760c906d48329c0f8585882b3526/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:29.468289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:29.476770 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413ac3a-9fc3-49d9-9d7e-f97f51c410ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39ce1f48a55416ea165b44d21c0c12e, user_id=1365760c906d48329c0f8585882b3526, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:29.479859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413ac3a-9fc3-49d9-9d7e-f97f51c410ca admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:29.504696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 983/1962] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:29 2022] PUT /identity/v3/projects/e39ce1f48a55416ea165b44d21c0c12e/users/1365760c906d48329c0f8585882b3526/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:29.519052 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767fbf8-83dd-4953-8f90-425282fda40f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:29.519581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767fbf8-83dd-4953-8f90-425282fda40f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:29.520229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767fbf8-83dd-4953-8f90-425282fda40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:29.586050 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-3767fbf8-83dd-4953-8f90-425282fda40f None None] MFA Rules not processed for user `1365760c906d48329c0f8585882b3526`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:29.588138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3767fbf8-83dd-4953-8f90-425282fda40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:29.685244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413ac3a-9fc3-49d9-9d7e-f97f51c410ca admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:29.685825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 980/1963] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:29 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:29.764050 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413ac3a-9fc3-49d9-9d7e-f97f51c410ca admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:29.768938 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c49683-c376-4332-87b3-73b2701b1936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:29.769563 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49683-c376-4332-87b3-73b2701b1936 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:29.769836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49683-c376-4332-87b3-73b2701b1936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:29.770104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c49683-c376-4332-87b3-73b2701b1936 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:29.770864 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c49683-c376-4332-87b3-73b2701b1936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:29.772953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c49683-c376-4332-87b3-73b2701b1936 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:29.804596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 984/1964] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:29 2022] POST /identity/v3/projects => generated 399 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:29.806031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767fbf8-83dd-4953-8f90-425282fda40f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:29.819105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767fbf8-83dd-4953-8f90-425282fda40f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:29.904027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ce896-e2e0-41ef-a1a5-0a9025561dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:29.904833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ce896-e2e0-41ef-a1a5-0a9025561dbe admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:29.905271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ce896-e2e0-41ef-a1a5-0a9025561dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:29.905571 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ce896-e2e0-41ef-a1a5-0a9025561dbe admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:29.906307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ce896-e2e0-41ef-a1a5-0a9025561dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:29.909037 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ce896-e2e0-41ef-a1a5-0a9025561dbe admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:29.966787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 981/1965] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:29 2022] POST /identity/v3/users => generated 306 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:29.967919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c49683-c376-4332-87b3-73b2701b1936 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:29.979300 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c49683-c376-4332-87b3-73b2701b1936 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:29.986298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57613b3f-7a24-4653-8f91-b045f1d87b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:29.986967 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57613b3f-7a24-4653-8f91-b045f1d87b9c admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:29.987249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57613b3f-7a24-4653-8f91-b045f1d87b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:29.987522 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57613b3f-7a24-4653-8f91-b045f1d87b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:29.988177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57613b3f-7a24-4653-8f91-b045f1d87b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:29.989970 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57613b3f-7a24-4653-8f91-b045f1d87b9c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:30.003805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 985/1966] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:30.009433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ce896-e2e0-41ef-a1a5-0a9025561dbe admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:30.022897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ce896-e2e0-41ef-a1a5-0a9025561dbe admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:30.029241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa584d0-e993-4839-9618-795e06d8ac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:30.030056 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa584d0-e993-4839-9618-795e06d8ac56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:30.030435 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa584d0-e993-4839-9618-795e06d8ac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:30.030895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa584d0-e993-4839-9618-795e06d8ac56 admin admin] PATH_INFO: `/v3/projects/fdfe7196e5674fb6bbf747be851c080a/users/820cf3f33b464bc5871dd87d7df1f767/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:30.052266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa584d0-e993-4839-9618-795e06d8ac56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdfe7196e5674fb6bbf747be851c080a, user_id=820cf3f33b464bc5871dd87d7df1f767, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:30.055568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa584d0-e993-4839-9618-795e06d8ac56 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:30.074511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 982/1967] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:30 2022] PUT /identity/v3/projects/fdfe7196e5674fb6bbf747be851c080a/users/820cf3f33b464bc5871dd87d7df1f767/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:30.079323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57613b3f-7a24-4653-8f91-b045f1d87b9c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:30.092800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57613b3f-7a24-4653-8f91-b045f1d87b9c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:30.123421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa584d0-e993-4839-9618-795e06d8ac56 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:30.125544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4fa584d0-e993-4839-9618-795e06d8ac56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:30.198502 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da92b-6eab-4c74-acd6-ce3efcc5b003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:30.199509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da92b-6eab-4c74-acd6-ce3efcc5b003 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:30.199718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da92b-6eab-4c74-acd6-ce3efcc5b003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:30.199966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da92b-6eab-4c74-acd6-ce3efcc5b003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:30.200647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8da92b-6eab-4c74-acd6-ce3efcc5b003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:30.202743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8da92b-6eab-4c74-acd6-ce3efcc5b003 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:30.210637 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:30.218799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 986/1968] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:30.219980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da92b-6eab-4c74-acd6-ce3efcc5b003 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:30.233117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da92b-6eab-4c74-acd6-ce3efcc5b003 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:30.238315 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ff435-935a-46ec-b690-a6854e7d989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:30.239077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ff435-935a-46ec-b690-a6854e7d989d admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:30.239406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ff435-935a-46ec-b690-a6854e7d989d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:30.239683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ff435-935a-46ec-b690-a6854e7d989d admin admin] PATH_INFO: `/v3/projects/fdfe7196e5674fb6bbf747be851c080a/users/820cf3f33b464bc5871dd87d7df1f767/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:30.241622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ff435-935a-46ec-b690-a6854e7d989d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdfe7196e5674fb6bbf747be851c080a, user_id=820cf3f33b464bc5871dd87d7df1f767, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:30.242702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa584d0-e993-4839-9618-795e06d8ac56 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:30.244426 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ff435-935a-46ec-b690-a6854e7d989d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:30.249451 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305d79f-d674-4d68-a708-1f8820d408fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:30.250255 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305d79f-d674-4d68-a708-1f8820d408fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:30.250375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305d79f-d674-4d68-a708-1f8820d408fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:30.250622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305d79f-d674-4d68-a708-1f8820d408fb admin admin] PATH_INFO: `/v3/projects/cd9964fbdaa64c07be7228c03e56a586` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:30.251949 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305d79f-d674-4d68-a708-1f8820d408fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9964fbdaa64c07be7228c03e56a586)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:30.253906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305d79f-d674-4d68-a708-1f8820d408fb admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:30.257377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 987/1969] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:30 2022] PUT /identity/v3/projects/fdfe7196e5674fb6bbf747be851c080a/users/820cf3f33b464bc5871dd87d7df1f767/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:30.268947 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0ef91-5f61-48e6-aa61-f978d761acc9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:30.269248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0ef91-5f61-48e6-aa61-f978d761acc9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:30.272922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0ef91-5f61-48e6-aa61-f978d761acc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:30.328318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f3b0ef91-5f61-48e6-aa61-f978d761acc9 None None] MFA Rules not processed for user `820cf3f33b464bc5871dd87d7df1f767`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:30.329665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f3b0ef91-5f61-48e6-aa61-f978d761acc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:30.380270 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a305d79f-d674-4d68-a708-1f8820d408fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9964fbdaa64c07be7228c03e56a586', 'request_id': 'req-a305d79f-d674-4d68-a708-1f8820d408fb'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:30.384429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:30.394750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a305d79f-d674-4d68-a708-1f8820d408fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9964fbdaa64c07be7228c03e56a586', 'request_id': 'req-a305d79f-d674-4d68-a708-1f8820d408fb'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:30.412844 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a305d79f-d674-4d68-a708-1f8820d408fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9964fbdaa64c07be7228c03e56a586', 'request_id': 'req-a305d79f-d674-4d68-a708-1f8820d408fb'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:30.431481 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a305d79f-d674-4d68-a708-1f8820d408fb admin admin] The token cache is being invalidate because project cd9964fbdaa64c07be7228c03e56a586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:30.432263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a305d79f-d674-4d68-a708-1f8820d408fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:30.433336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a305d79f-d674-4d68-a708-1f8820d408fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:30.439166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 983/1970] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:30 2022] DELETE /identity/v3/projects/cd9964fbdaa64c07be7228c03e56a586 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:30.457142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2e1f-1ee9-4263-9ca8-e67ef7b89981 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:30.457612 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2e1f-1ee9-4263-9ca8-e67ef7b89981 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:30.458086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2e1f-1ee9-4263-9ca8-e67ef7b89981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:30.460356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 988/1971] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:30.474898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0ef91-5f61-48e6-aa61-f978d761acc9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:30.477321 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f3b0ef91-5f61-48e6-aa61-f978d761acc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:30.491923 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-b00d2e1f-1ee9-4263-9ca8-e67ef7b89981 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:30.493243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-b00d2e1f-1ee9-4263-9ca8-e67ef7b89981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:30.571074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 984/1972] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:30.579814 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddb0b0-ed01-42dd-a2c6-5d7386def3a4 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:30.580415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddb0b0-ed01-42dd-a2c6-5d7386def3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:30.580827 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddb0b0-ed01-42dd-a2c6-5d7386def3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:30.604204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-d2ddb0b0-ed01-42dd-a2c6-5d7386def3a4 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:30.604828 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0ef91-5f61-48e6-aa61-f978d761acc9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:30.606035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d2ddb0b0-ed01-42dd-a2c6-5d7386def3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:30.619603 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 985/1973] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:30.620819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddb0b0-ed01-42dd-a2c6-5d7386def3a4 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:30.633855 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddb0b0-ed01-42dd-a2c6-5d7386def3a4 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:30.642160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536feef-c6a6-489b-9d28-53e278215a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:30.642978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536feef-c6a6-489b-9d28-53e278215a3f admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:30.643676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536feef-c6a6-489b-9d28-53e278215a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:30.643955 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536feef-c6a6-489b-9d28-53e278215a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:30.644617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536feef-c6a6-489b-9d28-53e278215a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:30.644993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536feef-c6a6-489b-9d28-53e278215a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:30.647526 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536feef-c6a6-489b-9d28-53e278215a3f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:30.665686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 986/1974] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:30.670491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536feef-c6a6-489b-9d28-53e278215a3f admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:30.679698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f2021-1d31-4c74-be19-347403815f78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:30.680380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f2021-1d31-4c74-be19-347403815f78 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:30.680668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f2021-1d31-4c74-be19-347403815f78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:30.681101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f2021-1d31-4c74-be19-347403815f78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:30.684308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536feef-c6a6-489b-9d28-53e278215a3f admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:30.692414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e68b9d-96e2-4010-b112-5b8fd44a65bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:30.693219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e68b9d-96e2-4010-b112-5b8fd44a65bc admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:30.693581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e68b9d-96e2-4010-b112-5b8fd44a65bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:30.693936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e68b9d-96e2-4010-b112-5b8fd44a65bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:30.694965 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e68b9d-96e2-4010-b112-5b8fd44a65bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:30.697334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e68b9d-96e2-4010-b112-5b8fd44a65bc admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:30.739697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 987/1975] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:30 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:30.743774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e68b9d-96e2-4010-b112-5b8fd44a65bc admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:30.775613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f2021-1d31-4c74-be19-347403815f78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:30.777730 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f2021-1d31-4c74-be19-347403815f78 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:30.803505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:30.817712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 989/1976] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:03:30.872077 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e68b9d-96e2-4010-b112-5b8fd44a65bc admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:30.891664 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df8cac-8e07-4a63-9cf4-a2761368391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:30.892319 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df8cac-8e07-4a63-9cf4-a2761368391d admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:30.892602 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df8cac-8e07-4a63-9cf4-a2761368391d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:30.892882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df8cac-8e07-4a63-9cf4-a2761368391d admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:30.893530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df8cac-8e07-4a63-9cf4-a2761368391d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:30.895663 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df8cac-8e07-4a63-9cf4-a2761368391d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:30.916609 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f2021-1d31-4c74-be19-347403815f78 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:30.918556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fc5f2021-1d31-4c74-be19-347403815f78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:30.936031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f2021-1d31-4c74-be19-347403815f78 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:30.938681 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 988/1977] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:30 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:30.941566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df8cac-8e07-4a63-9cf4-a2761368391d admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:30.956113 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df8cac-8e07-4a63-9cf4-a2761368391d admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:30.962474 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83fe27-6e92-42f0-a71e-d06f5cca1614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:30.963476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83fe27-6e92-42f0-a71e-d06f5cca1614 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:30.963929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83fe27-6e92-42f0-a71e-d06f5cca1614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:30.964560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83fe27-6e92-42f0-a71e-d06f5cca1614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:30.965568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83fe27-6e92-42f0-a71e-d06f5cca1614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:30.967364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83fe27-6e92-42f0-a71e-d06f5cca1614 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:30.983992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 989/1978] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:30.987700 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83fe27-6e92-42f0-a71e-d06f5cca1614 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:31.002367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83fe27-6e92-42f0-a71e-d06f5cca1614 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:31.003296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:31.014156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224679b4-7a44-4331-a803-a765e35c1e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:31.015517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224679b4-7a44-4331-a803-a765e35c1e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:31.015888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224679b4-7a44-4331-a803-a765e35c1e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:31.016166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224679b4-7a44-4331-a803-a765e35c1e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:31.017284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224679b4-7a44-4331-a803-a765e35c1e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:31.019977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224679b4-7a44-4331-a803-a765e35c1e45 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:31.037561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 990/1979] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:31.039103 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224679b4-7a44-4331-a803-a765e35c1e45 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:31.045990 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bb334-ce07-42fc-b5f6-a6716bad8128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:31.047069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bb334-ce07-42fc-b5f6-a6716bad8128 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:31.048394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bb334-ce07-42fc-b5f6-a6716bad8128 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:31.049054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bb334-ce07-42fc-b5f6-a6716bad8128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:31.052134 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-476bb334-ce07-42fc-b5f6-a6716bad8128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:31.052815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224679b4-7a44-4331-a803-a765e35c1e45 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:31.059086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834984a-21cc-49e6-8ba8-3af72c960ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:31.059869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834984a-21cc-49e6-8ba8-3af72c960ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:31.060209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834984a-21cc-49e6-8ba8-3af72c960ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:31.060550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834984a-21cc-49e6-8ba8-3af72c960ccf admin admin] PATH_INFO: `/v3/projects/501f573d35ea40fe9f9f9d4ab9843a0c/users/1b50ca44d7c8424693c136e5104a0e02/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:31.086292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834984a-21cc-49e6-8ba8-3af72c960ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=501f573d35ea40fe9f9f9d4ab9843a0c, user_id=1b50ca44d7c8424693c136e5104a0e02, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:31.092850 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834984a-21cc-49e6-8ba8-3af72c960ccf admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:31.122567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 991/1980] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:31 2022] PUT /identity/v3/projects/501f573d35ea40fe9f9f9d4ab9843a0c/users/1b50ca44d7c8424693c136e5104a0e02/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:31.136399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a785ae7-294b-4fe6-9f38-476d62bf71b4 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:31.136899 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a785ae7-294b-4fe6-9f38-476d62bf71b4 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:31.137379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a785ae7-294b-4fe6-9f38-476d62bf71b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:31.163204 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bb334-ce07-42fc-b5f6-a6716bad8128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:31.166301 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bb334-ce07-42fc-b5f6-a6716bad8128 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:31.184411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 990/1981] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:30 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:31.204822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-5a785ae7-294b-4fe6-9f38-476d62bf71b4 None None] MFA Rules not processed for user `1b50ca44d7c8424693c136e5104a0e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:31.206351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5a785ae7-294b-4fe6-9f38-476d62bf71b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:31.297927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 992/1982] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:31.303024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bb334-ce07-42fc-b5f6-a6716bad8128 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:31.315554 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bb334-ce07-42fc-b5f6-a6716bad8128 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:31.406086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c535249-07e3-452b-8d34-9b8dd59b7487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:31.407051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c535249-07e3-452b-8d34-9b8dd59b7487 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:31.407464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c535249-07e3-452b-8d34-9b8dd59b7487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:31.407875 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c535249-07e3-452b-8d34-9b8dd59b7487 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:31.408820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c535249-07e3-452b-8d34-9b8dd59b7487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:31.414167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c535249-07e3-452b-8d34-9b8dd59b7487 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:31.468832 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 991/1983] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:31 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:31.469815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a785ae7-294b-4fe6-9f38-476d62bf71b4 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:31.482999 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a785ae7-294b-4fe6-9f38-476d62bf71b4 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:31.573222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd92ec-c488-4c4e-b7f1-96f3ef124d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:31.574316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd92ec-c488-4c4e-b7f1-96f3ef124d17 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:31.574789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd92ec-c488-4c4e-b7f1-96f3ef124d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:31.575057 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd92ec-c488-4c4e-b7f1-96f3ef124d17 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:31.575714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd92ec-c488-4c4e-b7f1-96f3ef124d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:31.578169 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd92ec-c488-4c4e-b7f1-96f3ef124d17 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:31.612173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:31.668847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 993/1984] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:31 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:31.672915 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c535249-07e3-452b-8d34-9b8dd59b7487 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:31.685604 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c535249-07e3-452b-8d34-9b8dd59b7487 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:31.691590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa7a00-af67-4e12-86e6-e5264b827229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:31.699328 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa7a00-af67-4e12-86e6-e5264b827229 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:31.700014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa7a00-af67-4e12-86e6-e5264b827229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:31.700400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa7a00-af67-4e12-86e6-e5264b827229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:31.701191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa7a00-af67-4e12-86e6-e5264b827229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:31.703336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa7a00-af67-4e12-86e6-e5264b827229 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:31.744118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 992/1985] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:31.748109 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd92ec-c488-4c4e-b7f1-96f3ef124d17 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:31.774546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd92ec-c488-4c4e-b7f1-96f3ef124d17 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:31.792428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d823a13-2e69-4e47-b593-0967391fa671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:31.794328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d823a13-2e69-4e47-b593-0967391fa671 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:31.794702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d823a13-2e69-4e47-b593-0967391fa671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:31.794986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d823a13-2e69-4e47-b593-0967391fa671 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:31.796803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d823a13-2e69-4e47-b593-0967391fa671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:31.798680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d823a13-2e69-4e47-b593-0967391fa671 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:31.811774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 994/1986] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:31.816414 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa7a00-af67-4e12-86e6-e5264b827229 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:31.841901 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa7a00-af67-4e12-86e6-e5264b827229 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:31.855423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8484d-8f1c-45e1-b116-49a724293347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:31.856128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8484d-8f1c-45e1-b116-49a724293347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:31.856431 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8484d-8f1c-45e1-b116-49a724293347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:31.856712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8484d-8f1c-45e1-b116-49a724293347 admin admin] PATH_INFO: `/v3/projects/f1907cb7451b48c687eb83730969eb89/users/db86ab7998c64e429c838a9fe7d9144d/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:31.877540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8484d-8f1c-45e1-b116-49a724293347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1907cb7451b48c687eb83730969eb89, user_id=db86ab7998c64e429c838a9fe7d9144d, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:31.879799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8484d-8f1c-45e1-b116-49a724293347 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:31.899295 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 993/1987] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:31 2022] PUT /identity/v3/projects/f1907cb7451b48c687eb83730969eb89/users/db86ab7998c64e429c838a9fe7d9144d/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:31.911175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6905-fd68-4aaf-838c-2fcf1c9e12e9 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:31.911793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6905-fd68-4aaf-838c-2fcf1c9e12e9 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:31.912095 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be6905-fd68-4aaf-838c-2fcf1c9e12e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:31.952247 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-43be6905-fd68-4aaf-838c-2fcf1c9e12e9 None None] MFA Rules not processed for user `db86ab7998c64e429c838a9fe7d9144d`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:31.953837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-43be6905-fd68-4aaf-838c-2fcf1c9e12e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:32.060449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8484d-8f1c-45e1-b116-49a724293347 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:32.067539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 995/1988] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:32.171845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:32.208501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8484d-8f1c-45e1-b116-49a724293347 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:32.223376 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5250bf-43d4-41a9-bb69-1374497e320d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:32.224790 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5250bf-43d4-41a9-bb69-1374497e320d admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:32.225340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5250bf-43d4-41a9-bb69-1374497e320d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:32.225751 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5250bf-43d4-41a9-bb69-1374497e320d admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:32.226553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5250bf-43d4-41a9-bb69-1374497e320d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:32.236897 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5250bf-43d4-41a9-bb69-1374497e320d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:32.288774 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 994/1989] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:32 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:32.290248 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be6905-fd68-4aaf-838c-2fcf1c9e12e9 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:32.302282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be6905-fd68-4aaf-838c-2fcf1c9e12e9 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:32.390207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2093a7-d0ce-409e-ac2a-325e1a783d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:32.391051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2093a7-d0ce-409e-ac2a-325e1a783d03 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:32.391419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2093a7-d0ce-409e-ac2a-325e1a783d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:32.391785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2093a7-d0ce-409e-ac2a-325e1a783d03 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:32.392524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2093a7-d0ce-409e-ac2a-325e1a783d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:32.394930 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2093a7-d0ce-409e-ac2a-325e1a783d03 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:32.423045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 996/1990] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:32 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:32.424436 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5250bf-43d4-41a9-bb69-1374497e320d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:32.435556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5250bf-43d4-41a9-bb69-1374497e320d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:32.441789 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0e7ac-504f-45fe-a002-edd45e6b276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:32.442423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0e7ac-504f-45fe-a002-edd45e6b276b admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:32.442768 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0e7ac-504f-45fe-a002-edd45e6b276b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:32.443018 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0e7ac-504f-45fe-a002-edd45e6b276b admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:32.443673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0e7ac-504f-45fe-a002-edd45e6b276b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:32.445353 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0e7ac-504f-45fe-a002-edd45e6b276b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:32.462356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 995/1991] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:32.464422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2093a7-d0ce-409e-ac2a-325e1a783d03 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:32.474572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2093a7-d0ce-409e-ac2a-325e1a783d03 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:32.479473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972289f-a301-4b4b-91bc-d53cbc87d207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:32.480186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972289f-a301-4b4b-91bc-d53cbc87d207 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:32.480468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972289f-a301-4b4b-91bc-d53cbc87d207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:32.480752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972289f-a301-4b4b-91bc-d53cbc87d207 admin admin] PATH_INFO: `/v3/projects/7be9af4886dc4ac5897d07a04dfca8a1/users/289a16e9cf5a443ebcb3c0796d022799/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:32.497998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972289f-a301-4b4b-91bc-d53cbc87d207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be9af4886dc4ac5897d07a04dfca8a1, user_id=289a16e9cf5a443ebcb3c0796d022799, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:32.500803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972289f-a301-4b4b-91bc-d53cbc87d207 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:32.519081 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 997/1992] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:32 2022] PUT /identity/v3/projects/7be9af4886dc4ac5897d07a04dfca8a1/users/289a16e9cf5a443ebcb3c0796d022799/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:32.520395 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0e7ac-504f-45fe-a002-edd45e6b276b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:32.532365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0e7ac-504f-45fe-a002-edd45e6b276b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:32.598404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb480f-7e29-4b7e-b1dc-d425d54b5140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:32.599077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb480f-7e29-4b7e-b1dc-d425d54b5140 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:32.599355 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb480f-7e29-4b7e-b1dc-d425d54b5140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:32.599628 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb480f-7e29-4b7e-b1dc-d425d54b5140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:32.600342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb480f-7e29-4b7e-b1dc-d425d54b5140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:32.602235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb480f-7e29-4b7e-b1dc-d425d54b5140 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:32.617748 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 996/1993] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:32.619458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972289f-a301-4b4b-91bc-d53cbc87d207 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:32.631208 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972289f-a301-4b4b-91bc-d53cbc87d207 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:32.638429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c75470-4aae-4b42-b665-6f7a46304712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:32.639194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c75470-4aae-4b42-b665-6f7a46304712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:32.639539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c75470-4aae-4b42-b665-6f7a46304712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:32.639881 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c75470-4aae-4b42-b665-6f7a46304712 admin admin] PATH_INFO: `/v3/projects/7be9af4886dc4ac5897d07a04dfca8a1/users/289a16e9cf5a443ebcb3c0796d022799/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:32.642068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c75470-4aae-4b42-b665-6f7a46304712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be9af4886dc4ac5897d07a04dfca8a1, user_id=289a16e9cf5a443ebcb3c0796d022799, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:32.645574 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c75470-4aae-4b42-b665-6f7a46304712 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:32.670245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 998/1994] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:32 2022] PUT /identity/v3/projects/7be9af4886dc4ac5897d07a04dfca8a1/users/289a16e9cf5a443ebcb3c0796d022799/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:32.672439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c1b70-f2f5-42a4-9784-2b388b742cba None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:32.672750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c1b70-f2f5-42a4-9784-2b388b742cba None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:32.673148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c1b70-f2f5-42a4-9784-2b388b742cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:32.710240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f41c1b70-f2f5-42a4-9784-2b388b742cba None None] MFA Rules not processed for user `289a16e9cf5a443ebcb3c0796d022799`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:32.711877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f41c1b70-f2f5-42a4-9784-2b388b742cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:32.897021 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 997/1995] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:32.969729 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c75470-4aae-4b42-b665-6f7a46304712 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:33.032711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:33.089336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c75470-4aae-4b42-b665-6f7a46304712 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:33.095107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e41170-cd4c-4d38-bc05-1639f125385a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:33.095902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41170-cd4c-4d38-bc05-1639f125385a service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:33.096256 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41170-cd4c-4d38-bc05-1639f125385a service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:33.096733 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41170-cd4c-4d38-bc05-1639f125385a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:33.191762 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e41170-cd4c-4d38-bc05-1639f125385a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:33.193882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e41170-cd4c-4d38-bc05-1639f125385a service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:33.219011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 999/1996] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:35.255976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c1b70-f2f5-42a4-9784-2b388b742cba None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:35.266341 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c1b70-f2f5-42a4-9784-2b388b742cba None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:35.270257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d5456-0bfc-42f8-bdad-937c35749acb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:35.270925 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d5456-0bfc-42f8-bdad-937c35749acb service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:35.271262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d5456-0bfc-42f8-bdad-937c35749acb service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:35.271509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d5456-0bfc-42f8-bdad-937c35749acb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:35.334510 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:35.372136 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d5456-0bfc-42f8-bdad-937c35749acb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:35.373612 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d5456-0bfc-42f8-bdad-937c35749acb service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:35.387379 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 998/1997] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:35.890692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e41170-cd4c-4d38-bc05-1639f125385a service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:35.892327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a2e41170-cd4c-4d38-bc05-1639f125385a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:36.016439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e41170-cd4c-4d38-bc05-1639f125385a service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:36.025317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bc854-55f3-4985-bef2-77c6fd7b7a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:36.027577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bc854-55f3-4985-bef2-77c6fd7b7a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:36.028030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bc854-55f3-4985-bef2-77c6fd7b7a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:36.028586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bc854-55f3-4985-bef2-77c6fd7b7a88 admin admin] PATH_INFO: `/v3/users/1365760c906d48329c0f8585882b3526` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:36.030888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bc854-55f3-4985-bef2-77c6fd7b7a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1365760c906d48329c0f8585882b3526)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:36.033928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559bc854-55f3-4985-bef2-77c6fd7b7a88 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:36.110449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-559bc854-55f3-4985-bef2-77c6fd7b7a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1365760c906d48329c0f8585882b3526'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:36.136258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-559bc854-55f3-4985-bef2-77c6fd7b7a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1365760c906d48329c0f8585882b3526'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:36.147894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-559bc854-55f3-4985-bef2-77c6fd7b7a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1365760c906d48329c0f8585882b3526'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:36.155840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:36.158088 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-559bc854-55f3-4985-bef2-77c6fd7b7a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1365760c906d48329c0f8585882b3526'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:36.159185 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-559bc854-55f3-4985-bef2-77c6fd7b7a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1365760c906d48329c0f8585882b3526'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:36.173645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfc02a-5444-4518-8ccc-d2f3d578528e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:36.173959 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfc02a-5444-4518-8ccc-d2f3d578528e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:36.174205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfc02a-5444-4518-8ccc-d2f3d578528e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:36.177472 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1000/1998] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:35 2022] DELETE /identity/v3/users/1365760c906d48329c0f8585882b3526 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:36.215805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-32cfc02a-5444-4518-8ccc-d2f3d578528e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:36.217743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-32cfc02a-5444-4518-8ccc-d2f3d578528e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:36.241529 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bc854-55f3-4985-bef2-77c6fd7b7a88 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:36.243583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-559bc854-55f3-4985-bef2-77c6fd7b7a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:36.314299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bc854-55f3-4985-bef2-77c6fd7b7a88 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:36.318790 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ed7f2-0a0e-4cf4-9a55-65b3a36bbf66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:36.319570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ed7f2-0a0e-4cf4-9a55-65b3a36bbf66 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:36.319921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ed7f2-0a0e-4cf4-9a55-65b3a36bbf66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:36.320204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ed7f2-0a0e-4cf4-9a55-65b3a36bbf66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:36.322315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0e1ed7f2-0a0e-4cf4-9a55-65b3a36bbf66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:36.346584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 999/1999] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:36.353206 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfc02a-5444-4518-8ccc-d2f3d578528e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:36.354888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-32cfc02a-5444-4518-8ccc-d2f3d578528e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:36.422512 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ed7f2-0a0e-4cf4-9a55-65b3a36bbf66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:36.424178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ed7f2-0a0e-4cf4-9a55-65b3a36bbf66 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:36.427745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfc02a-5444-4518-8ccc-d2f3d578528e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:36.435214 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1001/2000] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:36.437302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55572db6-af6f-478b-8144-728cf65d0ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:36.438299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55572db6-af6f-478b-8144-728cf65d0ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:36.438797 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55572db6-af6f-478b-8144-728cf65d0ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:36.439355 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55572db6-af6f-478b-8144-728cf65d0ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:36.453503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55572db6-af6f-478b-8144-728cf65d0ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:36.455644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55572db6-af6f-478b-8144-728cf65d0ab0 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:36.470006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1000/2001] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:36.903264 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ed7f2-0a0e-4cf4-9a55-65b3a36bbf66 service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:36.904809 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0e1ed7f2-0a0e-4cf4-9a55-65b3a36bbf66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:36.922774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ed7f2-0a0e-4cf4-9a55-65b3a36bbf66 service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:36.935155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:36.935834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:36.936124 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:36.936428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] PATH_INFO: `/v3/projects/e39ce1f48a55416ea165b44d21c0c12e` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:36.938768 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39ce1f48a55416ea165b44d21c0c12e)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:36.940909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:37.028326 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39ce1f48a55416ea165b44d21c0c12e', 'request_id': 'req-ff26d418-8375-45b7-bd0e-e029449818a2'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.037653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39ce1f48a55416ea165b44d21c0c12e', 'request_id': 'req-ff26d418-8375-45b7-bd0e-e029449818a2'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.046661 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39ce1f48a55416ea165b44d21c0c12e', 'request_id': 'req-ff26d418-8375-45b7-bd0e-e029449818a2'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.057801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] The token cache is being invalidate because project e39ce1f48a55416ea165b44d21c0c12e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:37.058554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.059878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.062574 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1002/2002] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:36 2022] DELETE /identity/v3/projects/e39ce1f48a55416ea165b44d21c0c12e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:37.066625 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55572db6-af6f-478b-8144-728cf65d0ab0 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:37.080014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55572db6-af6f-478b-8144-728cf65d0ab0 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:37.161453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d76326-6eb4-4bb4-93e2-0e2405ff7d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:37.161453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d76326-6eb4-4bb4-93e2-0e2405ff7d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:37.161453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d76326-6eb4-4bb4-93e2-0e2405ff7d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:37.161453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d76326-6eb4-4bb4-93e2-0e2405ff7d60 admin admin] PATH_INFO: `/v3/users/820cf3f33b464bc5871dd87d7df1f767` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:37.162528 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d76326-6eb4-4bb4-93e2-0e2405ff7d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=820cf3f33b464bc5871dd87d7df1f767)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:37.164704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d76326-6eb4-4bb4-93e2-0e2405ff7d60 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:37.197706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:37.239128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-61d76326-6eb4-4bb4-93e2-0e2405ff7d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820cf3f33b464bc5871dd87d7df1f767'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.240452 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-61d76326-6eb4-4bb4-93e2-0e2405ff7d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820cf3f33b464bc5871dd87d7df1f767'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.241344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-61d76326-6eb4-4bb4-93e2-0e2405ff7d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820cf3f33b464bc5871dd87d7df1f767'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.254711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-61d76326-6eb4-4bb4-93e2-0e2405ff7d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820cf3f33b464bc5871dd87d7df1f767'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.266960 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-61d76326-6eb4-4bb4-93e2-0e2405ff7d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820cf3f33b464bc5871dd87d7df1f767'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.291069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1001/2003] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:37 2022] DELETE /identity/v3/users/820cf3f33b464bc5871dd87d7df1f767 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:37.619812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:37.622793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:37.646420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26d418-8375-45b7-bd0e-e029449818a2 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:37.699895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:37.763326 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e61e68-dfd1-42bf-906f-37f46623a33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:37.764954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e61e68-dfd1-42bf-906f-37f46623a33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:37.765381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e61e68-dfd1-42bf-906f-37f46623a33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:37.765665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e61e68-dfd1-42bf-906f-37f46623a33f admin admin] PATH_INFO: `/v3/projects/fdfe7196e5674fb6bbf747be851c080a` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:37.780670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e61e68-dfd1-42bf-906f-37f46623a33f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdfe7196e5674fb6bbf747be851c080a)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:37.782846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e61e68-dfd1-42bf-906f-37f46623a33f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:37.854025 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c5e61e68-dfd1-42bf-906f-37f46623a33f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdfe7196e5674fb6bbf747be851c080a', 'request_id': 'req-c5e61e68-dfd1-42bf-906f-37f46623a33f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.864670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c5e61e68-dfd1-42bf-906f-37f46623a33f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdfe7196e5674fb6bbf747be851c080a', 'request_id': 'req-c5e61e68-dfd1-42bf-906f-37f46623a33f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.873987 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c5e61e68-dfd1-42bf-906f-37f46623a33f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdfe7196e5674fb6bbf747be851c080a', 'request_id': 'req-c5e61e68-dfd1-42bf-906f-37f46623a33f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.902722 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c5e61e68-dfd1-42bf-906f-37f46623a33f admin admin] The token cache is being invalidate because project fdfe7196e5674fb6bbf747be851c080a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:37.903006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c5e61e68-dfd1-42bf-906f-37f46623a33f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.903860 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c5e61e68-dfd1-42bf-906f-37f46623a33f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:37.906024 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1003/2004] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:37 2022] DELETE /identity/v3/projects/fdfe7196e5674fb6bbf747be851c080a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:37.911970 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b78cf-0231-486a-b108-71a1edc35acb None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:37.912459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b78cf-0231-486a-b108-71a1edc35acb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:37.912569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b78cf-0231-486a-b108-71a1edc35acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:37.936181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d12b78cf-0231-486a-b108-71a1edc35acb None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:37.937719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d12b78cf-0231-486a-b108-71a1edc35acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:38.044955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1002/2005] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:38.048277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169c774-03b3-4986-a027-d04cff366ec7 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.048821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169c774-03b3-4986-a027-d04cff366ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.049251 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169c774-03b3-4986-a027-d04cff366ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:38.072777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-9169c774-03b3-4986-a027-d04cff366ec7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:38.074327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9169c774-03b3-4986-a027-d04cff366ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:38.083248 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1004/2006] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:38.087741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b78cf-0231-486a-b108-71a1edc35acb None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:38.098961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b78cf-0231-486a-b108-71a1edc35acb None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:38.103941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c63860-8fc3-406e-92cc-0b921cd311b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:38.104565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c63860-8fc3-406e-92cc-0b921cd311b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.104847 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c63860-8fc3-406e-92cc-0b921cd311b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.105147 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c63860-8fc3-406e-92cc-0b921cd311b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:38.105805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c63860-8fc3-406e-92cc-0b921cd311b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:38.106107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c63860-8fc3-406e-92cc-0b921cd311b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:38.108371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c63860-8fc3-406e-92cc-0b921cd311b8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:38.121537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1003/2007] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:38.125866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169c774-03b3-4986-a027-d04cff366ec7 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:38.137154 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169c774-03b3-4986-a027-d04cff366ec7 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:38.143215 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7eb3d-172e-4b5a-a371-85f94d984f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:38.143930 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7eb3d-172e-4b5a-a371-85f94d984f5a admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.144249 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7eb3d-172e-4b5a-a371-85f94d984f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.144623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7eb3d-172e-4b5a-a371-85f94d984f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:38.145347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7eb3d-172e-4b5a-a371-85f94d984f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:38.147522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7eb3d-172e-4b5a-a371-85f94d984f5a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:38.178034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1005/2008] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:38 2022] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:38.182564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c63860-8fc3-406e-92cc-0b921cd311b8 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:38.193550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c63860-8fc3-406e-92cc-0b921cd311b8 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:38.255705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74acd8-bbd6-4b3b-a591-8e871dd2549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:38.256399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74acd8-bbd6-4b3b-a591-8e871dd2549d admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.256754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74acd8-bbd6-4b3b-a591-8e871dd2549d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.257187 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74acd8-bbd6-4b3b-a591-8e871dd2549d admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:38.257798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74acd8-bbd6-4b3b-a591-8e871dd2549d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:38.259850 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74acd8-bbd6-4b3b-a591-8e871dd2549d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:38.311302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1004/2009] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:38 2022] POST /identity/v3/users => generated 304 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:38.312775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7eb3d-172e-4b5a-a371-85f94d984f5a admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:38.341292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7eb3d-172e-4b5a-a371-85f94d984f5a admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:38.355010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff8f0d-d1df-4a98-8eed-2bca00a70325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:38.355648 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff8f0d-d1df-4a98-8eed-2bca00a70325 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.356712 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff8f0d-d1df-4a98-8eed-2bca00a70325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.357161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff8f0d-d1df-4a98-8eed-2bca00a70325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:38.357666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff8f0d-d1df-4a98-8eed-2bca00a70325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:38.359643 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff8f0d-d1df-4a98-8eed-2bca00a70325 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:38.379745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1006/2010] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:38.380863 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74acd8-bbd6-4b3b-a591-8e871dd2549d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:38.397824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74acd8-bbd6-4b3b-a591-8e871dd2549d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:38.414220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e629a-3a11-43b1-93fb-d80eac6244e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:38.415419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e629a-3a11-43b1-93fb-d80eac6244e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.415935 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e629a-3a11-43b1-93fb-d80eac6244e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.416352 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e629a-3a11-43b1-93fb-d80eac6244e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:38.417154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e629a-3a11-43b1-93fb-d80eac6244e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:38.418948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e629a-3a11-43b1-93fb-d80eac6244e2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:38.434695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1005/2011] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:38.435774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff8f0d-d1df-4a98-8eed-2bca00a70325 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:38.437991 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-95ff8f0d-d1df-4a98-8eed-2bca00a70325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:38.438505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e629a-3a11-43b1-93fb-d80eac6244e2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:38.445287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:38.451812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e629a-3a11-43b1-93fb-d80eac6244e2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:38.456094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff8f0d-d1df-4a98-8eed-2bca00a70325 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:38.458788 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb8bc8-bb2e-420c-93a5-9009bb58ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:38.459665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb8bc8-bb2e-420c-93a5-9009bb58ad8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.460027 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb8bc8-bb2e-420c-93a5-9009bb58ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.460445 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb8bc8-bb2e-420c-93a5-9009bb58ad8b admin admin] PATH_INFO: `/v3/projects/a3202efebd104790a34aa3ebde340870/users/8e36f4c097284dcfb5c6c8ae1c5de53a/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:38.463189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64ead8-e11f-403d-ac33-f2f4e36d4832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:38.464011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64ead8-e11f-403d-ac33-f2f4e36d4832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.465283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64ead8-e11f-403d-ac33-f2f4e36d4832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.465570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64ead8-e11f-403d-ac33-f2f4e36d4832 admin admin] PATH_INFO: `/v3/users/c520ee45e9b54e9da2ec876b32ff22aa` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:38.467048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64ead8-e11f-403d-ac33-f2f4e36d4832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c520ee45e9b54e9da2ec876b32ff22aa)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:38.468950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64ead8-e11f-403d-ac33-f2f4e36d4832 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:38.479336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb8bc8-bb2e-420c-93a5-9009bb58ad8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3202efebd104790a34aa3ebde340870, user_id=8e36f4c097284dcfb5c6c8ae1c5de53a, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:38.482347 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb8bc8-bb2e-420c-93a5-9009bb58ad8b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:38.499787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1006/2012] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:38 2022] PUT /identity/v3/projects/a3202efebd104790a34aa3ebde340870/users/8e36f4c097284dcfb5c6c8ae1c5de53a/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:38.510985 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac13194-28ce-457e-ab4c-d9bfc0cdb5d1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.511288 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac13194-28ce-457e-ab4c-d9bfc0cdb5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.511552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac13194-28ce-457e-ab4c-d9bfc0cdb5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:38.533043 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-de64ead8-e11f-403d-ac33-f2f4e36d4832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c520ee45e9b54e9da2ec876b32ff22aa'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:38.540705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-eac13194-28ce-457e-ab4c-d9bfc0cdb5d1 None None] MFA Rules not processed for user `8e36f4c097284dcfb5c6c8ae1c5de53a`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:38.542011 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-eac13194-28ce-457e-ab4c-d9bfc0cdb5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:38.549202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-de64ead8-e11f-403d-ac33-f2f4e36d4832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c520ee45e9b54e9da2ec876b32ff22aa'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:38.561004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-de64ead8-e11f-403d-ac33-f2f4e36d4832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c520ee45e9b54e9da2ec876b32ff22aa'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:38.563963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:38.571616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-de64ead8-e11f-403d-ac33-f2f4e36d4832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c520ee45e9b54e9da2ec876b32ff22aa'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:38.572959 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-de64ead8-e11f-403d-ac33-f2f4e36d4832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c520ee45e9b54e9da2ec876b32ff22aa'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:38.582671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1007/2013] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:38 2022] DELETE /identity/v3/users/c520ee45e9b54e9da2ec876b32ff22aa => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:38.587186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7265d84-50fc-45ff-8a8c-daf233350572 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.587551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7265d84-50fc-45ff-8a8c-daf233350572 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.587888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7265d84-50fc-45ff-8a8c-daf233350572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:38.607549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c7265d84-50fc-45ff-8a8c-daf233350572 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:38.608867 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c7265d84-50fc-45ff-8a8c-daf233350572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:38.620404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1007/2014] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:38 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:38.625286 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac13194-28ce-457e-ab4c-d9bfc0cdb5d1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:38.626781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-eac13194-28ce-457e-ab4c-d9bfc0cdb5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:38.680594 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1008/2015] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:38.690290 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7265d84-50fc-45ff-8a8c-daf233350572 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:38.691746 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c7265d84-50fc-45ff-8a8c-daf233350572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:38.706140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac13194-28ce-457e-ab4c-d9bfc0cdb5d1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:38.714547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f680c-bbef-4f02-bda4-6c78dcc81609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:38.716019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f680c-bbef-4f02-bda4-6c78dcc81609 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.716505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f680c-bbef-4f02-bda4-6c78dcc81609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.717290 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f680c-bbef-4f02-bda4-6c78dcc81609 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:38.717856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f680c-bbef-4f02-bda4-6c78dcc81609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:38.721353 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f680c-bbef-4f02-bda4-6c78dcc81609 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:38.759943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1008/2016] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:38 2022] POST /identity/v3/projects => generated 409 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:38.761011 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f680c-bbef-4f02-bda4-6c78dcc81609 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:38.763475 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7265d84-50fc-45ff-8a8c-daf233350572 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:38.835441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:38.844160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f680c-bbef-4f02-bda4-6c78dcc81609 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:38.848380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61cb3b-7428-4b24-84b9-0a942d417fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:38.849020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61cb3b-7428-4b24-84b9-0a942d417fcb service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.849296 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61cb3b-7428-4b24-84b9-0a942d417fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.849568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61cb3b-7428-4b24-84b9-0a942d417fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:38.854481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccebb64-0ca3-4231-8a0b-b324dcebfe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:38.855159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccebb64-0ca3-4231-8a0b-b324dcebfe29 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.855436 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccebb64-0ca3-4231-8a0b-b324dcebfe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.855712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccebb64-0ca3-4231-8a0b-b324dcebfe29 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:38.856389 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccebb64-0ca3-4231-8a0b-b324dcebfe29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:38.858490 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccebb64-0ca3-4231-8a0b-b324dcebfe29 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:38.865700 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61cb3b-7428-4b24-84b9-0a942d417fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:38.868968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61cb3b-7428-4b24-84b9-0a942d417fcb service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:38.897426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1009/2017] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:03:38.905646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1009/2018] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:38 2022] POST /identity/v3/users => generated 311 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:38.907656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61cb3b-7428-4b24-84b9-0a942d417fcb service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:38.921226 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61cb3b-7428-4b24-84b9-0a942d417fcb service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:38.929753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252537f-b784-497c-9fe6-d822fa9e7607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:38.930438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252537f-b784-497c-9fe6-d822fa9e7607 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.930978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252537f-b784-497c-9fe6-d822fa9e7607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.931262 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252537f-b784-497c-9fe6-d822fa9e7607 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:38.931933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252537f-b784-497c-9fe6-d822fa9e7607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:38.934493 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252537f-b784-497c-9fe6-d822fa9e7607 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:38.958854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1010/2019] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:38.960134 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccebb64-0ca3-4231-8a0b-b324dcebfe29 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:38.973463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccebb64-0ca3-4231-8a0b-b324dcebfe29 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:38.981213 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd152c0d-5433-4442-b15a-ff85ffdf792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:38.981918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd152c0d-5433-4442-b15a-ff85ffdf792e admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:38.982492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd152c0d-5433-4442-b15a-ff85ffdf792e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:38.982492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd152c0d-5433-4442-b15a-ff85ffdf792e admin admin] PATH_INFO: `/v3/projects/1247f8c3fca5488aa05631fff022dc7d/users/e75de90b7ba64a27bdf7a9a84f33f161/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:39.005179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd152c0d-5433-4442-b15a-ff85ffdf792e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1247f8c3fca5488aa05631fff022dc7d, user_id=e75de90b7ba64a27bdf7a9a84f33f161, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:39.008052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd152c0d-5433-4442-b15a-ff85ffdf792e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:39.029845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1010/2020] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:38 2022] PUT /identity/v3/projects/1247f8c3fca5488aa05631fff022dc7d/users/e75de90b7ba64a27bdf7a9a84f33f161/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:39.034635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252537f-b784-497c-9fe6-d822fa9e7607 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:39.047864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252537f-b784-497c-9fe6-d822fa9e7607 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:39.096826 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:39.119645 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886f323-87ad-498c-8530-c1c6122a3b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:39.120331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886f323-87ad-498c-8530-c1c6122a3b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:39.120622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886f323-87ad-498c-8530-c1c6122a3b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:39.120925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886f323-87ad-498c-8530-c1c6122a3b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:39.122095 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886f323-87ad-498c-8530-c1c6122a3b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:39.123189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886f323-87ad-498c-8530-c1c6122a3b7e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:39.138231 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1011/2021] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:39.139441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd152c0d-5433-4442-b15a-ff85ffdf792e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:39.155102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd152c0d-5433-4442-b15a-ff85ffdf792e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:39.160933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c12f2d-9586-465a-87a4-07211c8df9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:39.161622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c12f2d-9586-465a-87a4-07211c8df9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:39.161896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c12f2d-9586-465a-87a4-07211c8df9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:39.162163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c12f2d-9586-465a-87a4-07211c8df9ae admin admin] PATH_INFO: `/v3/projects/1247f8c3fca5488aa05631fff022dc7d/users/e75de90b7ba64a27bdf7a9a84f33f161/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:39.164566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c12f2d-9586-465a-87a4-07211c8df9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1247f8c3fca5488aa05631fff022dc7d, user_id=e75de90b7ba64a27bdf7a9a84f33f161, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:39.168048 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c12f2d-9586-465a-87a4-07211c8df9ae admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:39.183180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1011/2022] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:39 2022] PUT /identity/v3/projects/1247f8c3fca5488aa05631fff022dc7d/users/e75de90b7ba64a27bdf7a9a84f33f161/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:39.195138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0578048-6460-45d1-a0b9-e7082e81bdf0 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:39.195680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0578048-6460-45d1-a0b9-e7082e81bdf0 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:39.195844 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0578048-6460-45d1-a0b9-e7082e81bdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:39.233857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-d0578048-6460-45d1-a0b9-e7082e81bdf0 None None] MFA Rules not processed for user `e75de90b7ba64a27bdf7a9a84f33f161`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:39.235414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d0578048-6460-45d1-a0b9-e7082e81bdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:39.334148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1012/2023] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:39 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:39.345571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c12f2d-9586-465a-87a4-07211c8df9ae admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:39.348751 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-96c12f2d-9586-465a-87a4-07211c8df9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:39.403690 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0578048-6460-45d1-a0b9-e7082e81bdf0 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:39.408678 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d0578048-6460-45d1-a0b9-e7082e81bdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:39.444997 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c12f2d-9586-465a-87a4-07211c8df9ae admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:39.453737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85851102-460a-4ffe-b081-7a5fe23fcc8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:39.454418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85851102-460a-4ffe-b081-7a5fe23fcc8c service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:39.455226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85851102-460a-4ffe-b081-7a5fe23fcc8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:39.455904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85851102-460a-4ffe-b081-7a5fe23fcc8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:39.469864 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85851102-460a-4ffe-b081-7a5fe23fcc8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:39.471778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85851102-460a-4ffe-b081-7a5fe23fcc8c service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:39.511177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1012/2024] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:39 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:39.520211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0578048-6460-45d1-a0b9-e7082e81bdf0 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:39.534738 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:39.537425 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:39.537792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:39.537965 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] PATH_INFO: `/v3/projects/33779b761f50481a86041cdc1952b7f2` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:39.540071 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33779b761f50481a86041cdc1952b7f2)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:39.547207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:39.678082 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33779b761f50481a86041cdc1952b7f2', 'request_id': 'req-cf74a4a9-11ce-4245-b147-92b604e64cf6'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:39.690096 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33779b761f50481a86041cdc1952b7f2', 'request_id': 'req-cf74a4a9-11ce-4245-b147-92b604e64cf6'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:39.716353 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33779b761f50481a86041cdc1952b7f2', 'request_id': 'req-cf74a4a9-11ce-4245-b147-92b604e64cf6'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:39.722546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:39.737235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] The token cache is being invalidate because project 33779b761f50481a86041cdc1952b7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:39.737736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:39.738789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:39.740479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1013/2025] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:39 2022] DELETE /identity/v3/projects/33779b761f50481a86041cdc1952b7f2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:39.746116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a828589-6745-4677-a2b0-5f0b52c955db None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:39.746116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a828589-6745-4677-a2b0-5f0b52c955db None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:39.746543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a828589-6745-4677-a2b0-5f0b52c955db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:39.780574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9a828589-6745-4677-a2b0-5f0b52c955db None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:39.781965 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9a828589-6745-4677-a2b0-5f0b52c955db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:39.791788 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:39.793640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:39.892519 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74a4a9-11ce-4245-b147-92b604e64cf6 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:39.896649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1013/2026] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:39.897003 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95294-82f2-4aa8-b7c9-036ba9fa01fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:39.898067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95294-82f2-4aa8-b7c9-036ba9fa01fb service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:39.898531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95294-82f2-4aa8-b7c9-036ba9fa01fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:39.898919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95294-82f2-4aa8-b7c9-036ba9fa01fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:39.900819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-63c95294-82f2-4aa8-b7c9-036ba9fa01fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:39.905726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4350bd-66f2-4da4-a182-357872c253f8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:39.906247 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4350bd-66f2-4da4-a182-357872c253f8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:39.906953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4350bd-66f2-4da4-a182-357872c253f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:39.933591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6d4350bd-66f2-4da4-a182-357872c253f8 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:39.935145 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6d4350bd-66f2-4da4-a182-357872c253f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:39.950481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1014/2027] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:39.955844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4350bd-66f2-4da4-a182-357872c253f8 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:39.971645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4350bd-66f2-4da4-a182-357872c253f8 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:39.977116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781d147-250b-42fd-8eb4-38746217cdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:39.977747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781d147-250b-42fd-8eb4-38746217cdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:39.978089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781d147-250b-42fd-8eb4-38746217cdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:39.978365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781d147-250b-42fd-8eb4-38746217cdf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:39.980568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781d147-250b-42fd-8eb4-38746217cdf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:39.980568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781d147-250b-42fd-8eb4-38746217cdf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:39.982495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781d147-250b-42fd-8eb4-38746217cdf6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:39.983692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c95294-82f2-4aa8-b7c9-036ba9fa01fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:39.986844 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c95294-82f2-4aa8-b7c9-036ba9fa01fb service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:39.998273 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1015/2028] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:03:39.999530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1014/2029] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:39 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:40.002823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781d147-250b-42fd-8eb4-38746217cdf6 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:40.019085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781d147-250b-42fd-8eb4-38746217cdf6 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:40.027677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3fe9f-0c84-4c8c-9b81-5b86bdf32cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:40.028308 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3fe9f-0c84-4c8c-9b81-5b86bdf32cef admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:40.028651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3fe9f-0c84-4c8c-9b81-5b86bdf32cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:40.028934 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3fe9f-0c84-4c8c-9b81-5b86bdf32cef admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:40.029565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3fe9f-0c84-4c8c-9b81-5b86bdf32cef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:40.031659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3fe9f-0c84-4c8c-9b81-5b86bdf32cef admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:40.074941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1016/2030] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:40 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:40.079184 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95294-82f2-4aa8-b7c9-036ba9fa01fb service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:40.095800 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95294-82f2-4aa8-b7c9-036ba9fa01fb service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:40.215782 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c469f4-526f-42a9-aa14-a75f6bcc54a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:40.217378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c469f4-526f-42a9-aa14-a75f6bcc54a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:40.217378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c469f4-526f-42a9-aa14-a75f6bcc54a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:40.217657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c469f4-526f-42a9-aa14-a75f6bcc54a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:40.218399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c469f4-526f-42a9-aa14-a75f6bcc54a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:40.221050 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c469f4-526f-42a9-aa14-a75f6bcc54a5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:40.261333 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1015/2031] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:40 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:40.265515 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3fe9f-0c84-4c8c-9b81-5b86bdf32cef admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:40.282079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3fe9f-0c84-4c8c-9b81-5b86bdf32cef admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:40.288325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ad0c2-86e5-4ba9-aeee-1216f53cb852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:40.288719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ad0c2-86e5-4ba9-aeee-1216f53cb852 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:40.288983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ad0c2-86e5-4ba9-aeee-1216f53cb852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:40.289256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ad0c2-86e5-4ba9-aeee-1216f53cb852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:40.289922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ad0c2-86e5-4ba9-aeee-1216f53cb852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:40.291572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ad0c2-86e5-4ba9-aeee-1216f53cb852 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:40.294047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:40.304507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1017/2032] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:40.308302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c469f4-526f-42a9-aa14-a75f6bcc54a5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:40.319700 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c469f4-526f-42a9-aa14-a75f6bcc54a5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:40.326461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5c907-a778-4a37-8995-d4dd3c30e94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:40.327056 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5c907-a778-4a37-8995-d4dd3c30e94e admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:40.327341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5c907-a778-4a37-8995-d4dd3c30e94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:40.327609 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5c907-a778-4a37-8995-d4dd3c30e94e admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:40.328318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5c907-a778-4a37-8995-d4dd3c30e94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:40.329948 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5c907-a778-4a37-8995-d4dd3c30e94e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:40.346923 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1016/2033] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:40.349184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ad0c2-86e5-4ba9-aeee-1216f53cb852 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:40.362261 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ad0c2-86e5-4ba9-aeee-1216f53cb852 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:40.368212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e1414-c933-4045-a6a2-ac30c977d48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:40.368939 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e1414-c933-4045-a6a2-ac30c977d48e admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:40.369223 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e1414-c933-4045-a6a2-ac30c977d48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:40.369528 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e1414-c933-4045-a6a2-ac30c977d48e admin admin] PATH_INFO: `/v3/projects/b7040cdda0a648c69e57fef7e46f3ca0/users/1667ccf68d7a4747a21e2f54e23fd58c/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:40.388478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e1414-c933-4045-a6a2-ac30c977d48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7040cdda0a648c69e57fef7e46f3ca0, user_id=1667ccf68d7a4747a21e2f54e23fd58c, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:40.401892 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e1414-c933-4045-a6a2-ac30c977d48e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:40.419750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1018/2034] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:40 2022] PUT /identity/v3/projects/b7040cdda0a648c69e57fef7e46f3ca0/users/1667ccf68d7a4747a21e2f54e23fd58c/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:40.429926 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd8d43-3d83-4316-af86-8ca64c82fce4 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:40.430212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd8d43-3d83-4316-af86-8ca64c82fce4 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:40.430488 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd8d43-3d83-4316-af86-8ca64c82fce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:40.469309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-8dcd8d43-3d83-4316-af86-8ca64c82fce4 None None] MFA Rules not processed for user `1667ccf68d7a4747a21e2f54e23fd58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:40.470639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8dcd8d43-3d83-4316-af86-8ca64c82fce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:40.487477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:40.592335 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1017/2035] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:40.604904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e1414-c933-4045-a6a2-ac30c977d48e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:40.682920 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e1414-c933-4045-a6a2-ac30c977d48e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:40.687111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8040a4-f162-47df-9610-826aeaae30bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:40.687805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8040a4-f162-47df-9610-826aeaae30bf service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:40.688019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8040a4-f162-47df-9610-826aeaae30bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:40.688547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8040a4-f162-47df-9610-826aeaae30bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:40.701176 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8040a4-f162-47df-9610-826aeaae30bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:40.703392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8040a4-f162-47df-9610-826aeaae30bf service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:40.716228 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1019/2036] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:40.743644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd8d43-3d83-4316-af86-8ca64c82fce4 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:40.809271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8040a4-f162-47df-9610-826aeaae30bf service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:40.810898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9b8040a4-f162-47df-9610-826aeaae30bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:40.835702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd8d43-3d83-4316-af86-8ca64c82fce4 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:40.842111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eb2d4-2a0f-45d0-bf5a-7303ae447bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:40.843006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb2d4-2a0f-45d0-bf5a-7303ae447bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:40.843270 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb2d4-2a0f-45d0-bf5a-7303ae447bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:40.843544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb2d4-2a0f-45d0-bf5a-7303ae447bdf admin admin] PATH_INFO: `/v3/users/1667ccf68d7a4747a21e2f54e23fd58c` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:40.845034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eb2d4-2a0f-45d0-bf5a-7303ae447bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1667ccf68d7a4747a21e2f54e23fd58c)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:40.849048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eb2d4-2a0f-45d0-bf5a-7303ae447bdf admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:40.916912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a75eb2d4-2a0f-45d0-bf5a-7303ae447bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1667ccf68d7a4747a21e2f54e23fd58c'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:40.927620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8040a4-f162-47df-9610-826aeaae30bf service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:40.931718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a75eb2d4-2a0f-45d0-bf5a-7303ae447bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1667ccf68d7a4747a21e2f54e23fd58c'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:40.934982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da1335-0fb1-497a-a594-601722ac80e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:40.936593 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da1335-0fb1-497a-a594-601722ac80e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:40.936877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da1335-0fb1-497a-a594-601722ac80e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:40.937235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da1335-0fb1-497a-a594-601722ac80e4 admin admin] PATH_INFO: `/v3/users/1b50ca44d7c8424693c136e5104a0e02` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:40.939175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da1335-0fb1-497a-a594-601722ac80e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b50ca44d7c8424693c136e5104a0e02)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:40.941704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da1335-0fb1-497a-a594-601722ac80e4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:40.941870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a75eb2d4-2a0f-45d0-bf5a-7303ae447bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1667ccf68d7a4747a21e2f54e23fd58c'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:40.951607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a75eb2d4-2a0f-45d0-bf5a-7303ae447bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1667ccf68d7a4747a21e2f54e23fd58c'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:40.952573 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a75eb2d4-2a0f-45d0-bf5a-7303ae447bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1667ccf68d7a4747a21e2f54e23fd58c'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:40.963776 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1018/2037] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:40 2022] DELETE /identity/v3/users/1667ccf68d7a4747a21e2f54e23fd58c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:40.965276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522f91-124c-4669-8da2-b966020ecc3a None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:40.965570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522f91-124c-4669-8da2-b966020ecc3a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:40.965848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd522f91-124c-4669-8da2-b966020ecc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:40.999335 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-bd522f91-124c-4669-8da2-b966020ecc3a None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:41.000909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bd522f91-124c-4669-8da2-b966020ecc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:41.014635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-10da1335-0fb1-497a-a594-601722ac80e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b50ca44d7c8424693c136e5104a0e02'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.015495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-10da1335-0fb1-497a-a594-601722ac80e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b50ca44d7c8424693c136e5104a0e02'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.016379 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-10da1335-0fb1-497a-a594-601722ac80e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b50ca44d7c8424693c136e5104a0e02'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.026850 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-10da1335-0fb1-497a-a594-601722ac80e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b50ca44d7c8424693c136e5104a0e02'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.042863 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-10da1335-0fb1-497a-a594-601722ac80e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b50ca44d7c8424693c136e5104a0e02'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:41.046204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:41.059767 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:41.069413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1020/2038] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:40 2022] DELETE /identity/v3/users/1b50ca44d7c8424693c136e5104a0e02 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:41.076489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425168b2-d7ce-4f00-b832-7016978896f5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:41.077795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425168b2-d7ce-4f00-b832-7016978896f5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:41.078587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425168b2-d7ce-4f00-b832-7016978896f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:41.102781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-425168b2-d7ce-4f00-b832-7016978896f5 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:41.104239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-425168b2-d7ce-4f00-b832-7016978896f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:41.120310 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1019/2039] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:41.137787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd522f91-124c-4669-8da2-b966020ecc3a None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:41.141042 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bd522f91-124c-4669-8da2-b966020ecc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:41.241214 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1021/2040] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:41.246331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd522f91-124c-4669-8da2-b966020ecc3a None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:41.252110 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425168b2-d7ce-4f00-b832-7016978896f5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:41.314229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943e8db-2326-49b2-a61c-ab426f829997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:41.314900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943e8db-2326-49b2-a61c-ab426f829997 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:41.315180 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943e8db-2326-49b2-a61c-ab426f829997 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:41.315449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943e8db-2326-49b2-a61c-ab426f829997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:41.328012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943e8db-2326-49b2-a61c-ab426f829997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:41.329342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943e8db-2326-49b2-a61c-ab426f829997 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:41.340252 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1020/2041] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:41.353656 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425168b2-d7ce-4f00-b832-7016978896f5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:41.357671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da03ac-5f51-4037-a941-05be1a2f029c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:41.358995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da03ac-5f51-4037-a941-05be1a2f029c service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:41.359287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da03ac-5f51-4037-a941-05be1a2f029c service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:41.359562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da03ac-5f51-4037-a941-05be1a2f029c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:41.373738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da03ac-5f51-4037-a941-05be1a2f029c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:41.375446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da03ac-5f51-4037-a941-05be1a2f029c service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:41.389588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1022/2042] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:41.933754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943e8db-2326-49b2-a61c-ab426f829997 service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:41.936049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f943e8db-2326-49b2-a61c-ab426f829997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:41.953991 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943e8db-2326-49b2-a61c-ab426f829997 service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:41.963896 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dfaea-fbc9-4b2c-9881-45a5f736df3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:41.964755 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dfaea-fbc9-4b2c-9881-45a5f736df3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:41.965079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dfaea-fbc9-4b2c-9881-45a5f736df3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:41.965673 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dfaea-fbc9-4b2c-9881-45a5f736df3e admin admin] PATH_INFO: `/v3/projects/b7040cdda0a648c69e57fef7e46f3ca0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:41.972502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dfaea-fbc9-4b2c-9881-45a5f736df3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7040cdda0a648c69e57fef7e46f3ca0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:41.982525 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dfaea-fbc9-4b2c-9881-45a5f736df3e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:42.046749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da03ac-5f51-4037-a941-05be1a2f029c service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:42.048186 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-39da03ac-5f51-4037-a941-05be1a2f029c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:42.073384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da03ac-5f51-4037-a941-05be1a2f029c service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:42.083505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:42.084337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.084713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.085068 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f admin admin] PATH_INFO: `/v3/projects/501f573d35ea40fe9f9f9d4ab9843a0c` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.086943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=501f573d35ea40fe9f9f9d4ab9843a0c)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:42.089234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:42.131889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-864dfaea-fbc9-4b2c-9881-45a5f736df3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7040cdda0a648c69e57fef7e46f3ca0', 'request_id': 'req-864dfaea-fbc9-4b2c-9881-45a5f736df3e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.145639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-864dfaea-fbc9-4b2c-9881-45a5f736df3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7040cdda0a648c69e57fef7e46f3ca0', 'request_id': 'req-864dfaea-fbc9-4b2c-9881-45a5f736df3e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.160520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-864dfaea-fbc9-4b2c-9881-45a5f736df3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7040cdda0a648c69e57fef7e46f3ca0', 'request_id': 'req-864dfaea-fbc9-4b2c-9881-45a5f736df3e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.177293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-864dfaea-fbc9-4b2c-9881-45a5f736df3e admin admin] The token cache is being invalidate because project b7040cdda0a648c69e57fef7e46f3ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:42.177625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-864dfaea-fbc9-4b2c-9881-45a5f736df3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.178561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-864dfaea-fbc9-4b2c-9881-45a5f736df3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.180383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1021/2043] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:41 2022] DELETE /identity/v3/projects/b7040cdda0a648c69e57fef7e46f3ca0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:42.184465 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dbc29-f0fd-4625-89d1-49aedfa895f7 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.184762 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dbc29-f0fd-4625-89d1-49aedfa895f7 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.185227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6dbc29-f0fd-4625-89d1-49aedfa895f7 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.187467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1022/2044] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 22 16:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:03:42.188901 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928b42-04e4-48ec-94f0-00242fa8a7b7 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.189245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928b42-04e4-48ec-94f0-00242fa8a7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.189521 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501f573d35ea40fe9f9f9d4ab9843a0c', 'request_id': 'req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.189627 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928b42-04e4-48ec-94f0-00242fa8a7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.202661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501f573d35ea40fe9f9f9d4ab9843a0c', 'request_id': 'req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.216998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501f573d35ea40fe9f9f9d4ab9843a0c', 'request_id': 'req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.222109 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-2f928b42-04e4-48ec-94f0-00242fa8a7b7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:42.223317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-2f928b42-04e4-48ec-94f0-00242fa8a7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:42.235000 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:42.238980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f admin admin] The token cache is being invalidate because project 501f573d35ea40fe9f9f9d4ab9843a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:42.239666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.240755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-44e3998f-54fe-4990-b5bc-dfbdcbcc4b7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.246001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1023/2045] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:42 2022] DELETE /identity/v3/projects/501f573d35ea40fe9f9f9d4ab9843a0c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:42.252946 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76680b04-5b5b-454e-b22a-ed55b4af6677 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.252946 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76680b04-5b5b-454e-b22a-ed55b4af6677 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.252946 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76680b04-5b5b-454e-b22a-ed55b4af6677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.286528 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-76680b04-5b5b-454e-b22a-ed55b4af6677 None None] MFA Rules not processed for user `4be9a664d10d438382b9e359b26ba86e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:42.287988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-76680b04-5b5b-454e-b22a-ed55b4af6677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:42.334049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1023/2046] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:42.335401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f928b42-04e4-48ec-94f0-00242fa8a7b7 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:42.343898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-2f928b42-04e4-48ec-94f0-00242fa8a7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:42.353419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:42.375407 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f928b42-04e4-48ec-94f0-00242fa8a7b7 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:42.389980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991782fa-e8f5-4466-b080-e6639b48dda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:42.390812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991782fa-e8f5-4466-b080-e6639b48dda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.395261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991782fa-e8f5-4466-b080-e6639b48dda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.395596 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991782fa-e8f5-4466-b080-e6639b48dda5 admin admin] PATH_INFO: `/v3/users/db86ab7998c64e429c838a9fe7d9144d` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.396927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991782fa-e8f5-4466-b080-e6639b48dda5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db86ab7998c64e429c838a9fe7d9144d)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:42.399026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991782fa-e8f5-4466-b080-e6639b48dda5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:42.449334 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1024/2047] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 22 16:03:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:42.450430 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76680b04-5b5b-454e-b22a-ed55b4af6677 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:42.452131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-76680b04-5b5b-454e-b22a-ed55b4af6677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:42.456416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-991782fa-e8f5-4466-b080-e6639b48dda5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db86ab7998c64e429c838a9fe7d9144d'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.467892 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76680b04-5b5b-454e-b22a-ed55b4af6677 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:42.469138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-991782fa-e8f5-4466-b080-e6639b48dda5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db86ab7998c64e429c838a9fe7d9144d'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.475000 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77cc90-b103-43ea-a82c-6674c8a93d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:42.475661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77cc90-b103-43ea-a82c-6674c8a93d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.476019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77cc90-b103-43ea-a82c-6674c8a93d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.476301 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77cc90-b103-43ea-a82c-6674c8a93d37 admin admin] PATH_INFO: `/v3/users/8d9a3c6d32dc495a8b9fdd85f8e54c13` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.477570 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77cc90-b103-43ea-a82c-6674c8a93d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9a3c6d32dc495a8b9fdd85f8e54c13)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:42.478791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-991782fa-e8f5-4466-b080-e6639b48dda5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db86ab7998c64e429c838a9fe7d9144d'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.479669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77cc90-b103-43ea-a82c-6674c8a93d37 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:42.487178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-991782fa-e8f5-4466-b080-e6639b48dda5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db86ab7998c64e429c838a9fe7d9144d'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.487970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-991782fa-e8f5-4466-b080-e6639b48dda5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db86ab7998c64e429c838a9fe7d9144d'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.494373 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1024/2048] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:42 2022] DELETE /identity/v3/users/db86ab7998c64e429c838a9fe7d9144d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:42.495650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d7ee5-f636-43ab-843f-57e22d48d259 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.495937 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d7ee5-f636-43ab-843f-57e22d48d259 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.496213 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d7ee5-f636-43ab-843f-57e22d48d259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.520577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-aa1d7ee5-f636-43ab-843f-57e22d48d259 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:42.522860 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-aa1d7ee5-f636-43ab-843f-57e22d48d259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:42.546151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b77cc90-b103-43ea-a82c-6674c8a93d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9a3c6d32dc495a8b9fdd85f8e54c13'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.547395 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b77cc90-b103-43ea-a82c-6674c8a93d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9a3c6d32dc495a8b9fdd85f8e54c13'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.548106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b77cc90-b103-43ea-a82c-6674c8a93d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9a3c6d32dc495a8b9fdd85f8e54c13'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.558355 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b77cc90-b103-43ea-a82c-6674c8a93d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9a3c6d32dc495a8b9fdd85f8e54c13'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.567096 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b77cc90-b103-43ea-a82c-6674c8a93d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9a3c6d32dc495a8b9fdd85f8e54c13'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.592941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1025/2049] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:42 2022] DELETE /identity/v3/users/8d9a3c6d32dc495a8b9fdd85f8e54c13 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:42.593846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77cc90-b103-43ea-a82c-6674c8a93d37 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:42.595389 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6b77cc90-b103-43ea-a82c-6674c8a93d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:42.624381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1025/2050] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:42.628104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d7ee5-f636-43ab-843f-57e22d48d259 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:42.647453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d7ee5-f636-43ab-843f-57e22d48d259 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:42.689158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:42.735483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77cc90-b103-43ea-a82c-6674c8a93d37 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:42.747052 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d9402-df45-4168-897f-ecf79c45ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:42.748038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d9402-df45-4168-897f-ecf79c45ea47 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.748393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d9402-df45-4168-897f-ecf79c45ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.748780 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d9402-df45-4168-897f-ecf79c45ea47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.749710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d9402-df45-4168-897f-ecf79c45ea47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:42.750099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d9402-df45-4168-897f-ecf79c45ea47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:42.752092 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d9402-df45-4168-897f-ecf79c45ea47 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:42.753059 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d228d3-2ba5-4273-b54a-63ff11a00b08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be9a664d10d438382b9e359b26ba86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:42.755868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d228d3-2ba5-4273-b54a-63ff11a00b08 service placement] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.756382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d228d3-2ba5-4273-b54a-63ff11a00b08 service placement] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.757394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d228d3-2ba5-4273-b54a-63ff11a00b08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.759566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f2d228d3-2ba5-4273-b54a-63ff11a00b08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:42.770748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1026/2051] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:03:42.774563 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d9402-df45-4168-897f-ecf79c45ea47 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:42.777628 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d228d3-2ba5-4273-b54a-63ff11a00b08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:42.779324 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d228d3-2ba5-4273-b54a-63ff11a00b08 service placement] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:42.793092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1026/2052] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:42.793545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d9402-df45-4168-897f-ecf79c45ea47 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:42.798479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b8644-685e-4598-a747-03beb68896a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:42.799236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b8644-685e-4598-a747-03beb68896a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.800668 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b8644-685e-4598-a747-03beb68896a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.801532 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b8644-685e-4598-a747-03beb68896a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.802317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b8644-685e-4598-a747-03beb68896a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:42.802815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d228d3-2ba5-4273-b54a-63ff11a00b08 service placement] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:42.804474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f2d228d3-2ba5-4273-b54a-63ff11a00b08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:42.804995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b8644-685e-4598-a747-03beb68896a5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:42.820333 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d228d3-2ba5-4273-b54a-63ff11a00b08 service placement] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:42.838465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:42.839426 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.840369 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.840743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] PATH_INFO: `/v3/projects/aaa7c50a452d415d9086b4e26636bbe4` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:42.842464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa7c50a452d415d9086b4e26636bbe4)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:42.844919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:42.860695 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1027/2053] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:42 2022] POST /identity/v3/projects => generated 391 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:42.861893 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b8644-685e-4598-a747-03beb68896a5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:42.864282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-149b8644-685e-4598-a747-03beb68896a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:42.875373 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:42.912970 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa7c50a452d415d9086b4e26636bbe4', 'request_id': 'req-adaf3335-857b-41a0-9aa6-88d8f916f157'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.919886 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa7c50a452d415d9086b4e26636bbe4', 'request_id': 'req-adaf3335-857b-41a0-9aa6-88d8f916f157'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.928676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa7c50a452d415d9086b4e26636bbe4', 'request_id': 'req-adaf3335-857b-41a0-9aa6-88d8f916f157'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.939835 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b8644-685e-4598-a747-03beb68896a5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:42.947377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] The token cache is being invalidate because project aaa7c50a452d415d9086b4e26636bbe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:42.947673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.948775 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:42.954769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1027/2054] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:42 2022] DELETE /identity/v3/projects/aaa7c50a452d415d9086b4e26636bbe4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:42.954769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:42.954769 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:42.998589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:42.999250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:42.999570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:42.999878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] PATH_INFO: `/v3/projects/f1907cb7451b48c687eb83730969eb89` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.001272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1907cb7451b48c687eb83730969eb89)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.004899 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.029529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf3335-857b-41a0-9aa6-88d8f916f157 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.035088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55e12c-d896-4853-8d87-4a31f0194d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.035829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55e12c-d896-4853-8d87-4a31f0194d62 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.036054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55e12c-d896-4853-8d87-4a31f0194d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.036329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55e12c-d896-4853-8d87-4a31f0194d62 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.036962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55e12c-d896-4853-8d87-4a31f0194d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.039026 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55e12c-d896-4853-8d87-4a31f0194d62 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.068014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1028/2055] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:42 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:43.069857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85617c14-cdd7-463e-8751-15a52fa01c0d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.070139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85617c14-cdd7-463e-8751-15a52fa01c0d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.070410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85617c14-cdd7-463e-8751-15a52fa01c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.072154 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1907cb7451b48c687eb83730969eb89', 'request_id': 'req-02d43644-1501-484a-9767-e5a774eade2b'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.074341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:43.083554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1907cb7451b48c687eb83730969eb89', 'request_id': 'req-02d43644-1501-484a-9767-e5a774eade2b'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.093309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1907cb7451b48c687eb83730969eb89', 'request_id': 'req-02d43644-1501-484a-9767-e5a774eade2b'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.097300 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-85617c14-cdd7-463e-8751-15a52fa01c0d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:43.098619 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-85617c14-cdd7-463e-8751-15a52fa01c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:43.106467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] The token cache is being invalidate because project f1907cb7451b48c687eb83730969eb89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:43.106948 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.108048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.109844 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1028/2056] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:42 2022] DELETE /identity/v3/projects/f1907cb7451b48c687eb83730969eb89 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:43.111218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.112438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:43.188155 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1029/2057] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:43.188155 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85617c14-cdd7-463e-8751-15a52fa01c0d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.188155 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-85617c14-cdd7-463e-8751-15a52fa01c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:43.197676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85617c14-cdd7-463e-8751-15a52fa01c0d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.207047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d43644-1501-484a-9767-e5a774eade2b admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.210450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd15499-a107-40e2-b425-17389720839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.211578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd15499-a107-40e2-b425-17389720839c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.212092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd15499-a107-40e2-b425-17389720839c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.212194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29309ee4-997a-4227-b366-134e5397be3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.212578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd15499-a107-40e2-b425-17389720839c admin admin] PATH_INFO: `/v3/users/289a16e9cf5a443ebcb3c0796d022799` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.212766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29309ee4-997a-4227-b366-134e5397be3f admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.213047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29309ee4-997a-4227-b366-134e5397be3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.213353 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29309ee4-997a-4227-b366-134e5397be3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.214017 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29309ee4-997a-4227-b366-134e5397be3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.214296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd15499-a107-40e2-b425-17389720839c admin admin] RBAC: Authorizing `identity:delete_user(user_id=289a16e9cf5a443ebcb3c0796d022799)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.215674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29309ee4-997a-4227-b366-134e5397be3f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.216292 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd15499-a107-40e2-b425-17389720839c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.237271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1029/2058] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:43.237271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b764-5a37-4cc5-9d21-8e679b634d30 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.238942 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b764-5a37-4cc5-9d21-8e679b634d30 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.239150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b764-5a37-4cc5-9d21-8e679b634d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.255760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:43.260128 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-de25b764-5a37-4cc5-9d21-8e679b634d30 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:43.261531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-de25b764-5a37-4cc5-9d21-8e679b634d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:43.270116 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1030/2059] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:43.271198 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25b764-5a37-4cc5-9d21-8e679b634d30 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.278683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-abd15499-a107-40e2-b425-17389720839c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289a16e9cf5a443ebcb3c0796d022799'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.279805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-abd15499-a107-40e2-b425-17389720839c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289a16e9cf5a443ebcb3c0796d022799'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.280422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-abd15499-a107-40e2-b425-17389720839c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289a16e9cf5a443ebcb3c0796d022799'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.281658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25b764-5a37-4cc5-9d21-8e679b634d30 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.288552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-abd15499-a107-40e2-b425-17389720839c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289a16e9cf5a443ebcb3c0796d022799'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.290155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232885d-aded-4c7e-b1bc-f2a78350dfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.290875 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232885d-aded-4c7e-b1bc-f2a78350dfad admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.291246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232885d-aded-4c7e-b1bc-f2a78350dfad admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.291563 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232885d-aded-4c7e-b1bc-f2a78350dfad admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.292224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232885d-aded-4c7e-b1bc-f2a78350dfad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.294040 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232885d-aded-4c7e-b1bc-f2a78350dfad admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.299759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-abd15499-a107-40e2-b425-17389720839c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289a16e9cf5a443ebcb3c0796d022799'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.306711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1031/2060] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:43.307291 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232885d-aded-4c7e-b1bc-f2a78350dfad admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.309392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a232885d-aded-4c7e-b1bc-f2a78350dfad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:43.321740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1030/2061] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:43 2022] DELETE /identity/v3/users/289a16e9cf5a443ebcb3c0796d022799 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:43.322659 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd15499-a107-40e2-b425-17389720839c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.324436 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-abd15499-a107-40e2-b425-17389720839c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:43.324547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232885d-aded-4c7e-b1bc-f2a78350dfad admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.408462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f637be-6138-4830-89ee-82ab1b26641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.409592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f637be-6138-4830-89ee-82ab1b26641f admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.410117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f637be-6138-4830-89ee-82ab1b26641f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.410584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f637be-6138-4830-89ee-82ab1b26641f admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.412165 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f637be-6138-4830-89ee-82ab1b26641f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:43.415026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f637be-6138-4830-89ee-82ab1b26641f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.416883 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f637be-6138-4830-89ee-82ab1b26641f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.426758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd15499-a107-40e2-b425-17389720839c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.431881 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6f479-7fcd-4fc8-a612-144720635536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.435721 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6f479-7fcd-4fc8-a612-144720635536 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.435721 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6f479-7fcd-4fc8-a612-144720635536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.435721 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6f479-7fcd-4fc8-a612-144720635536 admin admin] PATH_INFO: `/v3/projects/99b27b5e28004d74bee9e633b775061b/users/3c67f6ef99b74499af255d527f6bbe9f/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.442005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1032/2062] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:43.446552 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f637be-6138-4830-89ee-82ab1b26641f admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.466000 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6f479-7fcd-4fc8-a612-144720635536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b27b5e28004d74bee9e633b775061b, user_id=3c67f6ef99b74499af255d527f6bbe9f, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.467824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f637be-6138-4830-89ee-82ab1b26641f admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.472374 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6f479-7fcd-4fc8-a612-144720635536 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.481674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b6c75-ecd6-42cd-96f4-71e1e5f39a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.487032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b6c75-ecd6-42cd-96f4-71e1e5f39a35 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.488204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b6c75-ecd6-42cd-96f4-71e1e5f39a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.488553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b6c75-ecd6-42cd-96f4-71e1e5f39a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.489677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b6c75-ecd6-42cd-96f4-71e1e5f39a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.491020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1031/2063] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:43 2022] PUT /identity/v3/projects/99b27b5e28004d74bee9e633b775061b/users/3c67f6ef99b74499af255d527f6bbe9f/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:43.495143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b6c75-ecd6-42cd-96f4-71e1e5f39a35 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.502386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58887e06-158c-447d-a877-eb380df60fca None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.503562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58887e06-158c-447d-a877-eb380df60fca None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.503941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58887e06-158c-447d-a877-eb380df60fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.539768 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1033/2064] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:43 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:43.544097 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b6c75-ecd6-42cd-96f4-71e1e5f39a35 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.580212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:43.580727 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-58887e06-158c-447d-a877-eb380df60fca None None] MFA Rules not processed for user `3c67f6ef99b74499af255d527f6bbe9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:43.582484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-58887e06-158c-447d-a877-eb380df60fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:43.648534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b6c75-ecd6-42cd-96f4-71e1e5f39a35 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.655379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18b3c0-6b80-4d24-8a02-4b1d52d74e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.656483 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18b3c0-6b80-4d24-8a02-4b1d52d74e7d admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.656891 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18b3c0-6b80-4d24-8a02-4b1d52d74e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.657477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18b3c0-6b80-4d24-8a02-4b1d52d74e7d admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.658348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18b3c0-6b80-4d24-8a02-4b1d52d74e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.662917 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18b3c0-6b80-4d24-8a02-4b1d52d74e7d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.701132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1034/2065] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:43 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:43.708168 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18b3c0-6b80-4d24-8a02-4b1d52d74e7d admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.744138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1032/2066] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:43.748398 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18b3c0-6b80-4d24-8a02-4b1d52d74e7d admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.755644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b2174-e5a5-4c06-899d-f6dbe1d9dd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.756501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b2174-e5a5-4c06-899d-f6dbe1d9dd90 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.756783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b2174-e5a5-4c06-899d-f6dbe1d9dd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.757174 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b2174-e5a5-4c06-899d-f6dbe1d9dd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.758626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b2174-e5a5-4c06-899d-f6dbe1d9dd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.760749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b2174-e5a5-4c06-899d-f6dbe1d9dd90 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.765653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58887e06-158c-447d-a877-eb380df60fca None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.771596 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-58887e06-158c-447d-a877-eb380df60fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:43.776841 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1035/2067] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:43.783985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b2174-e5a5-4c06-899d-f6dbe1d9dd90 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.800325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b2174-e5a5-4c06-899d-f6dbe1d9dd90 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.807384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e1335-658a-43cc-9212-1b2a223c067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.808188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e1335-658a-43cc-9212-1b2a223c067f admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.808454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e1335-658a-43cc-9212-1b2a223c067f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.808839 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e1335-658a-43cc-9212-1b2a223c067f admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.810376 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e1335-658a-43cc-9212-1b2a223c067f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.812836 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e1335-658a-43cc-9212-1b2a223c067f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.817320 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:43.831963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1036/2068] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:43.832835 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e1335-658a-43cc-9212-1b2a223c067f admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.836950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8f7e1335-658a-43cc-9212-1b2a223c067f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:43.854807 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e1335-658a-43cc-9212-1b2a223c067f admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.864898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.865556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.865834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.866104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928 admin admin] PATH_INFO: `/v3/projects/7be9af4886dc4ac5897d07a04dfca8a1` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.867312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be9af4886dc4ac5897d07a04dfca8a1)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.869577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.874874 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58887e06-158c-447d-a877-eb380df60fca None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.881177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb3cae-4fdd-4e19-833b-92a405ef0fc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:43.882063 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb3cae-4fdd-4e19-833b-92a405ef0fc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.882471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb3cae-4fdd-4e19-833b-92a405ef0fc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.882978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb3cae-4fdd-4e19-833b-92a405ef0fc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:43.895803 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb3cae-4fdd-4e19-833b-92a405ef0fc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:43.897366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb3cae-4fdd-4e19-833b-92a405ef0fc0 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:43.909070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1033/2069] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:03:43.910064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb3cae-4fdd-4e19-833b-92a405ef0fc0 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:43.929171 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb3cae-4fdd-4e19-833b-92a405ef0fc0 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:43.942104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be9af4886dc4ac5897d07a04dfca8a1', 'request_id': 'req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.954338 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be9af4886dc4ac5897d07a04dfca8a1', 'request_id': 'req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.963418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be9af4886dc4ac5897d07a04dfca8a1', 'request_id': 'req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.982556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928 admin admin] The token cache is being invalidate because project 7be9af4886dc4ac5897d07a04dfca8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:43.982556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.982556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-fa7ed2fd-bd2d-44a3-9cc3-d4d6ae824928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:43.982556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1037/2070] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:43 2022] DELETE /identity/v3/projects/7be9af4886dc4ac5897d07a04dfca8a1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:43.987331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc47ca-26d4-428c-a8bc-92e5cee9a4eb None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:43.987726 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc47ca-26d4-428c-a8bc-92e5cee9a4eb None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:43.988091 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc47ca-26d4-428c-a8bc-92e5cee9a4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.014701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-cefc47ca-26d4-428c-a8bc-92e5cee9a4eb None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:44.016250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-cefc47ca-26d4-428c-a8bc-92e5cee9a4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:44.024221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcd8ec-6e4c-4e5f-900a-2407eaaeb109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.025054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcd8ec-6e4c-4e5f-900a-2407eaaeb109 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.025342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcd8ec-6e4c-4e5f-900a-2407eaaeb109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.025615 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcd8ec-6e4c-4e5f-900a-2407eaaeb109 admin admin] PATH_INFO: `/v3/projects/0b67f088bbdc4fe5959b9d7133e26e15/users/bd2df499cf1a4faa93eb8c16cc539928/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.046479 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcd8ec-6e4c-4e5f-900a-2407eaaeb109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b67f088bbdc4fe5959b9d7133e26e15, user_id=bd2df499cf1a4faa93eb8c16cc539928, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.049640 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcd8ec-6e4c-4e5f-900a-2407eaaeb109 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.068115 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1034/2071] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:43 2022] PUT /identity/v3/projects/0b67f088bbdc4fe5959b9d7133e26e15/users/bd2df499cf1a4faa93eb8c16cc539928/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:44.079135 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a409b84-ec49-41ce-b4ae-4c9923e83c9b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.079483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a409b84-ec49-41ce-b4ae-4c9923e83c9b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.080102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a409b84-ec49-41ce-b4ae-4c9923e83c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.103075 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1038/2072] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:44.109989 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0a409b84-ec49-41ce-b4ae-4c9923e83c9b None None] MFA Rules not processed for user `bd2df499cf1a4faa93eb8c16cc539928`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:44.111268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0a409b84-ec49-41ce-b4ae-4c9923e83c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:44.113064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce0652-7b7d-4176-998f-1c2dfabd8e60 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.113064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce0652-7b7d-4176-998f-1c2dfabd8e60 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.113064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce0652-7b7d-4176-998f-1c2dfabd8e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.142258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-25ce0652-7b7d-4176-998f-1c2dfabd8e60 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:44.144982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-25ce0652-7b7d-4176-998f-1c2dfabd8e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:44.162156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:44.200159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1035/2073] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:44.220771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a409b84-ec49-41ce-b4ae-4c9923e83c9b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.222946 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0a409b84-ec49-41ce-b4ae-4c9923e83c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:44.275525 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1039/2074] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:44.278128 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce0652-7b7d-4176-998f-1c2dfabd8e60 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.294010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce0652-7b7d-4176-998f-1c2dfabd8e60 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.300902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d88aea-a562-4642-aecd-3a289d44b451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.301564 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d88aea-a562-4642-aecd-3a289d44b451 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.301839 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d88aea-a562-4642-aecd-3a289d44b451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.302619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d88aea-a562-4642-aecd-3a289d44b451 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.302943 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d88aea-a562-4642-aecd-3a289d44b451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:44.303250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d88aea-a562-4642-aecd-3a289d44b451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.305192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d88aea-a562-4642-aecd-3a289d44b451 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.331353 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1040/2075] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:44.332642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d88aea-a562-4642-aecd-3a289d44b451 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.349532 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d88aea-a562-4642-aecd-3a289d44b451 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.352206 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:44.359140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8d82a-ff93-4b2f-876b-9a63f5a033a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.359781 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8d82a-ff93-4b2f-876b-9a63f5a033a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.360061 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8d82a-ff93-4b2f-876b-9a63f5a033a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.360336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8d82a-ff93-4b2f-876b-9a63f5a033a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.360989 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8d82a-ff93-4b2f-876b-9a63f5a033a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.363484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8d82a-ff93-4b2f-876b-9a63f5a033a2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.396345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1041/2076] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:44 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:44.400560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8d82a-ff93-4b2f-876b-9a63f5a033a2 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.420379 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a409b84-ec49-41ce-b4ae-4c9923e83c9b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.470676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8d82a-ff93-4b2f-876b-9a63f5a033a2 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.475665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b5fbf-a547-46de-809c-362f9ecbeaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.476279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b5fbf-a547-46de-809c-362f9ecbeaee admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.476559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b5fbf-a547-46de-809c-362f9ecbeaee admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.476828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b5fbf-a547-46de-809c-362f9ecbeaee admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.477485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b5fbf-a547-46de-809c-362f9ecbeaee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.479457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b5fbf-a547-46de-809c-362f9ecbeaee admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.486027 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9aabe-5f5b-427d-b97a-fac68749ba7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.486669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9aabe-5f5b-427d-b97a-fac68749ba7c service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.486945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9aabe-5f5b-427d-b97a-fac68749ba7c service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.487212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9aabe-5f5b-427d-b97a-fac68749ba7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.502544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1042/2077] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:44 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:44.506517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b5fbf-a547-46de-809c-362f9ecbeaee admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.516662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b5fbf-a547-46de-809c-362f9ecbeaee admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.521831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacef2e-f07c-4602-85a4-be6753b78207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.522467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacef2e-f07c-4602-85a4-be6753b78207 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.522994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacef2e-f07c-4602-85a4-be6753b78207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.523274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacef2e-f07c-4602-85a4-be6753b78207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.523964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacef2e-f07c-4602-85a4-be6753b78207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.525594 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacef2e-f07c-4602-85a4-be6753b78207 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.539487 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1043/2078] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:44.542166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacef2e-f07c-4602-85a4-be6753b78207 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.554160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacef2e-f07c-4602-85a4-be6753b78207 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.559314 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20236f34-63be-4c68-8fe5-bf73e547167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.559683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9aabe-5f5b-427d-b97a-fac68749ba7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.559931 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236f34-63be-4c68-8fe5-bf73e547167d admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.560203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236f34-63be-4c68-8fe5-bf73e547167d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.560482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236f34-63be-4c68-8fe5-bf73e547167d admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.561134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20236f34-63be-4c68-8fe5-bf73e547167d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.561306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9aabe-5f5b-427d-b97a-fac68749ba7c service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.562884 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20236f34-63be-4c68-8fe5-bf73e547167d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.570818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1036/2079] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:44.578667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1044/2080] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:44.583755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9aabe-5f5b-427d-b97a-fac68749ba7c service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.597686 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9aabe-5f5b-427d-b97a-fac68749ba7c service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.602532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664a848-1907-4c5f-85cd-ddf51b74791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.603230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664a848-1907-4c5f-85cd-ddf51b74791d admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.603520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664a848-1907-4c5f-85cd-ddf51b74791d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.603806 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664a848-1907-4c5f-85cd-ddf51b74791d admin admin] PATH_INFO: `/v3/projects/3c59f1d5ec1743f78c2fdd4e3e43051e/users/67ad333d849f44dfa4ab6fa4ea9839f1/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.626297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664a848-1907-4c5f-85cd-ddf51b74791d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c59f1d5ec1743f78c2fdd4e3e43051e, user_id=67ad333d849f44dfa4ab6fa4ea9839f1, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.630636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664a848-1907-4c5f-85cd-ddf51b74791d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.647114 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1037/2081] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:44 2022] PUT /identity/v3/projects/3c59f1d5ec1743f78c2fdd4e3e43051e/users/67ad333d849f44dfa4ab6fa4ea9839f1/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:44.652905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5681-3803-4f8a-a87f-35bc499ab5ee None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.653278 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5681-3803-4f8a-a87f-35bc499ab5ee None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.653621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b5681-3803-4f8a-a87f-35bc499ab5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.674447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-946b5681-3803-4f8a-a87f-35bc499ab5ee None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:44.675817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-946b5681-3803-4f8a-a87f-35bc499ab5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:44.729727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:44.746196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1045/2082] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:44.756327 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664a848-1907-4c5f-85cd-ddf51b74791d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:44.759704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f664a848-1907-4c5f-85cd-ddf51b74791d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:44.820534 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:44.838657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664a848-1907-4c5f-85cd-ddf51b74791d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:44.843051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e1285-6069-4a02-9e38-db5acd06210b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:44.843716 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e1285-6069-4a02-9e38-db5acd06210b service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:44.844458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e1285-6069-4a02-9e38-db5acd06210b service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:44.844711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e1285-6069-4a02-9e38-db5acd06210b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:44.855189 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e1285-6069-4a02-9e38-db5acd06210b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:44.856671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e1285-6069-4a02-9e38-db5acd06210b service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:44.868456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1038/2083] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:45.901022 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b5681-3803-4f8a-a87f-35bc499ab5ee None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:45.903130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-946b5681-3803-4f8a-a87f-35bc499ab5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:45.916357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b5681-3803-4f8a-a87f-35bc499ab5ee None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:45.922083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028d490-ff60-485e-a909-b0557827959a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:45.922629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028d490-ff60-485e-a909-b0557827959a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:45.923232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028d490-ff60-485e-a909-b0557827959a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:45.923232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028d490-ff60-485e-a909-b0557827959a admin admin] PATH_INFO: `/v3/users/8e36f4c097284dcfb5c6c8ae1c5de53a` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:45.924554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028d490-ff60-485e-a909-b0557827959a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e36f4c097284dcfb5c6c8ae1c5de53a)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:45.926897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028d490-ff60-485e-a909-b0557827959a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:46.010014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a028d490-ff60-485e-a909-b0557827959a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e36f4c097284dcfb5c6c8ae1c5de53a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:46.030686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a028d490-ff60-485e-a909-b0557827959a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e36f4c097284dcfb5c6c8ae1c5de53a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:46.039580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a028d490-ff60-485e-a909-b0557827959a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e36f4c097284dcfb5c6c8ae1c5de53a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:46.047062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a028d490-ff60-485e-a909-b0557827959a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e36f4c097284dcfb5c6c8ae1c5de53a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:46.047812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a028d490-ff60-485e-a909-b0557827959a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e36f4c097284dcfb5c6c8ae1c5de53a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:46.058090 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1046/2084] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:45 2022] DELETE /identity/v3/users/8e36f4c097284dcfb5c6c8ae1c5de53a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:46.060620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8056a0c-af89-4d0a-b262-70943d0c9532 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:46.061501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8056a0c-af89-4d0a-b262-70943d0c9532 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:46.062026 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8056a0c-af89-4d0a-b262-70943d0c9532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:46.088682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d8056a0c-af89-4d0a-b262-70943d0c9532 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:46.089910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d8056a0c-af89-4d0a-b262-70943d0c9532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:46.188997 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1039/2085] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:46.197518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028d490-ff60-485e-a909-b0557827959a admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:46.200095 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a028d490-ff60-485e-a909-b0557827959a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:46.272817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028d490-ff60-485e-a909-b0557827959a admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:46.276799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9395100-b74c-4746-9518-04934cc3c12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:46.277572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9395100-b74c-4746-9518-04934cc3c12b service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:46.277950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9395100-b74c-4746-9518-04934cc3c12b service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:46.278319 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9395100-b74c-4746-9518-04934cc3c12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:46.293411 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9395100-b74c-4746-9518-04934cc3c12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:46.293411 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9395100-b74c-4746-9518-04934cc3c12b service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:46.305977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1047/2086] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:46.795161 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8056a0c-af89-4d0a-b262-70943d0c9532 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:46.811634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d8056a0c-af89-4d0a-b262-70943d0c9532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:46.853363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8056a0c-af89-4d0a-b262-70943d0c9532 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:46.866461 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:46.867928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:46.868587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:46.869111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] PATH_INFO: `/v3/projects/a3202efebd104790a34aa3ebde340870` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:46.871225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3202efebd104790a34aa3ebde340870)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:46.874067 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:46.985354 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3202efebd104790a34aa3ebde340870', 'request_id': 'req-333e20a1-188a-40b5-9f08-4f8509ecfff0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.010312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3202efebd104790a34aa3ebde340870', 'request_id': 'req-333e20a1-188a-40b5-9f08-4f8509ecfff0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.020571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3202efebd104790a34aa3ebde340870', 'request_id': 'req-333e20a1-188a-40b5-9f08-4f8509ecfff0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.034453 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] The token cache is being invalidate because project a3202efebd104790a34aa3ebde340870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:47.034803 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.035548 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.037484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1040/2087] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:46 2022] DELETE /identity/v3/projects/a3202efebd104790a34aa3ebde340870 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:47.042089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9395100-b74c-4746-9518-04934cc3c12b service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:47.059054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9395100-b74c-4746-9518-04934cc3c12b service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:47.160201 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2b070-b0d2-4938-8cb8-ab8062b3dd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:47.160875 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2b070-b0d2-4938-8cb8-ab8062b3dd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:47.161232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2b070-b0d2-4938-8cb8-ab8062b3dd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:47.161504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2b070-b0d2-4938-8cb8-ab8062b3dd92 admin admin] PATH_INFO: `/v3/users/e75de90b7ba64a27bdf7a9a84f33f161` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:47.162953 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2b070-b0d2-4938-8cb8-ab8062b3dd92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75de90b7ba64a27bdf7a9a84f33f161)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:47.165075 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2b070-b0d2-4938-8cb8-ab8062b3dd92 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:47.178450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:47.242745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6ab2b070-b0d2-4938-8cb8-ab8062b3dd92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75de90b7ba64a27bdf7a9a84f33f161'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.264131 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6ab2b070-b0d2-4938-8cb8-ab8062b3dd92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75de90b7ba64a27bdf7a9a84f33f161'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.273851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6ab2b070-b0d2-4938-8cb8-ab8062b3dd92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75de90b7ba64a27bdf7a9a84f33f161'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.289433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6ab2b070-b0d2-4938-8cb8-ab8062b3dd92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75de90b7ba64a27bdf7a9a84f33f161'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.290704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6ab2b070-b0d2-4938-8cb8-ab8062b3dd92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75de90b7ba64a27bdf7a9a84f33f161'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.299559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1048/2088] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:47 2022] DELETE /identity/v3/users/e75de90b7ba64a27bdf7a9a84f33f161 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:47.498163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:47.499773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:47.525990 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e20a1-188a-40b5-9f08-4f8509ecfff0 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:47.672627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e5052-d1d5-4417-8605-c2bae8d45c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:47.673219 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e5052-d1d5-4417-8605-c2bae8d45c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:47.673503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e5052-d1d5-4417-8605-c2bae8d45c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:47.673788 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e5052-d1d5-4417-8605-c2bae8d45c48 admin admin] PATH_INFO: `/v3/users/bd2df499cf1a4faa93eb8c16cc539928` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:47.675225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e5052-d1d5-4417-8605-c2bae8d45c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2df499cf1a4faa93eb8c16cc539928)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:47.682779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e5052-d1d5-4417-8605-c2bae8d45c48 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:47.724021 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:47.798357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ee5e5052-d1d5-4417-8605-c2bae8d45c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2df499cf1a4faa93eb8c16cc539928'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.799562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ee5e5052-d1d5-4417-8605-c2bae8d45c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2df499cf1a4faa93eb8c16cc539928'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.800303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ee5e5052-d1d5-4417-8605-c2bae8d45c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2df499cf1a4faa93eb8c16cc539928'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.814086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ee5e5052-d1d5-4417-8605-c2bae8d45c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2df499cf1a4faa93eb8c16cc539928'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.828309 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ee5e5052-d1d5-4417-8605-c2bae8d45c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2df499cf1a4faa93eb8c16cc539928'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:47.859330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1041/2089] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:47 2022] DELETE /identity/v3/users/bd2df499cf1a4faa93eb8c16cc539928 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:47.863611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005a9f5-6295-4f8e-a8f2-adf116a090bf None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:47.863897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005a9f5-6295-4f8e-a8f2-adf116a090bf None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:47.864167 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005a9f5-6295-4f8e-a8f2-adf116a090bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:47.903014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-3005a9f5-6295-4f8e-a8f2-adf116a090bf None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:47.904426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3005a9f5-6295-4f8e-a8f2-adf116a090bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:48.010027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1049/2090] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:48.021780 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e5052-d1d5-4417-8605-c2bae8d45c48 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:48.025384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ee5e5052-d1d5-4417-8605-c2bae8d45c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:48.043173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005a9f5-6295-4f8e-a8f2-adf116a090bf None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:48.044685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3005a9f5-6295-4f8e-a8f2-adf116a090bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:48.087364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005a9f5-6295-4f8e-a8f2-adf116a090bf None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:48.092314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e5052-d1d5-4417-8605-c2bae8d45c48 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:48.096120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7f05b-e34d-44e7-bf31-93cd53579cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:48.096748 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f05b-e34d-44e7-bf31-93cd53579cba service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:48.097129 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f05b-e34d-44e7-bf31-93cd53579cba service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:48.097369 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f05b-e34d-44e7-bf31-93cd53579cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:48.107887 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7f05b-e34d-44e7-bf31-93cd53579cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:48.109569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7f05b-e34d-44e7-bf31-93cd53579cba service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:48.121026 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1042/2091] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:48.129379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f03a9-647d-400d-82f1-d2dc08a5836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:48.131184 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f03a9-647d-400d-82f1-d2dc08a5836a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:48.135021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f03a9-647d-400d-82f1-d2dc08a5836a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:48.135550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f03a9-647d-400d-82f1-d2dc08a5836a admin admin] PATH_INFO: `/v3/projects/1247f8c3fca5488aa05631fff022dc7d` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:48.137949 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f03a9-647d-400d-82f1-d2dc08a5836a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1247f8c3fca5488aa05631fff022dc7d)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:48.143496 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f03a9-647d-400d-82f1-d2dc08a5836a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:48.251789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-170f03a9-647d-400d-82f1-d2dc08a5836a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1247f8c3fca5488aa05631fff022dc7d', 'request_id': 'req-170f03a9-647d-400d-82f1-d2dc08a5836a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.264066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-170f03a9-647d-400d-82f1-d2dc08a5836a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1247f8c3fca5488aa05631fff022dc7d', 'request_id': 'req-170f03a9-647d-400d-82f1-d2dc08a5836a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.288457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-170f03a9-647d-400d-82f1-d2dc08a5836a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1247f8c3fca5488aa05631fff022dc7d', 'request_id': 'req-170f03a9-647d-400d-82f1-d2dc08a5836a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.318749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-170f03a9-647d-400d-82f1-d2dc08a5836a admin admin] The token cache is being invalidate because project 1247f8c3fca5488aa05631fff022dc7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:48.320358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-170f03a9-647d-400d-82f1-d2dc08a5836a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.322979 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-170f03a9-647d-400d-82f1-d2dc08a5836a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.328020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1050/2092] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:48 2022] DELETE /identity/v3/projects/1247f8c3fca5488aa05631fff022dc7d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:48.335111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2ce7-7271-4bea-a849-a1c55261ffdd None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:48.335840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2ce7-7271-4bea-a849-a1c55261ffdd None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:48.336709 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2ce7-7271-4bea-a849-a1c55261ffdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:48.380332 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e04b2ce7-7271-4bea-a849-a1c55261ffdd None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:48.386916 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e04b2ce7-7271-4bea-a849-a1c55261ffdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:48.598642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1043/2093] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:48.604822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a1b78-b6ad-463e-ba0f-89f6427a8d87 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:48.605380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a1b78-b6ad-463e-ba0f-89f6427a8d87 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:48.605711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a1b78-b6ad-463e-ba0f-89f6427a8d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:48.638134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-4b3a1b78-b6ad-463e-ba0f-89f6427a8d87 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:48.639524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4b3a1b78-b6ad-463e-ba0f-89f6427a8d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:48.649080 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1051/2094] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:48.653422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b2ce7-7271-4bea-a849-a1c55261ffdd None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:48.666197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b2ce7-7271-4bea-a849-a1c55261ffdd None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:48.673590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb2ef2-9b4b-4ed4-ad15-f5d0dc2625c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:48.674644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb2ef2-9b4b-4ed4-ad15-f5d0dc2625c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:48.675079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb2ef2-9b4b-4ed4-ad15-f5d0dc2625c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:48.675836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb2ef2-9b4b-4ed4-ad15-f5d0dc2625c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:48.676772 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb2ef2-9b4b-4ed4-ad15-f5d0dc2625c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:48.677085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb2ef2-9b4b-4ed4-ad15-f5d0dc2625c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:48.679438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb2ef2-9b4b-4ed4-ad15-f5d0dc2625c7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:48.701554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a1b78-b6ad-463e-ba0f-89f6427a8d87 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:48.713086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1044/2095] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:48.725454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:48.732336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a1b78-b6ad-463e-ba0f-89f6427a8d87 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:48.741587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26060489-18fc-4a1e-8bf1-5957ef06ef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:48.742181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb2ef2-9b4b-4ed4-ad15-f5d0dc2625c7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:48.742317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060489-18fc-4a1e-8bf1-5957ef06ef7b admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:48.742749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060489-18fc-4a1e-8bf1-5957ef06ef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:48.743254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060489-18fc-4a1e-8bf1-5957ef06ef7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:48.744185 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26060489-18fc-4a1e-8bf1-5957ef06ef7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:48.744414 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b1eb2ef2-9b4b-4ed4-ad15-f5d0dc2625c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:48.747728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26060489-18fc-4a1e-8bf1-5957ef06ef7b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:48.770560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb2ef2-9b4b-4ed4-ad15-f5d0dc2625c7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:48.789714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d2703-92c4-4c60-a60e-d7db67ae6637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:48.790398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2703-92c4-4c60-a60e-d7db67ae6637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:48.790701 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2703-92c4-4c60-a60e-d7db67ae6637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:48.790979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2703-92c4-4c60-a60e-d7db67ae6637 admin admin] PATH_INFO: `/v3/projects/0b67f088bbdc4fe5959b9d7133e26e15` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:48.792171 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d2703-92c4-4c60-a60e-d7db67ae6637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b67f088bbdc4fe5959b9d7133e26e15)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:48.794329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d2703-92c4-4c60-a60e-d7db67ae6637 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:48.801217 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1052/2096] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:48 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:48.802924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26060489-18fc-4a1e-8bf1-5957ef06ef7b admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:48.822488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:48.874062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d26d2703-92c4-4c60-a60e-d7db67ae6637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b67f088bbdc4fe5959b9d7133e26e15', 'request_id': 'req-d26d2703-92c4-4c60-a60e-d7db67ae6637'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.884598 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d26d2703-92c4-4c60-a60e-d7db67ae6637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b67f088bbdc4fe5959b9d7133e26e15', 'request_id': 'req-d26d2703-92c4-4c60-a60e-d7db67ae6637'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.899626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d26d2703-92c4-4c60-a60e-d7db67ae6637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b67f088bbdc4fe5959b9d7133e26e15', 'request_id': 'req-d26d2703-92c4-4c60-a60e-d7db67ae6637'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.922272 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d26d2703-92c4-4c60-a60e-d7db67ae6637 admin admin] The token cache is being invalidate because project 0b67f088bbdc4fe5959b9d7133e26e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:48.922561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d26d2703-92c4-4c60-a60e-d7db67ae6637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.923963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d26d2703-92c4-4c60-a60e-d7db67ae6637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:48.925610 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1045/2097] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:48 2022] DELETE /identity/v3/projects/0b67f088bbdc4fe5959b9d7133e26e15 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:48.932114 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3ca97-c4a4-4a4b-95d3-83e88ddf3e2c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:48.932386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3ca97-c4a4-4a4b-95d3-83e88ddf3e2c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:48.932652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3ca97-c4a4-4a4b-95d3-83e88ddf3e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:48.945763 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26060489-18fc-4a1e-8bf1-5957ef06ef7b admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:48.964782 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0ad3ca97-c4a4-4a4b-95d3-83e88ddf3e2c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:48.966764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0ad3ca97-c4a4-4a4b-95d3-83e88ddf3e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:49.040138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361bef6-bb32-45dc-ae34-f205abaff63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.040904 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361bef6-bb32-45dc-ae34-f205abaff63e admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.041057 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361bef6-bb32-45dc-ae34-f205abaff63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.041336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361bef6-bb32-45dc-ae34-f205abaff63e admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.041981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361bef6-bb32-45dc-ae34-f205abaff63e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.048609 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361bef6-bb32-45dc-ae34-f205abaff63e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:49.059426 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1046/2098] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:49.076180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea27661-17e4-4ddf-8a47-bc78fe4fec58 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.076539 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea27661-17e4-4ddf-8a47-bc78fe4fec58 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.077026 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea27661-17e4-4ddf-8a47-bc78fe4fec58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.103176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1053/2099] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:48 2022] POST /identity/v3/users => generated 283 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:49.104691 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-eea27661-17e4-4ddf-8a47-bc78fe4fec58 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:49.106134 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-eea27661-17e4-4ddf-8a47-bc78fe4fec58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:49.109290 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361bef6-bb32-45dc-ae34-f205abaff63e admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:49.111454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3361bef6-bb32-45dc-ae34-f205abaff63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:49.119693 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1047/2100] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:49.123932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea27661-17e4-4ddf-8a47-bc78fe4fec58 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:49.127141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361bef6-bb32-45dc-ae34-f205abaff63e admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.132828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa70d5-b905-4723-b885-5b0e25d51fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.133656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa70d5-b905-4723-b885-5b0e25d51fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.134115 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa70d5-b905-4723-b885-5b0e25d51fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.134247 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea27661-17e4-4ddf-8a47-bc78fe4fec58 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.134856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa70d5-b905-4723-b885-5b0e25d51fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.135705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa70d5-b905-4723-b885-5b0e25d51fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.137523 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa70d5-b905-4723-b885-5b0e25d51fcb admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:49.139931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca66dfd-da62-47ad-8ae5-4fa32a122beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.140996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca66dfd-da62-47ad-8ae5-4fa32a122beb admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.141466 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca66dfd-da62-47ad-8ae5-4fa32a122beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.141938 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca66dfd-da62-47ad-8ae5-4fa32a122beb admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.142831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca66dfd-da62-47ad-8ae5-4fa32a122beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:49.143325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca66dfd-da62-47ad-8ae5-4fa32a122beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.145290 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca66dfd-da62-47ad-8ae5-4fa32a122beb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:49.148872 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1054/2101] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:49.153906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa70d5-b905-4723-b885-5b0e25d51fcb admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:49.167090 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa70d5-b905-4723-b885-5b0e25d51fcb admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.170115 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1048/2102] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:03:49.174677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca66dfd-da62-47ad-8ae5-4fa32a122beb admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:49.185633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca66dfd-da62-47ad-8ae5-4fa32a122beb admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.188539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ca65b-1ad0-48d7-8345-a97c37541931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.189174 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca65b-1ad0-48d7-8345-a97c37541931 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.189456 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca65b-1ad0-48d7-8345-a97c37541931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.189730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca65b-1ad0-48d7-8345-a97c37541931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.190392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ca65b-1ad0-48d7-8345-a97c37541931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.192051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ca65b-1ad0-48d7-8345-a97c37541931 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:49.193466 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee6d9a-5cec-423a-b5e5-62afcc719a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.194225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee6d9a-5cec-423a-b5e5-62afcc719a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.194872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee6d9a-5cec-423a-b5e5-62afcc719a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.195210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee6d9a-5cec-423a-b5e5-62afcc719a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.196047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee6d9a-5cec-423a-b5e5-62afcc719a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.198234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee6d9a-5cec-423a-b5e5-62afcc719a23 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:49.211009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1055/2103] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:49.214871 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ca65b-1ad0-48d7-8345-a97c37541931 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:49.228107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ca65b-1ad0-48d7-8345-a97c37541931 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.234127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bf75e-d7b4-452c-aba2-87c328c097cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.235079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bf75e-d7b4-452c-aba2-87c328c097cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.235213 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bf75e-d7b4-452c-aba2-87c328c097cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.235477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bf75e-d7b4-452c-aba2-87c328c097cd admin admin] PATH_INFO: `/v3/projects/5c75d565f0cd4e629015de1e47766fea/users/9dda40c581a74a25a8148b5926555f75/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.243293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1049/2104] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:49 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:49.246548 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee6d9a-5cec-423a-b5e5-62afcc719a23 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:49.265614 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bf75e-d7b4-452c-aba2-87c328c097cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c75d565f0cd4e629015de1e47766fea, user_id=9dda40c581a74a25a8148b5926555f75, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.268568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bf75e-d7b4-452c-aba2-87c328c097cd admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:49.305589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1056/2105] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:49 2022] PUT /identity/v3/projects/5c75d565f0cd4e629015de1e47766fea/users/9dda40c581a74a25a8148b5926555f75/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:49.317558 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbf09a-2864-4486-84f3-602aca92516f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.317950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbf09a-2864-4486-84f3-602aca92516f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.318345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbf09a-2864-4486-84f3-602aca92516f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.344392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee6d9a-5cec-423a-b5e5-62afcc719a23 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.350697 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:49.368155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1acbf09a-2864-4486-84f3-602aca92516f None None] MFA Rules not processed for user `9dda40c581a74a25a8148b5926555f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:49.371178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1acbf09a-2864-4486-84f3-602aca92516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:49.398464 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:49.432501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b16a1-17a0-48d8-9628-7ae80a8c4915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.433980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b16a1-17a0-48d8-9628-7ae80a8c4915 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.434585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b16a1-17a0-48d8-9628-7ae80a8c4915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.435149 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b16a1-17a0-48d8-9628-7ae80a8c4915 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.435962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b16a1-17a0-48d8-9628-7ae80a8c4915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.438802 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b16a1-17a0-48d8-9628-7ae80a8c4915 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:49.466127 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1057/2106] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:49.466969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1050/2107] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:49 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:49.470657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbf09a-2864-4486-84f3-602aca92516f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:49.470796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b16a1-17a0-48d8-9628-7ae80a8c4915 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:49.484266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbf09a-2864-4486-84f3-602aca92516f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.484771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b16a1-17a0-48d8-9628-7ae80a8c4915 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.489904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbebe39-d588-46ee-8539-5d67c88ed58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.490508 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbebe39-d588-46ee-8539-5d67c88ed58a admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.490829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbebe39-d588-46ee-8539-5d67c88ed58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.491197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbebe39-d588-46ee-8539-5d67c88ed58a admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.491662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d78167-22dd-4864-9192-9ef63f22ded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.491907 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbebe39-d588-46ee-8539-5d67c88ed58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.492488 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78167-22dd-4864-9192-9ef63f22ded6 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.493115 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78167-22dd-4864-9192-9ef63f22ded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.493830 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbebe39-d588-46ee-8539-5d67c88ed58a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:49.494137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78167-22dd-4864-9192-9ef63f22ded6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.494919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d78167-22dd-4864-9192-9ef63f22ded6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.498272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d78167-22dd-4864-9192-9ef63f22ded6 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:49.507775 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1051/2108] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:49.511162 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbebe39-d588-46ee-8539-5d67c88ed58a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:49.532367 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbebe39-d588-46ee-8539-5d67c88ed58a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.544191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6fefe-49fd-46d8-8dce-79f121d6bc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.544858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6fefe-49fd-46d8-8dce-79f121d6bc37 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.545094 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6fefe-49fd-46d8-8dce-79f121d6bc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.545384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6fefe-49fd-46d8-8dce-79f121d6bc37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.546020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6fefe-49fd-46d8-8dce-79f121d6bc37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.547682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6fefe-49fd-46d8-8dce-79f121d6bc37 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:49.552853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1058/2109] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:49 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:49.554351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d78167-22dd-4864-9192-9ef63f22ded6 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:49.582140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1052/2110] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:49.582876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6fefe-49fd-46d8-8dce-79f121d6bc37 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:49.609799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6fefe-49fd-46d8-8dce-79f121d6bc37 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.673077 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d78167-22dd-4864-9192-9ef63f22ded6 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.702414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc36ea-5076-462b-be62-731aa803c8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.709780 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc36ea-5076-462b-be62-731aa803c8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.710239 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc36ea-5076-462b-be62-731aa803c8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.710522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc36ea-5076-462b-be62-731aa803c8f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.711244 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc36ea-5076-462b-be62-731aa803c8f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.714523 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc36ea-5076-462b-be62-731aa803c8f3 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:49.773636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1059/2111] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:49 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:49.779507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc36ea-5076-462b-be62-731aa803c8f3 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:49.780448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5427c-b0d0-4526-92aa-96e20a0acd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.783257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5427c-b0d0-4526-92aa-96e20a0acd4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.785493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5427c-b0d0-4526-92aa-96e20a0acd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.786459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5427c-b0d0-4526-92aa-96e20a0acd4a admin admin] PATH_INFO: `/v3/projects/a125625a792b43ab8eef18c300334f6b/users/3dc8cfd2df054f64967459f799a73411/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.806962 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc36ea-5076-462b-be62-731aa803c8f3 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.814526 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b4702-8df0-4baf-9a09-160337de685c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:49.815526 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b4702-8df0-4baf-9a09-160337de685c admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.816000 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b4702-8df0-4baf-9a09-160337de685c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.816510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b4702-8df0-4baf-9a09-160337de685c admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.817997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b4702-8df0-4baf-9a09-160337de685c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.820203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b4702-8df0-4baf-9a09-160337de685c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:49.838294 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5427c-b0d0-4526-92aa-96e20a0acd4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a125625a792b43ab8eef18c300334f6b, user_id=3dc8cfd2df054f64967459f799a73411, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:49.841496 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1060/2112] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:49.845986 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5427c-b0d0-4526-92aa-96e20a0acd4a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:49.847976 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b4702-8df0-4baf-9a09-160337de685c admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:49.871201 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b4702-8df0-4baf-9a09-160337de685c admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:49.895152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1053/2113] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:49 2022] PUT /identity/v3/projects/a125625a792b43ab8eef18c300334f6b/users/3dc8cfd2df054f64967459f799a73411/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:49.899082 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2e7dd-7026-4c1f-9981-669ce2698ed9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:49.900224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2e7dd-7026-4c1f-9981-669ce2698ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:49.900790 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2e7dd-7026-4c1f-9981-669ce2698ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:49.955896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-cda2e7dd-7026-4c1f-9981-669ce2698ed9 None None] MFA Rules not processed for user `3dc8cfd2df054f64967459f799a73411`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:49.957646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cda2e7dd-7026-4c1f-9981-669ce2698ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:50.005164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f13c5-764d-460f-a26e-c385eda2c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:50.005858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f13c5-764d-460f-a26e-c385eda2c8f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:50.006141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f13c5-764d-460f-a26e-c385eda2c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:50.006420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f13c5-764d-460f-a26e-c385eda2c8f8 admin admin] PATH_INFO: `/v3/projects/f90376e1ad3640a4b3d72fee32f00b5f/users/ff4e015b88d148a19876c7de875d2ff3/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:50.042683 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f13c5-764d-460f-a26e-c385eda2c8f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90376e1ad3640a4b3d72fee32f00b5f, user_id=ff4e015b88d148a19876c7de875d2ff3, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:50.045512 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f13c5-764d-460f-a26e-c385eda2c8f8 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:50.051860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:50.078150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1061/2114] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:49 2022] PUT /identity/v3/projects/f90376e1ad3640a4b3d72fee32f00b5f/users/ff4e015b88d148a19876c7de875d2ff3/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:50.082094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f13c5-764d-460f-a26e-c385eda2c8f8 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:50.086999 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:50.105603 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1054/2115] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:50.123585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2e7dd-7026-4c1f-9981-669ce2698ed9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:50.125451 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cda2e7dd-7026-4c1f-9981-669ce2698ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:50.167137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f13c5-764d-460f-a26e-c385eda2c8f8 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:50.174886 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79702d2-df20-4bcc-b80d-ef7543b50e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:50.175567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79702d2-df20-4bcc-b80d-ef7543b50e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:50.176088 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79702d2-df20-4bcc-b80d-ef7543b50e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:50.176545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79702d2-df20-4bcc-b80d-ef7543b50e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:50.177210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79702d2-df20-4bcc-b80d-ef7543b50e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:50.179788 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79702d2-df20-4bcc-b80d-ef7543b50e16 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:50.192663 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1062/2116] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:50.197149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79702d2-df20-4bcc-b80d-ef7543b50e16 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:50.211119 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79702d2-df20-4bcc-b80d-ef7543b50e16 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:50.220131 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b321ad-7e2b-454d-b797-2f950315dbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:50.223054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b321ad-7e2b-454d-b797-2f950315dbf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:50.225006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b321ad-7e2b-454d-b797-2f950315dbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:50.226119 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b321ad-7e2b-454d-b797-2f950315dbf2 admin admin] PATH_INFO: `/v3/projects/f90376e1ad3640a4b3d72fee32f00b5f/users/ff4e015b88d148a19876c7de875d2ff3/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:50.242810 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b321ad-7e2b-454d-b797-2f950315dbf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90376e1ad3640a4b3d72fee32f00b5f, user_id=ff4e015b88d148a19876c7de875d2ff3, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:50.245688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b321ad-7e2b-454d-b797-2f950315dbf2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:50.275397 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1063/2117] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:50 2022] PUT /identity/v3/projects/f90376e1ad3640a4b3d72fee32f00b5f/users/ff4e015b88d148a19876c7de875d2ff3/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:50.293698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa1a78-65cc-40cc-afa6-b6ea4ad620d9 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:50.294012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa1a78-65cc-40cc-afa6-b6ea4ad620d9 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:50.294453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa1a78-65cc-40cc-afa6-b6ea4ad620d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:50.338567 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2e7dd-7026-4c1f-9981-669ce2698ed9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:50.359616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-f2aa1a78-65cc-40cc-afa6-b6ea4ad620d9 None None] MFA Rules not processed for user `ff4e015b88d148a19876c7de875d2ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:50.360959 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f2aa1a78-65cc-40cc-afa6-b6ea4ad620d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:50.473032 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e9a08-5f04-49f0-83b3-caf93b7d09c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:50.473788 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e9a08-5f04-49f0-83b3-caf93b7d09c6 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:50.474267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e9a08-5f04-49f0-83b3-caf93b7d09c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:50.474689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e9a08-5f04-49f0-83b3-caf93b7d09c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:50.487158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1064/2118] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:50.501418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa1a78-65cc-40cc-afa6-b6ea4ad620d9 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:50.508470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f2aa1a78-65cc-40cc-afa6-b6ea4ad620d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:50.560450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e9a08-5f04-49f0-83b3-caf93b7d09c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:50.562441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e9a08-5f04-49f0-83b3-caf93b7d09c6 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:50.575252 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1055/2119] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:50.590304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa1a78-65cc-40cc-afa6-b6ea4ad620d9 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:50.595087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056910bb-cc8e-4153-ac6f-b2c0b771d4d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:50.595758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056910bb-cc8e-4153-ac6f-b2c0b771d4d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:50.596068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056910bb-cc8e-4153-ac6f-b2c0b771d4d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:50.596325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056910bb-cc8e-4153-ac6f-b2c0b771d4d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:50.611715 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056910bb-cc8e-4153-ac6f-b2c0b771d4d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:50.614837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056910bb-cc8e-4153-ac6f-b2c0b771d4d8 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:50.658888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1065/2120] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:03:50.840756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e9a08-5f04-49f0-83b3-caf93b7d09c6 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:50.856504 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e9a08-5f04-49f0-83b3-caf93b7d09c6 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:50.867286 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1a6ba-7957-48aa-a10f-33ad3f7848e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:50.868282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1a6ba-7957-48aa-a10f-33ad3f7848e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:50.868570 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1a6ba-7957-48aa-a10f-33ad3f7848e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:50.868855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1a6ba-7957-48aa-a10f-33ad3f7848e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:50.920576 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:50.941745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056910bb-cc8e-4153-ac6f-b2c0b771d4d8 service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:50.967698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:50.986543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1a6ba-7957-48aa-a10f-33ad3f7848e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:50.988206 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1a6ba-7957-48aa-a10f-33ad3f7848e5 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:50.999857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1056/2121] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:51.063367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056910bb-cc8e-4153-ac6f-b2c0b771d4d8 service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.088118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613bcba-df3b-4026-ba90-39606f32bb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.089238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613bcba-df3b-4026-ba90-39606f32bb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.089238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613bcba-df3b-4026-ba90-39606f32bb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.089238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613bcba-df3b-4026-ba90-39606f32bb0c admin admin] PATH_INFO: `/v3/users/3dc8cfd2df054f64967459f799a73411` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.091994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613bcba-df3b-4026-ba90-39606f32bb0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc8cfd2df054f64967459f799a73411)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:51.096329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613bcba-df3b-4026-ba90-39606f32bb0c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:51.101074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29afc31-ea11-4126-b4e5-5ba59b135d6e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.101405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29afc31-ea11-4126-b4e5-5ba59b135d6e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.101635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29afc31-ea11-4126-b4e5-5ba59b135d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.136337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a29afc31-ea11-4126-b4e5-5ba59b135d6e None None] MFA Rules not processed for user `67ad333d849f44dfa4ab6fa4ea9839f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:51.137832 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a29afc31-ea11-4126-b4e5-5ba59b135d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:51.187237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0613bcba-df3b-4026-ba90-39606f32bb0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc8cfd2df054f64967459f799a73411'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:51.212387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0613bcba-df3b-4026-ba90-39606f32bb0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc8cfd2df054f64967459f799a73411'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:51.226221 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0613bcba-df3b-4026-ba90-39606f32bb0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc8cfd2df054f64967459f799a73411'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:51.243250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0613bcba-df3b-4026-ba90-39606f32bb0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc8cfd2df054f64967459f799a73411'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:51.243603 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1057/2122] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:51.244380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0613bcba-df3b-4026-ba90-39606f32bb0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc8cfd2df054f64967459f799a73411'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:51.249039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29afc31-ea11-4126-b4e5-5ba59b135d6e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:51.250943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a29afc31-ea11-4126-b4e5-5ba59b135d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:51.256034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1066/2123] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:50 2022] DELETE /identity/v3/users/3dc8cfd2df054f64967459f799a73411 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:51.261819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62c9cf-595d-4f7f-9dfb-f6aac8d6381e None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.262293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62c9cf-595d-4f7f-9dfb-f6aac8d6381e None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.262807 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62c9cf-595d-4f7f-9dfb-f6aac8d6381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.266357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29afc31-ea11-4126-b4e5-5ba59b135d6e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.292720 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-3c62c9cf-595d-4f7f-9dfb-f6aac8d6381e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:51.294462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3c62c9cf-595d-4f7f-9dfb-f6aac8d6381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:51.346175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b29e8-5298-4ee6-927a-b5ac0560e3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.346975 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b29e8-5298-4ee6-927a-b5ac0560e3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.347365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b29e8-5298-4ee6-927a-b5ac0560e3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.347749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b29e8-5298-4ee6-927a-b5ac0560e3c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.348484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b29e8-5298-4ee6-927a-b5ac0560e3c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:51.350739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b29e8-5298-4ee6-927a-b5ac0560e3c3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:51.430788 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1067/2124] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:03:51.440490 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1058/2125] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:51 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:51.441740 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62c9cf-595d-4f7f-9dfb-f6aac8d6381e None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:51.443470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3c62c9cf-595d-4f7f-9dfb-f6aac8d6381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:51.447690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b29e8-5298-4ee6-927a-b5ac0560e3c3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:51.450784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-456b29e8-5298-4ee6-927a-b5ac0560e3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:51.487821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62c9cf-595d-4f7f-9dfb-f6aac8d6381e None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.568115 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:51.570325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:51.598127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b29e8-5298-4ee6-927a-b5ac0560e3c3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.602286 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbcbb0-9594-44ac-96c5-5244a96055ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.602948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbcbb0-9594-44ac-96c5-5244a96055ae service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.603306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbcbb0-9594-44ac-96c5-5244a96055ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.603660 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbcbb0-9594-44ac-96c5-5244a96055ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.622799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357e7e2-be06-42cb-bbd4-ab8526430226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.623499 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357e7e2-be06-42cb-bbd4-ab8526430226 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.624234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357e7e2-be06-42cb-bbd4-ab8526430226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.624524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357e7e2-be06-42cb-bbd4-ab8526430226 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.625318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357e7e2-be06-42cb-bbd4-ab8526430226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:51.627566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357e7e2-be06-42cb-bbd4-ab8526430226 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:51.663811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1068/2126] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:51 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:51.665605 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357e7e2-be06-42cb-bbd4-ab8526430226 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:51.677964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357e7e2-be06-42cb-bbd4-ab8526430226 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.683586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190195-9b15-4cb4-b359-901ed0e73626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.684650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190195-9b15-4cb4-b359-901ed0e73626 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.685268 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190195-9b15-4cb4-b359-901ed0e73626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.685754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0190195-9b15-4cb4-b359-901ed0e73626 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.686522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0190195-9b15-4cb4-b359-901ed0e73626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:51.688401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0190195-9b15-4cb4-b359-901ed0e73626 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:51.698773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbcbb0-9594-44ac-96c5-5244a96055ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:51.701109 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbcbb0-9594-44ac-96c5-5244a96055ae service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:51.712290 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1069/2127] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:51.713401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190195-9b15-4cb4-b359-901ed0e73626 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:51.732485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0190195-9b15-4cb4-b359-901ed0e73626 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.738012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1059/2128] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:03:51.740104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a758d-7572-4fac-8277-f3dc1f2aeb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.740793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a758d-7572-4fac-8277-f3dc1f2aeb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.741135 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a758d-7572-4fac-8277-f3dc1f2aeb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.741411 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a758d-7572-4fac-8277-f3dc1f2aeb88 admin admin] PATH_INFO: `/v3/projects/b5acedb07a0a44339398638851fea04e/users/f8c741e7a5154dd3b5d9822510d54495/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.761988 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a758d-7572-4fac-8277-f3dc1f2aeb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5acedb07a0a44339398638851fea04e, user_id=f8c741e7a5154dd3b5d9822510d54495, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:51.765760 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a758d-7572-4fac-8277-f3dc1f2aeb88 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:51.788103 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1070/2129] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:51 2022] PUT /identity/v3/projects/b5acedb07a0a44339398638851fea04e/users/f8c741e7a5154dd3b5d9822510d54495/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:51.793033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbcbb0-9594-44ac-96c5-5244a96055ae service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:51.805753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbcbb0-9594-44ac-96c5-5244a96055ae service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.891941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab29667-fbf4-4f03-b2c0-c36d142d660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.892666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab29667-fbf4-4f03-b2c0-c36d142d660d admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.893049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab29667-fbf4-4f03-b2c0-c36d142d660d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.893432 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab29667-fbf4-4f03-b2c0-c36d142d660d admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.894188 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab29667-fbf4-4f03-b2c0-c36d142d660d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:51.896255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab29667-fbf4-4f03-b2c0-c36d142d660d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:51.914778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1060/2130] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:03:51.919654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a758d-7572-4fac-8277-f3dc1f2aeb88 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:51.935300 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a758d-7572-4fac-8277-f3dc1f2aeb88 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:51.954824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8df25-8b7c-4fca-95dd-3304f1591e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:51.954824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8df25-8b7c-4fca-95dd-3304f1591e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:51.954824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8df25-8b7c-4fca-95dd-3304f1591e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:51.954824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8df25-8b7c-4fca-95dd-3304f1591e22 admin admin] PATH_INFO: `/v3/projects/b5acedb07a0a44339398638851fea04e/users/f8c741e7a5154dd3b5d9822510d54495/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:51.955186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8df25-8b7c-4fca-95dd-3304f1591e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5acedb07a0a44339398638851fea04e, user_id=f8c741e7a5154dd3b5d9822510d54495, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:51.955186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8df25-8b7c-4fca-95dd-3304f1591e22 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:51.972130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1071/2131] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:51 2022] PUT /identity/v3/projects/b5acedb07a0a44339398638851fea04e/users/f8c741e7a5154dd3b5d9822510d54495/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:52.271661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab29667-fbf4-4f03-b2c0-c36d142d660d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:52.273773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8ab29667-fbf4-4f03-b2c0-c36d142d660d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:52.295061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab29667-fbf4-4f03-b2c0-c36d142d660d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:52.404104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc764a0-efb7-4499-877e-d50f4d8b0612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:52.404968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc764a0-efb7-4499-877e-d50f4d8b0612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:52.405399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc764a0-efb7-4499-877e-d50f4d8b0612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:52.405766 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc764a0-efb7-4499-877e-d50f4d8b0612 admin admin] PATH_INFO: `/v3/projects/a125625a792b43ab8eef18c300334f6b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:52.407301 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc764a0-efb7-4499-877e-d50f4d8b0612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a125625a792b43ab8eef18c300334f6b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:52.410427 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc764a0-efb7-4499-877e-d50f4d8b0612 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:52.451205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:52.475656 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5bc764a0-efb7-4499-877e-d50f4d8b0612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a125625a792b43ab8eef18c300334f6b', 'request_id': 'req-5bc764a0-efb7-4499-877e-d50f4d8b0612'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:52.484795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5bc764a0-efb7-4499-877e-d50f4d8b0612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a125625a792b43ab8eef18c300334f6b', 'request_id': 'req-5bc764a0-efb7-4499-877e-d50f4d8b0612'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:52.495153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5bc764a0-efb7-4499-877e-d50f4d8b0612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a125625a792b43ab8eef18c300334f6b', 'request_id': 'req-5bc764a0-efb7-4499-877e-d50f4d8b0612'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:52.510563 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5bc764a0-efb7-4499-877e-d50f4d8b0612 admin admin] The token cache is being invalidate because project a125625a792b43ab8eef18c300334f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:52.510942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5bc764a0-efb7-4499-877e-d50f4d8b0612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:52.511590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5bc764a0-efb7-4499-877e-d50f4d8b0612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:52.516537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1061/2132] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:52 2022] DELETE /identity/v3/projects/a125625a792b43ab8eef18c300334f6b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:52.518386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5011ffc-4a77-44a0-9258-d09a24324ba4 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:52.518865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5011ffc-4a77-44a0-9258-d09a24324ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:52.518984 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5011ffc-4a77-44a0-9258-d09a24324ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:52.545010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-f5011ffc-4a77-44a0-9258-d09a24324ba4 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:52.546271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f5011ffc-4a77-44a0-9258-d09a24324ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:52.638800 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1072/2133] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:52.647113 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d53e8-c683-4c8a-b64d-f51c6d911326 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:52.647457 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d53e8-c683-4c8a-b64d-f51c6d911326 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:52.647737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d53e8-c683-4c8a-b64d-f51c6d911326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:52.688431 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9d5d53e8-c683-4c8a-b64d-f51c6d911326 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:52.689406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9d5d53e8-c683-4c8a-b64d-f51c6d911326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:52.717434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1062/2134] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:52.721827 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5011ffc-4a77-44a0-9258-d09a24324ba4 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:52.741030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5011ffc-4a77-44a0-9258-d09a24324ba4 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:52.747767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307e9d3-3a7d-4a3c-a111-bcbb7a0ac8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:52.748907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e9d3-3a7d-4a3c-a111-bcbb7a0ac8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:52.749177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e9d3-3a7d-4a3c-a111-bcbb7a0ac8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:52.749595 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e9d3-3a7d-4a3c-a111-bcbb7a0ac8e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:52.750370 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307e9d3-3a7d-4a3c-a111-bcbb7a0ac8e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:52.750892 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307e9d3-3a7d-4a3c-a111-bcbb7a0ac8e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:52.752811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307e9d3-3a7d-4a3c-a111-bcbb7a0ac8e8 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:52.782736 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d53e8-c683-4c8a-b64d-f51c6d911326 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:52.791039 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1073/2135] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:52.800428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d53e8-c683-4c8a-b64d-f51c6d911326 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:52.817404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb31c9-3ac4-445f-9439-7e7fbc31495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:52.818331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb31c9-3ac4-445f-9439-7e7fbc31495e admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:52.818884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb31c9-3ac4-445f-9439-7e7fbc31495e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:52.819305 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb31c9-3ac4-445f-9439-7e7fbc31495e admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:52.820201 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb31c9-3ac4-445f-9439-7e7fbc31495e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:52.822765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb31c9-3ac4-445f-9439-7e7fbc31495e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:52.877117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307e9d3-3a7d-4a3c-a111-bcbb7a0ac8e8 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:52.886976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1063/2136] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:52 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:52.888466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307e9d3-3a7d-4a3c-a111-bcbb7a0ac8e8 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.028866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e3edf-b3b1-4517-8065-aaef206a967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.029642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3edf-b3b1-4517-8065-aaef206a967e admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.030016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3edf-b3b1-4517-8065-aaef206a967e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.031137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3edf-b3b1-4517-8065-aaef206a967e admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.031807 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e3edf-b3b1-4517-8065-aaef206a967e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.048425 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e3edf-b3b1-4517-8065-aaef206a967e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.064467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:53.098642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1074/2137] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:52 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:53.100918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb31c9-3ac4-445f-9439-7e7fbc31495e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:53.117858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb31c9-3ac4-445f-9439-7e7fbc31495e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.129788 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4ef27-4aef-4a91-8af7-a91f03eaf49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.132305 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4ef27-4aef-4a91-8af7-a91f03eaf49b admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.132715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4ef27-4aef-4a91-8af7-a91f03eaf49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.132995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4ef27-4aef-4a91-8af7-a91f03eaf49b admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.136741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4ef27-4aef-4a91-8af7-a91f03eaf49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.140199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4ef27-4aef-4a91-8af7-a91f03eaf49b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.182012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1064/2138] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:53.190822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e3edf-b3b1-4517-8065-aaef206a967e admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:53.218298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e3edf-b3b1-4517-8065-aaef206a967e admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.229924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23092a07-f9ce-4f14-9442-4bd7231c2a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.230668 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23092a07-f9ce-4f14-9442-4bd7231c2a9d admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.230876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23092a07-f9ce-4f14-9442-4bd7231c2a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.231207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23092a07-f9ce-4f14-9442-4bd7231c2a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.231894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23092a07-f9ce-4f14-9442-4bd7231c2a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.234987 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23092a07-f9ce-4f14-9442-4bd7231c2a9d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.250665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1075/2139] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:53.254498 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4ef27-4aef-4a91-8af7-a91f03eaf49b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:53.272966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4ef27-4aef-4a91-8af7-a91f03eaf49b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.280210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7584f-ac71-442f-bcd9-9e5da6036574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.280967 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7584f-ac71-442f-bcd9-9e5da6036574 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.281386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7584f-ac71-442f-bcd9-9e5da6036574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.281750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7584f-ac71-442f-bcd9-9e5da6036574 admin admin] PATH_INFO: `/v3/projects/ae10ecadd1794034abc01cd89748af87/users/7c225e6300f644fa805e4d85948b88bd/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.318843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7584f-ac71-442f-bcd9-9e5da6036574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae10ecadd1794034abc01cd89748af87, user_id=7c225e6300f644fa805e4d85948b88bd, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.321599 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7584f-ac71-442f-bcd9-9e5da6036574 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.346161 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1065/2140] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:53 2022] PUT /identity/v3/projects/ae10ecadd1794034abc01cd89748af87/users/7c225e6300f644fa805e4d85948b88bd/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:53.365583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e658a06-1861-40a2-82ff-d2a56954250e None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.366142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e658a06-1861-40a2-82ff-d2a56954250e None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.366454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e658a06-1861-40a2-82ff-d2a56954250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.406840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-9e658a06-1861-40a2-82ff-d2a56954250e None None] MFA Rules not processed for user `7c225e6300f644fa805e4d85948b88bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:53.409027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9e658a06-1861-40a2-82ff-d2a56954250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:53.495840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1076/2141] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:53.501089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7584f-ac71-442f-bcd9-9e5da6036574 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:53.605425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7584f-ac71-442f-bcd9-9e5da6036574 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.611967 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc562bf-597b-4ea1-aa78-f2e5cef96faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.611967 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc562bf-597b-4ea1-aa78-f2e5cef96faa admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.612303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc562bf-597b-4ea1-aa78-f2e5cef96faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.612669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc562bf-597b-4ea1-aa78-f2e5cef96faa admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.613931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc562bf-597b-4ea1-aa78-f2e5cef96faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.615961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc562bf-597b-4ea1-aa78-f2e5cef96faa admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.659762 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1066/2142] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:53 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:53.664237 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e658a06-1861-40a2-82ff-d2a56954250e None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:53.688849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc562bf-597b-4ea1-aa78-f2e5cef96faa admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:53.691952 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8dc562bf-597b-4ea1-aa78-f2e5cef96faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:53.692729 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e658a06-1861-40a2-82ff-d2a56954250e None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.762788 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:53.804071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc562bf-597b-4ea1-aa78-f2e5cef96faa admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.810950 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4a0b1-3e12-4578-8798-b422c8df9558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.811879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4a0b1-3e12-4578-8798-b422c8df9558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.812324 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4a0b1-3e12-4578-8798-b422c8df9558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.812829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4a0b1-3e12-4578-8798-b422c8df9558 admin admin] PATH_INFO: `/v3/users/0c4177393c6b4f31990a02d459560271` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.814381 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4a0b1-3e12-4578-8798-b422c8df9558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4177393c6b4f31990a02d459560271)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.816283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0199ba6-277d-4560-b8de-77065a966b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.817176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0199ba6-277d-4560-b8de-77065a966b31 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.817584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4a0b1-3e12-4578-8798-b422c8df9558 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.818019 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0199ba6-277d-4560-b8de-77065a966b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.818472 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0199ba6-277d-4560-b8de-77065a966b31 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.819812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0199ba6-277d-4560-b8de-77065a966b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.824771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0199ba6-277d-4560-b8de-77065a966b31 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.863555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1077/2143] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:53 2022] POST /identity/v3/users => generated 295 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:53.865065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0199ba6-277d-4560-b8de-77065a966b31 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:53.877745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0199ba6-277d-4560-b8de-77065a966b31 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.885218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6019530-0e8a-4ebd-b409-71a40923f81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.886137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6019530-0e8a-4ebd-b409-71a40923f81e admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.886644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6019530-0e8a-4ebd-b409-71a40923f81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.887071 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6019530-0e8a-4ebd-b409-71a40923f81e admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.887963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6019530-0e8a-4ebd-b409-71a40923f81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.889964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6019530-0e8a-4ebd-b409-71a40923f81e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.896937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7aa4a0b1-3e12-4578-8798-b422c8df9558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4177393c6b4f31990a02d459560271'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:53.898025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7aa4a0b1-3e12-4578-8798-b422c8df9558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4177393c6b4f31990a02d459560271'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:53.898915 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7aa4a0b1-3e12-4578-8798-b422c8df9558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4177393c6b4f31990a02d459560271'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:53.908957 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1078/2144] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:53.912491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7aa4a0b1-3e12-4578-8798-b422c8df9558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4177393c6b4f31990a02d459560271'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:53.915422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6019530-0e8a-4ebd-b409-71a40923f81e admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:53.919144 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7aa4a0b1-3e12-4578-8798-b422c8df9558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4177393c6b4f31990a02d459560271'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:53.921209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f6019530-0e8a-4ebd-b409-71a40923f81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:53.943621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6019530-0e8a-4ebd-b409-71a40923f81e admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:53.951402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050e763-656d-43f1-9cb4-63855d25cfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:53.954184 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050e763-656d-43f1-9cb4-63855d25cfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.954678 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050e763-656d-43f1-9cb4-63855d25cfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.955113 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050e763-656d-43f1-9cb4-63855d25cfd2 admin admin] PATH_INFO: `/v3/projects/1f2d29f407494c2c9e2f16a45b860483/users/8b3643e544d342c08667899fe1bb0917/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.955606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1067/2145] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:53 2022] DELETE /identity/v3/users/0c4177393c6b4f31990a02d459560271 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:53.957300 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f6614-9460-415c-8710-09a120a14bb2 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:53.957716 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f6614-9460-415c-8710-09a120a14bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:53.958197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f6614-9460-415c-8710-09a120a14bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:53.977661 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050e763-656d-43f1-9cb4-63855d25cfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2d29f407494c2c9e2f16a45b860483, user_id=8b3643e544d342c08667899fe1bb0917, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:53.980920 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050e763-656d-43f1-9cb4-63855d25cfd2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:53.988712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-042f6614-9460-415c-8710-09a120a14bb2 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:53.991147 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-042f6614-9460-415c-8710-09a120a14bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:54.006974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1079/2146] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:53 2022] PUT /identity/v3/projects/1f2d29f407494c2c9e2f16a45b860483/users/8b3643e544d342c08667899fe1bb0917/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:54.011554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050e763-656d-43f1-9cb4-63855d25cfd2 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:54.065974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:54.087700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1068/2147] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:54.099346 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f6614-9460-415c-8710-09a120a14bb2 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:54.101002 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-042f6614-9460-415c-8710-09a120a14bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:54.163422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050e763-656d-43f1-9cb4-63855d25cfd2 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:54.177640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7db040-fad0-4d3a-af3d-cf91629a47a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:54.179713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7db040-fad0-4d3a-af3d-cf91629a47a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:54.180170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7db040-fad0-4d3a-af3d-cf91629a47a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:54.180732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7db040-fad0-4d3a-af3d-cf91629a47a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:54.181664 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7db040-fad0-4d3a-af3d-cf91629a47a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:54.184209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7db040-fad0-4d3a-af3d-cf91629a47a5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:54.199869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1080/2148] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:54.204036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7db040-fad0-4d3a-af3d-cf91629a47a5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:54.216654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f6614-9460-415c-8710-09a120a14bb2 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:54.221970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7db040-fad0-4d3a-af3d-cf91629a47a5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:54.227566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3106fc-28eb-4535-ba75-705870ffc983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:54.228216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3106fc-28eb-4535-ba75-705870ffc983 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:54.228500 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3106fc-28eb-4535-ba75-705870ffc983 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:54.228776 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3106fc-28eb-4535-ba75-705870ffc983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:54.230216 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093fbaa-af97-40cc-b212-c71382bb7cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:54.231229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093fbaa-af97-40cc-b212-c71382bb7cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:54.231786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093fbaa-af97-40cc-b212-c71382bb7cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:54.232292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093fbaa-af97-40cc-b212-c71382bb7cb7 admin admin] PATH_INFO: `/v3/projects/1f2d29f407494c2c9e2f16a45b860483/users/8b3643e544d342c08667899fe1bb0917/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:54.235331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093fbaa-af97-40cc-b212-c71382bb7cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2d29f407494c2c9e2f16a45b860483, user_id=8b3643e544d342c08667899fe1bb0917, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:54.238280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093fbaa-af97-40cc-b212-c71382bb7cb7 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:54.254177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3106fc-28eb-4535-ba75-705870ffc983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:54.256147 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1081/2149] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:54 2022] PUT /identity/v3/projects/1f2d29f407494c2c9e2f16a45b860483/users/8b3643e544d342c08667899fe1bb0917/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:54.259079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3106fc-28eb-4535-ba75-705870ffc983 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:54.268829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:54.276650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e9825-d444-4dd7-8830-0453eac8b7f5 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:54.277255 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e9825-d444-4dd7-8830-0453eac8b7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:54.277851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e9825-d444-4dd7-8830-0453eac8b7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:54.289512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1069/2150] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:54.340684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-a72e9825-d444-4dd7-8830-0453eac8b7f5 None None] MFA Rules not processed for user `8b3643e544d342c08667899fe1bb0917`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:54.345405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a72e9825-d444-4dd7-8830-0453eac8b7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:54.557887 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1082/2151] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:54.593488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3106fc-28eb-4535-ba75-705870ffc983 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:54.595455 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0b3106fc-28eb-4535-ba75-705870ffc983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:54.750933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3106fc-28eb-4535-ba75-705870ffc983 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:54.885958 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dda903-fa03-4f80-9367-87e850dbd754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:54.889388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dda903-fa03-4f80-9367-87e850dbd754 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:54.889836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dda903-fa03-4f80-9367-87e850dbd754 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:54.890188 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dda903-fa03-4f80-9367-87e850dbd754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:54.893490 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-96dda903-fa03-4f80-9367-87e850dbd754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:54.974771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dda903-fa03-4f80-9367-87e850dbd754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:54.976549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dda903-fa03-4f80-9367-87e850dbd754 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:54.988198 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1070/2152] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:55.575710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e9825-d444-4dd7-8830-0453eac8b7f5 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:55.577263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a72e9825-d444-4dd7-8830-0453eac8b7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:55.664270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dda903-fa03-4f80-9367-87e850dbd754 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:55.665718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-96dda903-fa03-4f80-9367-87e850dbd754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:55.755378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e9825-d444-4dd7-8830-0453eac8b7f5 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:55.761230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:55.762051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:55.762431 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:55.762885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] PATH_INFO: `/v3/projects/a1bb560431b845a7adc69fa741579121` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:55.764448 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1bb560431b845a7adc69fa741579121)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:55.767177 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:55.843163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:55.864137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1bb560431b845a7adc69fa741579121', 'request_id': 'req-be8943a4-b938-4bd9-a34c-afe8a814d9b3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:55.878920 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dda903-fa03-4f80-9367-87e850dbd754 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:55.882323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1bb560431b845a7adc69fa741579121', 'request_id': 'req-be8943a4-b938-4bd9-a34c-afe8a814d9b3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:55.901983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1bb560431b845a7adc69fa741579121', 'request_id': 'req-be8943a4-b938-4bd9-a34c-afe8a814d9b3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:55.914498 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:55.934885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] The token cache is being invalidate because project a1bb560431b845a7adc69fa741579121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:55.935187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:55.940184 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:55.944265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1083/2153] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:55 2022] DELETE /identity/v3/projects/a1bb560431b845a7adc69fa741579121 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:55.948508 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:55.952325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:56.043384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a5453-7c5c-43ff-94b3-6a6ff8fe0f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:56.045544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a5453-7c5c-43ff-94b3-6a6ff8fe0f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:56.046466 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a5453-7c5c-43ff-94b3-6a6ff8fe0f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:56.047446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a5453-7c5c-43ff-94b3-6a6ff8fe0f26 admin admin] PATH_INFO: `/v3/users/3c67f6ef99b74499af255d527f6bbe9f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:56.052224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a5453-7c5c-43ff-94b3-6a6ff8fe0f26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c67f6ef99b74499af255d527f6bbe9f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:56.059202 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a5453-7c5c-43ff-94b3-6a6ff8fe0f26 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:56.150526 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8943a4-b938-4bd9-a34c-afe8a814d9b3 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:56.165384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00c631-1754-4a61-8e12-a77ce2181a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:56.166067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00c631-1754-4a61-8e12-a77ce2181a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:56.166349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00c631-1754-4a61-8e12-a77ce2181a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:56.166672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00c631-1754-4a61-8e12-a77ce2181a7a admin admin] PATH_INFO: `/v3/users/b61973bd3faa425895ebc8f57790c876` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:56.171238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00c631-1754-4a61-8e12-a77ce2181a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b61973bd3faa425895ebc8f57790c876)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:56.174910 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00c631-1754-4a61-8e12-a77ce2181a7a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:56.187147 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-673a5453-7c5c-43ff-94b3-6a6ff8fe0f26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c67f6ef99b74499af255d527f6bbe9f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:56.187475 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-673a5453-7c5c-43ff-94b3-6a6ff8fe0f26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c67f6ef99b74499af255d527f6bbe9f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:56.189743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-673a5453-7c5c-43ff-94b3-6a6ff8fe0f26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c67f6ef99b74499af255d527f6bbe9f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:56.205436 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-673a5453-7c5c-43ff-94b3-6a6ff8fe0f26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c67f6ef99b74499af255d527f6bbe9f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:56.218916 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-673a5453-7c5c-43ff-94b3-6a6ff8fe0f26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c67f6ef99b74499af255d527f6bbe9f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:56.253866 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1071/2154] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:55 2022] DELETE /identity/v3/users/3c67f6ef99b74499af255d527f6bbe9f => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:56.264472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde6675-be6d-4d33-b818-2047e4b4e2f4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:56.264758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde6675-be6d-4d33-b818-2047e4b4e2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:56.265103 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde6675-be6d-4d33-b818-2047e4b4e2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:56.278587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5c00c631-1754-4a61-8e12-a77ce2181a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b61973bd3faa425895ebc8f57790c876'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:56.288008 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-dbde6675-be6d-4d33-b818-2047e4b4e2f4 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:56.289781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-dbde6675-be6d-4d33-b818-2047e4b4e2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:56.308636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5c00c631-1754-4a61-8e12-a77ce2181a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b61973bd3faa425895ebc8f57790c876'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:56.319231 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5c00c631-1754-4a61-8e12-a77ce2181a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b61973bd3faa425895ebc8f57790c876'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:56.331119 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5c00c631-1754-4a61-8e12-a77ce2181a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b61973bd3faa425895ebc8f57790c876'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:56.332139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5c00c631-1754-4a61-8e12-a77ce2181a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b61973bd3faa425895ebc8f57790c876'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:56.342624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1084/2155] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:55 2022] DELETE /identity/v3/users/b61973bd3faa425895ebc8f57790c876 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:56.429406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1072/2156] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:56.458581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00c631-1754-4a61-8e12-a77ce2181a7a admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:56.461450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5c00c631-1754-4a61-8e12-a77ce2181a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:56.536465 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:56.555764 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00c631-1754-4a61-8e12-a77ce2181a7a admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:56.585401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658a80a-b434-4280-85d6-1c991679f7ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:56.586204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658a80a-b434-4280-85d6-1c991679f7ca service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:56.586686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658a80a-b434-4280-85d6-1c991679f7ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:56.587099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658a80a-b434-4280-85d6-1c991679f7ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:56.745107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658a80a-b434-4280-85d6-1c991679f7ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:56.748599 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658a80a-b434-4280-85d6-1c991679f7ca service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:56.769963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1085/2157] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:57.060753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde6675-be6d-4d33-b818-2047e4b4e2f4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:57.062297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-dbde6675-be6d-4d33-b818-2047e4b4e2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:57.087575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde6675-be6d-4d33-b818-2047e4b4e2f4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:57.097576 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:57.098852 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:57.099399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:57.099926 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] PATH_INFO: `/v3/projects/1c94e683255d48adaea7e1ca550f59cd` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:57.103872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c94e683255d48adaea7e1ca550f59cd)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:57.108248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:57.181717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:57.206904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c94e683255d48adaea7e1ca550f59cd', 'request_id': 'req-3d1a84fb-74de-4793-b1c1-b7b506b52be2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:57.222780 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c94e683255d48adaea7e1ca550f59cd', 'request_id': 'req-3d1a84fb-74de-4793-b1c1-b7b506b52be2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:57.239723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c94e683255d48adaea7e1ca550f59cd', 'request_id': 'req-3d1a84fb-74de-4793-b1c1-b7b506b52be2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:57.272263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] The token cache is being invalidate because project 1c94e683255d48adaea7e1ca550f59cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:57.272820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:57.279165 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:57.280929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1073/2158] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:57 2022] DELETE /identity/v3/projects/1c94e683255d48adaea7e1ca550f59cd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:57.286229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844bf5e-fdf3-4280-893d-ac76f1cdcfb1 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:57.286498 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844bf5e-fdf3-4280-893d-ac76f1cdcfb1 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:57.286872 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844bf5e-fdf3-4280-893d-ac76f1cdcfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:57.338960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-a844bf5e-fdf3-4280-893d-ac76f1cdcfb1 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:57.341749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a844bf5e-fdf3-4280-893d-ac76f1cdcfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:57.456338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:57.458072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:57.463723 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1086/2159] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:57.473135 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01ce14-8e08-4119-a4d2-469fbe0634ac None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:57.473593 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01ce14-8e08-4119-a4d2-469fbe0634ac None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:57.474257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01ce14-8e08-4119-a4d2-469fbe0634ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:57.481185 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a84fb-74de-4793-b1c1-b7b506b52be2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:57.491752 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06368a-6ad8-46ec-94a4-a3b4b6359a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:57.492756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06368a-6ad8-46ec-94a4-a3b4b6359a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:57.493271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06368a-6ad8-46ec-94a4-a3b4b6359a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:57.493859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06368a-6ad8-46ec-94a4-a3b4b6359a4f admin admin] PATH_INFO: `/v3/users/9dda40c581a74a25a8148b5926555f75` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:57.496015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06368a-6ad8-46ec-94a4-a3b4b6359a4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dda40c581a74a25a8148b5926555f75)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:57.498973 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-dc01ce14-8e08-4119-a4d2-469fbe0634ac None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:57.502095 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-dc01ce14-8e08-4119-a4d2-469fbe0634ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:57.510723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06368a-6ad8-46ec-94a4-a3b4b6359a4f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:57.522397 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1087/2160] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:57.526274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01ce14-8e08-4119-a4d2-469fbe0634ac None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:57.544251 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01ce14-8e08-4119-a4d2-469fbe0634ac None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:57.550845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47f9a6-638c-4f34-9094-6b7b1711e8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:57.551603 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47f9a6-638c-4f34-9094-6b7b1711e8aa admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:57.552342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47f9a6-638c-4f34-9094-6b7b1711e8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:57.554262 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47f9a6-638c-4f34-9094-6b7b1711e8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:57.555554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47f9a6-638c-4f34-9094-6b7b1711e8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:03:57.555554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47f9a6-638c-4f34-9094-6b7b1711e8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:57.558445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47f9a6-638c-4f34-9094-6b7b1711e8aa admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:57.578225 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1088/2161] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:03:57.582555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47f9a6-638c-4f34-9094-6b7b1711e8aa admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:57.601084 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47f9a6-638c-4f34-9094-6b7b1711e8aa admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:57.607509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0f06368a-6ad8-46ec-94a4-a3b4b6359a4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dda40c581a74a25a8148b5926555f75'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:57.608370 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0f06368a-6ad8-46ec-94a4-a3b4b6359a4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dda40c581a74a25a8148b5926555f75'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:57.609057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0f06368a-6ad8-46ec-94a4-a3b4b6359a4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dda40c581a74a25a8148b5926555f75'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:57.611436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1527b-63aa-4608-9392-91736157c4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:57.612351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1527b-63aa-4608-9392-91736157c4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:57.612670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1527b-63aa-4608-9392-91736157c4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:57.612940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1527b-63aa-4608-9392-91736157c4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:57.613577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1527b-63aa-4608-9392-91736157c4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:57.615552 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1527b-63aa-4608-9392-91736157c4e2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:57.617966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0f06368a-6ad8-46ec-94a4-a3b4b6359a4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dda40c581a74a25a8148b5926555f75'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:57.628359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0f06368a-6ad8-46ec-94a4-a3b4b6359a4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dda40c581a74a25a8148b5926555f75'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:57.654248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1074/2162] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:57 2022] DELETE /identity/v3/users/9dda40c581a74a25a8148b5926555f75 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:57.659012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7f6d-2b76-4078-bfda-a89c4438ffc8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:57.659957 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7f6d-2b76-4078-bfda-a89c4438ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:57.660516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7f6d-2b76-4078-bfda-a89c4438ffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:57.679544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1089/2163] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:57 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:03:57.683236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1527b-63aa-4608-9392-91736157c4e2 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:57.688117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d8d1527b-63aa-4608-9392-91736157c4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:57.692932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0c9b7f6d-2b76-4078-bfda-a89c4438ffc8 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:57.694370 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0c9b7f6d-2b76-4078-bfda-a89c4438ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:57.770969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1075/2164] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:57.787536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b7f6d-2b76-4078-bfda-a89c4438ffc8 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:57.794745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0c9b7f6d-2b76-4078-bfda-a89c4438ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:57.831036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:57.863586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1527b-63aa-4608-9392-91736157c4e2 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:57.865518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:57.887618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124115ff-00e4-4d0f-8374-f39f27a28a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:57.888067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124115ff-00e4-4d0f-8374-f39f27a28a75 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:57.888585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124115ff-00e4-4d0f-8374-f39f27a28a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:57.890387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124115ff-00e4-4d0f-8374-f39f27a28a75 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:57.891080 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124115ff-00e4-4d0f-8374-f39f27a28a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:57.900330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124115ff-00e4-4d0f-8374-f39f27a28a75 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:57.919055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b7f6d-2b76-4078-bfda-a89c4438ffc8 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:57.926252 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee9b52-be78-4eae-8d5c-45fdf18af5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:57.927542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9b52-be78-4eae-8d5c-45fdf18af5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:57.928051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9b52-be78-4eae-8d5c-45fdf18af5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:57.928663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9b52-be78-4eae-8d5c-45fdf18af5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:57.944386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee9b52-be78-4eae-8d5c-45fdf18af5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:57.946885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee9b52-be78-4eae-8d5c-45fdf18af5d4 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:57.966895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1090/2165] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:57 2022] POST /identity/v3/users => generated 283 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:57.966895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124115ff-00e4-4d0f-8374-f39f27a28a75 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:57.971119 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-124115ff-00e4-4d0f-8374-f39f27a28a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:57.972536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1076/2166] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:57.973353 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee9b52-be78-4eae-8d5c-45fdf18af5d4 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:57.986906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124115ff-00e4-4d0f-8374-f39f27a28a75 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:57.991977 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee9b52-be78-4eae-8d5c-45fdf18af5d4 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:57.993858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:57.996340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:57.996799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:57.997174 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] PATH_INFO: `/v3/projects/99b27b5e28004d74bee9e633b775061b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:57.998724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b27b5e28004d74bee9e633b775061b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:58.001774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:58.014208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8f570-ad86-4744-83f9-50cea9ba1880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:58.016896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8f570-ad86-4744-83f9-50cea9ba1880 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:58.017548 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8f570-ad86-4744-83f9-50cea9ba1880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:58.017548 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8f570-ad86-4744-83f9-50cea9ba1880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:58.018401 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8f570-ad86-4744-83f9-50cea9ba1880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:58.020270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8f570-ad86-4744-83f9-50cea9ba1880 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:58.045125 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1077/2167] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:58.052450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8f570-ad86-4744-83f9-50cea9ba1880 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:58.076904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8f570-ad86-4744-83f9-50cea9ba1880 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:58.086587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750bbd1-1f7a-4787-849c-f35ce4386d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:58.088587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750bbd1-1f7a-4787-849c-f35ce4386d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:58.090406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750bbd1-1f7a-4787-849c-f35ce4386d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:58.090834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750bbd1-1f7a-4787-849c-f35ce4386d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:58.093319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750bbd1-1f7a-4787-849c-f35ce4386d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:58.097894 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750bbd1-1f7a-4787-849c-f35ce4386d20 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:58.117963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b27b5e28004d74bee9e633b775061b', 'request_id': 'req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:58.133654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1078/2168] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:58.134371 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b27b5e28004d74bee9e633b775061b', 'request_id': 'req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:58.135700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750bbd1-1f7a-4787-849c-f35ce4386d20 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:58.138416 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d750bbd1-1f7a-4787-849c-f35ce4386d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:58.145462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b27b5e28004d74bee9e633b775061b', 'request_id': 'req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:58.162757 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] The token cache is being invalidate because project 99b27b5e28004d74bee9e633b775061b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:58.164047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:58.165365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:58.179661 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1091/2169] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:57 2022] DELETE /identity/v3/projects/99b27b5e28004d74bee9e633b775061b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:58.181124 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:58.207166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:58.343310 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750bbd1-1f7a-4787-849c-f35ce4386d20 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:58.381078 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc15b9-4ee8-4a0e-88b8-532d4ed69c51 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:58.394334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb869b70-83b5-4e30-8191-549e1f364658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:58.395078 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869b70-83b5-4e30-8191-549e1f364658 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:58.395663 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869b70-83b5-4e30-8191-549e1f364658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:58.395964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869b70-83b5-4e30-8191-549e1f364658 admin admin] PATH_INFO: `/v3/projects/d17f944fbc17441db3df69dcefa703c7/users/267a22b836f74446b1f813c99f7588d0/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:58.431305 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb869b70-83b5-4e30-8191-549e1f364658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17f944fbc17441db3df69dcefa703c7, user_id=267a22b836f74446b1f813c99f7588d0, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:58.434307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb869b70-83b5-4e30-8191-549e1f364658 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:58.461669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1092/2170] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:58 2022] PUT /identity/v3/projects/d17f944fbc17441db3df69dcefa703c7/users/267a22b836f74446b1f813c99f7588d0/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:58.477280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3b54f-9d86-4b1e-9510-677abe323a0c None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:58.478407 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3b54f-9d86-4b1e-9510-677abe323a0c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:58.479550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3b54f-9d86-4b1e-9510-677abe323a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:58.483615 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4f51c-6578-4c16-a0fb-c28d13738674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:58.484365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4f51c-6578-4c16-a0fb-c28d13738674 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:58.484856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4f51c-6578-4c16-a0fb-c28d13738674 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:58.485321 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4f51c-6578-4c16-a0fb-c28d13738674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:58.488389 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-58e4f51c-6578-4c16-a0fb-c28d13738674 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:58.541409 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-0fd3b54f-9d86-4b1e-9510-677abe323a0c None None] MFA Rules not processed for user `267a22b836f74446b1f813c99f7588d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:58.543073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0fd3b54f-9d86-4b1e-9510-677abe323a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:58.606777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:58.625684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4f51c-6578-4c16-a0fb-c28d13738674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:58.627213 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4f51c-6578-4c16-a0fb-c28d13738674 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:58.639633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1079/2171] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:03:58.662086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4f51c-6578-4c16-a0fb-c28d13738674 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:58.662831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1093/2172] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:58.680941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4f51c-6578-4c16-a0fb-c28d13738674 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:58.701410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:58.768078 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb9215-430f-4983-8bfb-b85b0eabbcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:58.768710 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb9215-430f-4983-8bfb-b85b0eabbcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:58.769428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb9215-430f-4983-8bfb-b85b0eabbcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:58.769428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb9215-430f-4983-8bfb-b85b0eabbcf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:58.769879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb9215-430f-4983-8bfb-b85b0eabbcf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:58.772474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb9215-430f-4983-8bfb-b85b0eabbcf7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:58.787809 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3b54f-9d86-4b1e-9510-677abe323a0c None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:58.791118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0fd3b54f-9d86-4b1e-9510-677abe323a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:58.816346 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3b54f-9d86-4b1e-9510-677abe323a0c None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:58.823607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1080/2173] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:03:58 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:58.826816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb9215-430f-4983-8bfb-b85b0eabbcf7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:58.829558 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:58.830337 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:58.830748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:58.831134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] PATH_INFO: `/v3/projects/5c75d565f0cd4e629015de1e47766fea` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:58.832573 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c75d565f0cd4e629015de1e47766fea)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:58.835552 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:58.952990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c75d565f0cd4e629015de1e47766fea', 'request_id': 'req-80101f24-9600-4b16-b3af-2d15d8820499'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:58.976000 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb9215-430f-4983-8bfb-b85b0eabbcf7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:58.977016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c75d565f0cd4e629015de1e47766fea', 'request_id': 'req-80101f24-9600-4b16-b3af-2d15d8820499'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:58.998971 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c75d565f0cd4e629015de1e47766fea', 'request_id': 'req-80101f24-9600-4b16-b3af-2d15d8820499'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:59.031399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] The token cache is being invalidate because project 5c75d565f0cd4e629015de1e47766fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:03:59.031977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:59.035099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:59.037372 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1094/2174] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:03:58 2022] DELETE /identity/v3/projects/5c75d565f0cd4e629015de1e47766fea => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:59.042492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:59.045548 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:59.113184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff488b-4e10-40a5-b031-6d0e29288542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:59.114281 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff488b-4e10-40a5-b031-6d0e29288542 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:59.115790 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff488b-4e10-40a5-b031-6d0e29288542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:59.116419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff488b-4e10-40a5-b031-6d0e29288542 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:59.117302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff488b-4e10-40a5-b031-6d0e29288542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:59.119867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff488b-4e10-40a5-b031-6d0e29288542 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:59.157137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1081/2175] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:03:58 2022] POST /identity/v3/users => generated 289 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:03:59.161704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff488b-4e10-40a5-b031-6d0e29288542 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:59.174964 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-02ff488b-4e10-40a5-b031-6d0e29288542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:59.200535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff488b-4e10-40a5-b031-6d0e29288542 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:59.207271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3cf47-107e-4ee3-b09a-8befb9f6a7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:59.207914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3cf47-107e-4ee3-b09a-8befb9f6a7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:59.208193 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3cf47-107e-4ee3-b09a-8befb9f6a7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:59.208529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3cf47-107e-4ee3-b09a-8befb9f6a7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:59.209201 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3cf47-107e-4ee3-b09a-8befb9f6a7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:59.211028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3cf47-107e-4ee3-b09a-8befb9f6a7a4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:59.243577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1082/2176] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:59.247693 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3cf47-107e-4ee3-b09a-8befb9f6a7a4 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:59.270483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3cf47-107e-4ee3-b09a-8befb9f6a7a4 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:59.282100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78d46f-bb56-49ca-8ab5-2618418851c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:59.291632 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80101f24-9600-4b16-b3af-2d15d8820499 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:59.295744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78d46f-bb56-49ca-8ab5-2618418851c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:59.296763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78d46f-bb56-49ca-8ab5-2618418851c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:59.297737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78d46f-bb56-49ca-8ab5-2618418851c4 admin admin] PATH_INFO: `/v3/projects/bd67d1e9f08a417f94fa6eaaae1f753b/users/589820a9c8f74fa2bf84a7bd9623918f/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:59.309008 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b9c20-4322-42d4-9086-1b426b6cd7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:59.309772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b9c20-4322-42d4-9086-1b426b6cd7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:59.310060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b9c20-4322-42d4-9086-1b426b6cd7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:59.310386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b9c20-4322-42d4-9086-1b426b6cd7c0 admin admin] PATH_INFO: `/v3/users/ff4e015b88d148a19876c7de875d2ff3` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:59.311771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b9c20-4322-42d4-9086-1b426b6cd7c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4e015b88d148a19876c7de875d2ff3)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:59.313866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b9c20-4322-42d4-9086-1b426b6cd7c0 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:59.334574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78d46f-bb56-49ca-8ab5-2618418851c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd67d1e9f08a417f94fa6eaaae1f753b, user_id=589820a9c8f74fa2bf84a7bd9623918f, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:59.343084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78d46f-bb56-49ca-8ab5-2618418851c4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:59.403448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1083/2177] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:59 2022] PUT /identity/v3/projects/bd67d1e9f08a417f94fa6eaaae1f753b/users/589820a9c8f74fa2bf84a7bd9623918f/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:59.406159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e49b9c20-4322-42d4-9086-1b426b6cd7c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4e015b88d148a19876c7de875d2ff3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:59.408428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78d46f-bb56-49ca-8ab5-2618418851c4 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:59.420540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:59.421318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:03:59.426647 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e49b9c20-4322-42d4-9086-1b426b6cd7c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4e015b88d148a19876c7de875d2ff3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:59.439387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e49b9c20-4322-42d4-9086-1b426b6cd7c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4e015b88d148a19876c7de875d2ff3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:59.453962 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e49b9c20-4322-42d4-9086-1b426b6cd7c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4e015b88d148a19876c7de875d2ff3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:59.455004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e49b9c20-4322-42d4-9086-1b426b6cd7c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4e015b88d148a19876c7de875d2ff3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:03:59.462879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1095/2178] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:03:59 2022] DELETE /identity/v3/users/ff4e015b88d148a19876c7de875d2ff3 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:03:59.508997 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78d46f-bb56-49ca-8ab5-2618418851c4 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:59.653430 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f831239-85b9-4424-bebc-0c5daa318519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:59.654563 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f831239-85b9-4424-bebc-0c5daa318519 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:59.655026 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f831239-85b9-4424-bebc-0c5daa318519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:59.655483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f831239-85b9-4424-bebc-0c5daa318519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:59.656470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f831239-85b9-4424-bebc-0c5daa318519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:59.663479 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f831239-85b9-4424-bebc-0c5daa318519 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:59.684670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1084/2179] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:03:59.685901 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b9c20-4322-42d4-9086-1b426b6cd7c0 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:59.688124 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e49b9c20-4322-42d4-9086-1b426b6cd7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:59.704518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b9c20-4322-42d4-9086-1b426b6cd7c0 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:59.710571 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7c28c-5e08-4a0a-a326-22678fcba85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:59.711281 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7c28c-5e08-4a0a-a326-22678fcba85d admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:59.711554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7c28c-5e08-4a0a-a326-22678fcba85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:59.711824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7c28c-5e08-4a0a-a326-22678fcba85d admin admin] PATH_INFO: `/v3/projects/bd67d1e9f08a417f94fa6eaaae1f753b/users/589820a9c8f74fa2bf84a7bd9623918f/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:59.713881 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7c28c-5e08-4a0a-a326-22678fcba85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd67d1e9f08a417f94fa6eaaae1f753b, user_id=589820a9c8f74fa2bf84a7bd9623918f, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:59.716505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7c28c-5e08-4a0a-a326-22678fcba85d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:59.729708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1096/2180] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:03:59 2022] PUT /identity/v3/projects/bd67d1e9f08a417f94fa6eaaae1f753b/users/589820a9c8f74fa2bf84a7bd9623918f/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:03:59.740488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a10d0-61a8-40f1-a432-77482c72b064 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:59.741951 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a10d0-61a8-40f1-a432-77482c72b064 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:59.742348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a10d0-61a8-40f1-a432-77482c72b064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:59.788730 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-560a10d0-61a8-40f1-a432-77482c72b064 None None] MFA Rules not processed for user `589820a9c8f74fa2bf84a7bd9623918f`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:03:59.789967 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-560a10d0-61a8-40f1-a432-77482c72b064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:59.870928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1085/2181] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:03:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:03:59.883823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7c28c-5e08-4a0a-a326-22678fcba85d admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:03:59.885770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f7f7c28c-5e08-4a0a-a326-22678fcba85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:03:59.955770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7c28c-5e08-4a0a-a326-22678fcba85d admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:03:59.964488 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f93c66-e831-4627-9ff3-651af45831a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:03:59.965423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f93c66-e831-4627-9ff3-651af45831a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:03:59.965701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f93c66-e831-4627-9ff3-651af45831a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:03:59.965982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f93c66-e831-4627-9ff3-651af45831a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:03:59.981079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f93c66-e831-4627-9ff3-651af45831a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:03:59.982541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f93c66-e831-4627-9ff3-651af45831a7 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:03:59.994056 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1097/2182] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:03:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:00.003605 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a10d0-61a8-40f1-a432-77482c72b064 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:00.005079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-560a10d0-61a8-40f1-a432-77482c72b064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:00.075119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:00.130499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a10d0-61a8-40f1-a432-77482c72b064 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:00.140668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97874457-8557-4d7a-9a3d-9e5208b29076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:00.141438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97874457-8557-4d7a-9a3d-9e5208b29076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:00.141779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97874457-8557-4d7a-9a3d-9e5208b29076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:00.142116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97874457-8557-4d7a-9a3d-9e5208b29076 admin admin] PATH_INFO: `/v3/projects/f90376e1ad3640a4b3d72fee32f00b5f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:00.144030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97874457-8557-4d7a-9a3d-9e5208b29076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90376e1ad3640a4b3d72fee32f00b5f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:00.147367 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97874457-8557-4d7a-9a3d-9e5208b29076 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:00.257611 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-97874457-8557-4d7a-9a3d-9e5208b29076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90376e1ad3640a4b3d72fee32f00b5f', 'request_id': 'req-97874457-8557-4d7a-9a3d-9e5208b29076'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.264807 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-97874457-8557-4d7a-9a3d-9e5208b29076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90376e1ad3640a4b3d72fee32f00b5f', 'request_id': 'req-97874457-8557-4d7a-9a3d-9e5208b29076'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.285628 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-97874457-8557-4d7a-9a3d-9e5208b29076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90376e1ad3640a4b3d72fee32f00b5f', 'request_id': 'req-97874457-8557-4d7a-9a3d-9e5208b29076'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.304134 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-97874457-8557-4d7a-9a3d-9e5208b29076 admin admin] The token cache is being invalidate because project f90376e1ad3640a4b3d72fee32f00b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:00.304421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-97874457-8557-4d7a-9a3d-9e5208b29076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.308591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-97874457-8557-4d7a-9a3d-9e5208b29076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.320079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1086/2183] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:00 2022] DELETE /identity/v3/projects/f90376e1ad3640a4b3d72fee32f00b5f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:00.328567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1865ab-be46-45e8-a16e-e4be7585d90d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:00.328877 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1865ab-be46-45e8-a16e-e4be7585d90d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:00.329218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1865ab-be46-45e8-a16e-e4be7585d90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:00.362824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-4f1865ab-be46-45e8-a16e-e4be7585d90d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:00.364561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4f1865ab-be46-45e8-a16e-e4be7585d90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:00.405847 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b340-c689-4467-b3d6-3f4fe1c1c10e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:00.406495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b340-c689-4467-b3d6-3f4fe1c1c10e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:00.406991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b340-c689-4467-b3d6-3f4fe1c1c10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:00.489018 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1098/2184] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:00.497105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf6061-13da-41df-ace9-b8c3ab53107a None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:00.498061 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf6061-13da-41df-ace9-b8c3ab53107a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:00.499250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf6061-13da-41df-ace9-b8c3ab53107a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:00.505534 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b273b340-c689-4467-b3d6-3f4fe1c1c10e None None] MFA Rules not processed for user `f8c741e7a5154dd3b5d9822510d54495`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:00.509386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b273b340-c689-4467-b3d6-3f4fe1c1c10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:00.561085 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1fdf6061-13da-41df-ace9-b8c3ab53107a None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:00.563260 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1fdf6061-13da-41df-ace9-b8c3ab53107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:00.578159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1099/2185] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:00.582066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf6061-13da-41df-ace9-b8c3ab53107a None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:00.593828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf6061-13da-41df-ace9-b8c3ab53107a None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:00.599824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac2fbc-e61b-4cda-ad21-c993c6cd6d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:00.600521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac2fbc-e61b-4cda-ad21-c993c6cd6d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:00.600801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac2fbc-e61b-4cda-ad21-c993c6cd6d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:00.601100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac2fbc-e61b-4cda-ad21-c993c6cd6d3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:00.601803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac2fbc-e61b-4cda-ad21-c993c6cd6d3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:00.602101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac2fbc-e61b-4cda-ad21-c993c6cd6d3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:00.603954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac2fbc-e61b-4cda-ad21-c993c6cd6d3e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:00.623064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1100/2186] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:04:00.627900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac2fbc-e61b-4cda-ad21-c993c6cd6d3e admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:00.632271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1087/2187] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:00.646939 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac2fbc-e61b-4cda-ad21-c993c6cd6d3e admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:00.651239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273b340-c689-4467-b3d6-3f4fe1c1c10e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:00.653588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b273b340-c689-4467-b3d6-3f4fe1c1c10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:00.655833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdcaf9-0ae4-412b-9ce9-820a8fdce7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:00.658360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdcaf9-0ae4-412b-9ce9-820a8fdce7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:00.660058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdcaf9-0ae4-412b-9ce9-820a8fdce7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:00.660564 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdcaf9-0ae4-412b-9ce9-820a8fdce7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:00.661267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdcaf9-0ae4-412b-9ce9-820a8fdce7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:00.665674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdcaf9-0ae4-412b-9ce9-820a8fdce7e1 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:00.710265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1101/2188] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:00 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:00.714877 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdcaf9-0ae4-412b-9ce9-820a8fdce7e1 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:00.734204 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:00.758070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:00.775493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273b340-c689-4467-b3d6-3f4fe1c1c10e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:00.796051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdcaf9-0ae4-412b-9ce9-820a8fdce7e1 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:00.801463 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd3ba0-6848-422f-87a2-37ba69dc9855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:00.802086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd3ba0-6848-422f-87a2-37ba69dc9855 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:00.802369 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd3ba0-6848-422f-87a2-37ba69dc9855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:00.802678 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd3ba0-6848-422f-87a2-37ba69dc9855 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:00.803407 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd3ba0-6848-422f-87a2-37ba69dc9855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:00.805372 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd3ba0-6848-422f-87a2-37ba69dc9855 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:00.827542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e6a8b-1da9-4c06-90f0-fd1cbf1fab75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7c46f4dc084a948bd09ca9b86c2748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:00.828249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e6a8b-1da9-4c06-90f0-fd1cbf1fab75 service glance] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:00.828600 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e6a8b-1da9-4c06-90f0-fd1cbf1fab75 service glance] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:00.828759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1102/2189] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:00 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:00.828979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e6a8b-1da9-4c06-90f0-fd1cbf1fab75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:00.829585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd3ba0-6848-422f-87a2-37ba69dc9855 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:00.831104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1c4e6a8b-1da9-4c06-90f0-fd1cbf1fab75 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:00.831345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-2acd3ba0-6848-422f-87a2-37ba69dc9855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:00.843952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd3ba0-6848-422f-87a2-37ba69dc9855 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:00.848731 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4503a0-7eb8-4f4c-aed1-aa2b2bc5531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:00.849377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4503a0-7eb8-4f4c-aed1-aa2b2bc5531c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:00.849660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4503a0-7eb8-4f4c-aed1-aa2b2bc5531c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:00.849932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4503a0-7eb8-4f4c-aed1-aa2b2bc5531c admin admin] PATH_INFO: `/v3/users/267a22b836f74446b1f813c99f7588d0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:00.851159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4503a0-7eb8-4f4c-aed1-aa2b2bc5531c admin admin] RBAC: Authorizing `identity:delete_user(user_id=267a22b836f74446b1f813c99f7588d0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:00.853111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4503a0-7eb8-4f4c-aed1-aa2b2bc5531c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:00.896657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e6a8b-1da9-4c06-90f0-fd1cbf1fab75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:00.898199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e6a8b-1da9-4c06-90f0-fd1cbf1fab75 service glance] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:00.903445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8c4503a0-7eb8-4f4c-aed1-aa2b2bc5531c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267a22b836f74446b1f813c99f7588d0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.907712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1088/2190] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:00.908533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e6a8b-1da9-4c06-90f0-fd1cbf1fab75 service glance] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:00.917606 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8c4503a0-7eb8-4f4c-aed1-aa2b2bc5531c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267a22b836f74446b1f813c99f7588d0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.919149 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e6a8b-1da9-4c06-90f0-fd1cbf1fab75 service glance] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:00.924057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0fa30-ea82-4b79-bd6a-ec09eaae5723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:00.924685 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0fa30-ea82-4b79-bd6a-ec09eaae5723 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:00.924945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0fa30-ea82-4b79-bd6a-ec09eaae5723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:00.925219 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0fa30-ea82-4b79-bd6a-ec09eaae5723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:00.925871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0fa30-ea82-4b79-bd6a-ec09eaae5723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:00.927133 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8c4503a0-7eb8-4f4c-aed1-aa2b2bc5531c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267a22b836f74446b1f813c99f7588d0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.927522 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0fa30-ea82-4b79-bd6a-ec09eaae5723 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:00.936504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8c4503a0-7eb8-4f4c-aed1-aa2b2bc5531c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267a22b836f74446b1f813c99f7588d0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.937307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8c4503a0-7eb8-4f4c-aed1-aa2b2bc5531c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267a22b836f74446b1f813c99f7588d0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:00.938932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1089/2191] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:00.943126 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0fa30-ea82-4b79-bd6a-ec09eaae5723 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:00.944928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b2e0fa30-ea82-4b79-bd6a-ec09eaae5723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:00.949180 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1103/2192] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:00 2022] DELETE /identity/v3/users/267a22b836f74446b1f813c99f7588d0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:00.953190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64737bfc-b8cc-4036-aa37-598a2f240d41 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:00.953476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64737bfc-b8cc-4036-aa37-598a2f240d41 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:00.953747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64737bfc-b8cc-4036-aa37-598a2f240d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:00.964302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0fa30-ea82-4b79-bd6a-ec09eaae5723 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:00.984978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-64737bfc-b8cc-4036-aa37-598a2f240d41 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:00.988169 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-64737bfc-b8cc-4036-aa37-598a2f240d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:01.064268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047753e-43a2-4e39-9b8c-6b708bda22b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:01.065133 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047753e-43a2-4e39-9b8c-6b708bda22b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:01.065455 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047753e-43a2-4e39-9b8c-6b708bda22b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:01.065692 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047753e-43a2-4e39-9b8c-6b708bda22b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:01.066555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047753e-43a2-4e39-9b8c-6b708bda22b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:01.068161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1104/2193] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:01.068376 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047753e-43a2-4e39-9b8c-6b708bda22b2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:01.079330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64737bfc-b8cc-4036-aa37-598a2f240d41 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:01.082414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-64737bfc-b8cc-4036-aa37-598a2f240d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:01.085289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1090/2194] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:01.086887 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484b476-68cd-45e9-9f65-c8d79a2654c5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:01.087184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484b476-68cd-45e9-9f65-c8d79a2654c5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:01.087463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484b476-68cd-45e9-9f65-c8d79a2654c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:01.118977 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0484b476-68cd-45e9-9f65-c8d79a2654c5 None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:01.120988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0484b476-68cd-45e9-9f65-c8d79a2654c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:01.126707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:01.160991 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64737bfc-b8cc-4036-aa37-598a2f240d41 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:01.162507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:01.166325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156dd03-ec55-4be6-871e-851b40e89549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:01.167067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156dd03-ec55-4be6-871e-851b40e89549 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:01.167345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156dd03-ec55-4be6-871e-851b40e89549 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:01.167615 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156dd03-ec55-4be6-871e-851b40e89549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:01.177600 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156dd03-ec55-4be6-871e-851b40e89549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:01.179102 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156dd03-ec55-4be6-871e-851b40e89549 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:01.199926 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1105/2195] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:01.205062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1091/2196] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 16:04:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:01.210821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156dd03-ec55-4be6-871e-851b40e89549 service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:01.222888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156dd03-ec55-4be6-871e-851b40e89549 service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:01.235878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbc5ba-0a7c-4a4e-8a53-377ad13cfc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:01.236660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbc5ba-0a7c-4a4e-8a53-377ad13cfc24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:01.237014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbc5ba-0a7c-4a4e-8a53-377ad13cfc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:01.237361 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbc5ba-0a7c-4a4e-8a53-377ad13cfc24 admin admin] PATH_INFO: `/v3/projects/fbfa5a69300c4975875ff7e363fba388/users/30b8518ab9e74a1798426049084009a0/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:01.255708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbc5ba-0a7c-4a4e-8a53-377ad13cfc24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbfa5a69300c4975875ff7e363fba388, user_id=30b8518ab9e74a1798426049084009a0, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:01.259030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbc5ba-0a7c-4a4e-8a53-377ad13cfc24 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:01.271216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484b476-68cd-45e9-9f65-c8d79a2654c5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:01.272860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0484b476-68cd-45e9-9f65-c8d79a2654c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:01.279111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1106/2197] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:01 2022] PUT /identity/v3/projects/fbfa5a69300c4975875ff7e363fba388/users/30b8518ab9e74a1798426049084009a0/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:01.299375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22cc47-e36a-481a-bfb6-6a852ac7a485 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:01.299667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22cc47-e36a-481a-bfb6-6a852ac7a485 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:01.306364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22cc47-e36a-481a-bfb6-6a852ac7a485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:01.370391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-eb22cc47-e36a-481a-bfb6-6a852ac7a485 None None] MFA Rules not processed for user `30b8518ab9e74a1798426049084009a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:01.372120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-eb22cc47-e36a-481a-bfb6-6a852ac7a485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:01.412257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484b476-68cd-45e9-9f65-c8d79a2654c5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:01.517538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1107/2198] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:01.524665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597855de-172c-4619-bc64-b5fa9425f8b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:01.525222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22cc47-e36a-481a-bfb6-6a852ac7a485 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:01.525497 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597855de-172c-4619-bc64-b5fa9425f8b3 service swift] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:01.525780 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597855de-172c-4619-bc64-b5fa9425f8b3 service swift] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:01.526049 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597855de-172c-4619-bc64-b5fa9425f8b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:01.527926 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-eb22cc47-e36a-481a-bfb6-6a852ac7a485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:01.623090 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597855de-172c-4619-bc64-b5fa9425f8b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:01.624930 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597855de-172c-4619-bc64-b5fa9425f8b3 service swift] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:01.642533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1092/2199] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:04:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 16:04:01.654413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22cc47-e36a-481a-bfb6-6a852ac7a485 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:01.660166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02e0a8-e9c0-499f-a3e4-d44c1aafba98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:01.661087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02e0a8-e9c0-499f-a3e4-d44c1aafba98 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:01.661543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02e0a8-e9c0-499f-a3e4-d44c1aafba98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:01.661896 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02e0a8-e9c0-499f-a3e4-d44c1aafba98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:01.662003 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597855de-172c-4619-bc64-b5fa9425f8b3 service swift] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:01.663574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-597855de-172c-4619-bc64-b5fa9425f8b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:01.691545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02e0a8-e9c0-499f-a3e4-d44c1aafba98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:01.693529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:01.694256 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02e0a8-e9c0-499f-a3e4-d44c1aafba98 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:01.723984 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1108/2200] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:01.822052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597855de-172c-4619-bc64-b5fa9425f8b3 service swift] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:01.831357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:01.832387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:01.833055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:01.833557 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] PATH_INFO: `/v3/projects/d17f944fbc17441db3df69dcefa703c7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:01.835947 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17f944fbc17441db3df69dcefa703c7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:01.839057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:01.978273 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17f944fbc17441db3df69dcefa703c7', 'request_id': 'req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.025002 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17f944fbc17441db3df69dcefa703c7', 'request_id': 'req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.050299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17f944fbc17441db3df69dcefa703c7', 'request_id': 'req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.089238 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] The token cache is being invalidate because project d17f944fbc17441db3df69dcefa703c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:02.089794 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.110999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.127932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1093/2201] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:01 2022] DELETE /identity/v3/projects/d17f944fbc17441db3df69dcefa703c7 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:02.132703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02e0a8-e9c0-499f-a3e4-d44c1aafba98 service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:02.193118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02e0a8-e9c0-499f-a3e4-d44c1aafba98 service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:02.302836 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:02.358732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84d9a7-a236-4a4c-84f5-c9eee399449f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:02.359485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84d9a7-a236-4a4c-84f5-c9eee399449f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:02.359882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84d9a7-a236-4a4c-84f5-c9eee399449f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:02.360219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84d9a7-a236-4a4c-84f5-c9eee399449f admin admin] PATH_INFO: `/v3/users/589820a9c8f74fa2bf84a7bd9623918f` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:02.361533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84d9a7-a236-4a4c-84f5-c9eee399449f admin admin] RBAC: Authorizing `identity:delete_user(user_id=589820a9c8f74fa2bf84a7bd9623918f)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:02.364317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84d9a7-a236-4a4c-84f5-c9eee399449f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:02.429842 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5e84d9a7-a236-4a4c-84f5-c9eee399449f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589820a9c8f74fa2bf84a7bd9623918f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.447225 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5e84d9a7-a236-4a4c-84f5-c9eee399449f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589820a9c8f74fa2bf84a7bd9623918f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.459728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5e84d9a7-a236-4a4c-84f5-c9eee399449f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589820a9c8f74fa2bf84a7bd9623918f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.470661 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5e84d9a7-a236-4a4c-84f5-c9eee399449f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589820a9c8f74fa2bf84a7bd9623918f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.471910 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5e84d9a7-a236-4a4c-84f5-c9eee399449f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589820a9c8f74fa2bf84a7bd9623918f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:02.479970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1109/2202] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:02 2022] DELETE /identity/v3/users/589820a9c8f74fa2bf84a7bd9623918f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:02.886158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:02.889271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:02.924312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcdf32-6fbf-4d5a-a75d-a3b6513154f6 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:03.018903 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce39b7-f7a3-49d0-898c-65fe38e2457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:03.020077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce39b7-f7a3-49d0-898c-65fe38e2457c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:03.020634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce39b7-f7a3-49d0-898c-65fe38e2457c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:03.021012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce39b7-f7a3-49d0-898c-65fe38e2457c admin admin] PATH_INFO: `/v3/projects/bd67d1e9f08a417f94fa6eaaae1f753b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:03.022561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce39b7-f7a3-49d0-898c-65fe38e2457c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd67d1e9f08a417f94fa6eaaae1f753b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:03.024825 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce39b7-f7a3-49d0-898c-65fe38e2457c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:03.141226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:03.147547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-abce39b7-f7a3-49d0-898c-65fe38e2457c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd67d1e9f08a417f94fa6eaaae1f753b', 'request_id': 'req-abce39b7-f7a3-49d0-898c-65fe38e2457c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:03.167948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-abce39b7-f7a3-49d0-898c-65fe38e2457c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd67d1e9f08a417f94fa6eaaae1f753b', 'request_id': 'req-abce39b7-f7a3-49d0-898c-65fe38e2457c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:03.177378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-abce39b7-f7a3-49d0-898c-65fe38e2457c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd67d1e9f08a417f94fa6eaaae1f753b', 'request_id': 'req-abce39b7-f7a3-49d0-898c-65fe38e2457c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:03.226004 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-abce39b7-f7a3-49d0-898c-65fe38e2457c admin admin] The token cache is being invalidate because project bd67d1e9f08a417f94fa6eaaae1f753b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:03.227010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-abce39b7-f7a3-49d0-898c-65fe38e2457c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:03.227816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-abce39b7-f7a3-49d0-898c-65fe38e2457c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:03.231538 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1094/2203] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:02 2022] DELETE /identity/v3/projects/bd67d1e9f08a417f94fa6eaaae1f753b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:03.236468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c18a9-68ac-48c2-bd42-3a2a28d2002b None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:03.236980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c18a9-68ac-48c2-bd42-3a2a28d2002b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:03.236980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c18a9-68ac-48c2-bd42-3a2a28d2002b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:03.330094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-7b5c18a9-68ac-48c2-bd42-3a2a28d2002b None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:03.330094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7b5c18a9-68ac-48c2-bd42-3a2a28d2002b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:03.610723 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1110/2204] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:03.611917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f82359-b097-4499-b0ce-30767d5495f6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:03.612232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f82359-b097-4499-b0ce-30767d5495f6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:03.612520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f82359-b097-4499-b0ce-30767d5495f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:03.671949 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-92f82359-b097-4499-b0ce-30767d5495f6 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:03.673036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-92f82359-b097-4499-b0ce-30767d5495f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:03.725924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1095/2205] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:03.730862 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c18a9-68ac-48c2-bd42-3a2a28d2002b None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:03.744052 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c18a9-68ac-48c2-bd42-3a2a28d2002b None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:03.753754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee377e-933a-4a99-98c9-0a65dd1db74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:03.754764 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee377e-933a-4a99-98c9-0a65dd1db74c admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:03.755350 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee377e-933a-4a99-98c9-0a65dd1db74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:03.762998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee377e-933a-4a99-98c9-0a65dd1db74c admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:03.764015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee377e-933a-4a99-98c9-0a65dd1db74c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:03.764534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee377e-933a-4a99-98c9-0a65dd1db74c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:03.766956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee377e-933a-4a99-98c9-0a65dd1db74c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:03.782538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1111/2206] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:04:03.786697 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f82359-b097-4499-b0ce-30767d5495f6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:03.800645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f82359-b097-4499-b0ce-30767d5495f6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:03.825572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c30e0-69cc-451a-a5c3-e64b3b660929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:03.826192 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c30e0-69cc-451a-a5c3-e64b3b660929 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:03.838703 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c30e0-69cc-451a-a5c3-e64b3b660929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:03.838703 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c30e0-69cc-451a-a5c3-e64b3b660929 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:03.838703 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c30e0-69cc-451a-a5c3-e64b3b660929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:03.845134 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c30e0-69cc-451a-a5c3-e64b3b660929 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:03.939750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1096/2207] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:03 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:03.959275 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee377e-933a-4a99-98c9-0a65dd1db74c admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:03.975519 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee377e-933a-4a99-98c9-0a65dd1db74c admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.044021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:04.069832 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368451a-c87e-44a9-a60b-202cb8ad68ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.070526 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368451a-c87e-44a9-a60b-202cb8ad68ba admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.070864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368451a-c87e-44a9-a60b-202cb8ad68ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.071141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368451a-c87e-44a9-a60b-202cb8ad68ba admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.071981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368451a-c87e-44a9-a60b-202cb8ad68ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.074498 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368451a-c87e-44a9-a60b-202cb8ad68ba admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.111173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1112/2208] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:03 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:04.115533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c30e0-69cc-451a-a5c3-e64b3b660929 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.127628 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c30e0-69cc-451a-a5c3-e64b3b660929 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.132868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80b6c8-5b01-4682-a05f-7bec72a277a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.133813 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b6c8-5b01-4682-a05f-7bec72a277a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.134409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b6c8-5b01-4682-a05f-7bec72a277a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.135150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80b6c8-5b01-4682-a05f-7bec72a277a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.136050 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80b6c8-5b01-4682-a05f-7bec72a277a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.138481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80b6c8-5b01-4682-a05f-7bec72a277a5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.165346 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1097/2209] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:04.169695 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368451a-c87e-44a9-a60b-202cb8ad68ba admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.199598 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368451a-c87e-44a9-a60b-202cb8ad68ba admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.206235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa79e0-2f12-4af2-9fd7-6506fed189a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.206911 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa79e0-2f12-4af2-9fd7-6506fed189a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.207193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa79e0-2f12-4af2-9fd7-6506fed189a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.207469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa79e0-2f12-4af2-9fd7-6506fed189a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.208220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa79e0-2f12-4af2-9fd7-6506fed189a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.209880 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa79e0-2f12-4af2-9fd7-6506fed189a6 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.227352 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1113/2210] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:04.232058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80b6c8-5b01-4682-a05f-7bec72a277a5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.247380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80b6c8-5b01-4682-a05f-7bec72a277a5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.256045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524da972-dd47-4645-b7af-f6775bd13b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.256795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524da972-dd47-4645-b7af-f6775bd13b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.257073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524da972-dd47-4645-b7af-f6775bd13b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.257350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524da972-dd47-4645-b7af-f6775bd13b05 admin admin] PATH_INFO: `/v3/projects/e4156cdd4a21419cab3523fba52c55bc/users/47faec989a20475b9885f19337bd1b19/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.295564 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524da972-dd47-4645-b7af-f6775bd13b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4156cdd4a21419cab3523fba52c55bc, user_id=47faec989a20475b9885f19337bd1b19, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.299213 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524da972-dd47-4645-b7af-f6775bd13b05 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.320707 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1098/2211] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:04 2022] PUT /identity/v3/projects/e4156cdd4a21419cab3523fba52c55bc/users/47faec989a20475b9885f19337bd1b19/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:04.331889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2d478-1d40-4302-86c5-bd29914523b5 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.332992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2d478-1d40-4302-86c5-bd29914523b5 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.333565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2d478-1d40-4302-86c5-bd29914523b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.372887 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-82a2d478-1d40-4302-86c5-bd29914523b5 None None] MFA Rules not processed for user `47faec989a20475b9885f19337bd1b19`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:04.376527 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-82a2d478-1d40-4302-86c5-bd29914523b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:04.471396 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1114/2212] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:04.475743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524da972-dd47-4645-b7af-f6775bd13b05 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.562333 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524da972-dd47-4645-b7af-f6775bd13b05 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.570578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71aa02-019e-437b-81e4-a846841273d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.571277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71aa02-019e-437b-81e4-a846841273d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.571552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71aa02-019e-437b-81e4-a846841273d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.571821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71aa02-019e-437b-81e4-a846841273d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.572470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71aa02-019e-437b-81e4-a846841273d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.574738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71aa02-019e-437b-81e4-a846841273d3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.646934 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1099/2213] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:04 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:04.648169 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2d478-1d40-4302-86c5-bd29914523b5 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.677246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2d478-1d40-4302-86c5-bd29914523b5 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.776988 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f7786-6a76-465b-8a8a-1cc1236367cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.778136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f7786-6a76-465b-8a8a-1cc1236367cd admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.779065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f7786-6a76-465b-8a8a-1cc1236367cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.779639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f7786-6a76-465b-8a8a-1cc1236367cd admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.781993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f7786-6a76-465b-8a8a-1cc1236367cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.785142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f7786-6a76-465b-8a8a-1cc1236367cd admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.834530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1115/2214] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:04 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:04.838369 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71aa02-019e-437b-81e4-a846841273d3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.857328 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71aa02-019e-437b-81e4-a846841273d3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.875526 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963165f0-df95-4b9e-9b03-ee7d4137c798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.878823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963165f0-df95-4b9e-9b03-ee7d4137c798 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.879211 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963165f0-df95-4b9e-9b03-ee7d4137c798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.879699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963165f0-df95-4b9e-9b03-ee7d4137c798 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.880473 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963165f0-df95-4b9e-9b03-ee7d4137c798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.883480 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963165f0-df95-4b9e-9b03-ee7d4137c798 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.903415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1100/2215] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:04.913755 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f7786-6a76-465b-8a8a-1cc1236367cd admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:04.930100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f7786-6a76-465b-8a8a-1cc1236367cd admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:04.952654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8eee6f-8d69-479c-b5b0-bc68d8cbadc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:04.953573 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eee6f-8d69-479c-b5b0-bc68d8cbadc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:04.953685 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eee6f-8d69-479c-b5b0-bc68d8cbadc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:04.954057 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eee6f-8d69-479c-b5b0-bc68d8cbadc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:04.955120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8eee6f-8d69-479c-b5b0-bc68d8cbadc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:04.957502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8eee6f-8d69-479c-b5b0-bc68d8cbadc5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:04.995220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1116/2216] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:05.012807 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963165f0-df95-4b9e-9b03-ee7d4137c798 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.024622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8eee6f-8d69-479c-b5b0-bc68d8cbadc5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.030085 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ab8eee6f-8d69-479c-b5b0-bc68d8cbadc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:05.034756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963165f0-df95-4b9e-9b03-ee7d4137c798 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.047289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167eb8d9-2feb-4fb5-b15e-3f0ac0c6d112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.047967 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eb8d9-2feb-4fb5-b15e-3f0ac0c6d112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.048247 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eb8d9-2feb-4fb5-b15e-3f0ac0c6d112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.048523 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eb8d9-2feb-4fb5-b15e-3f0ac0c6d112 admin admin] PATH_INFO: `/v3/projects/fe2660d802a74f5f82ab389e1280710c/users/8b73cb6bf81c4cda9ac28156b33a5e67/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.061910 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8eee6f-8d69-479c-b5b0-bc68d8cbadc5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.073786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc145459-4afb-4153-9cd7-4c7894f56099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.074636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145459-4afb-4153-9cd7-4c7894f56099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.074912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145459-4afb-4153-9cd7-4c7894f56099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.075209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145459-4afb-4153-9cd7-4c7894f56099 admin admin] PATH_INFO: `/v3/users/30b8518ab9e74a1798426049084009a0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.094568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc145459-4afb-4153-9cd7-4c7894f56099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b8518ab9e74a1798426049084009a0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.096955 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc145459-4afb-4153-9cd7-4c7894f56099 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.106639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167eb8d9-2feb-4fb5-b15e-3f0ac0c6d112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2660d802a74f5f82ab389e1280710c, user_id=8b73cb6bf81c4cda9ac28156b33a5e67, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.115224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167eb8d9-2feb-4fb5-b15e-3f0ac0c6d112 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.154875 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1101/2217] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:05 2022] PUT /identity/v3/projects/fe2660d802a74f5f82ab389e1280710c/users/8b73cb6bf81c4cda9ac28156b33a5e67/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:05.163384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ac36-d8d3-4e4e-8f4e-ecf263de4aa8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.163789 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ac36-d8d3-4e4e-8f4e-ecf263de4aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.164066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ac36-d8d3-4e4e-8f4e-ecf263de4aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.187151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:05.215158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2047ac36-d8d3-4e4e-8f4e-ecf263de4aa8 None None] MFA Rules not processed for user `8b73cb6bf81c4cda9ac28156b33a5e67`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:05.217007 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2047ac36-d8d3-4e4e-8f4e-ecf263de4aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:05.226023 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-bc145459-4afb-4153-9cd7-4c7894f56099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b8518ab9e74a1798426049084009a0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:05.229326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:05.254903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-bc145459-4afb-4153-9cd7-4c7894f56099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b8518ab9e74a1798426049084009a0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:05.267354 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-bc145459-4afb-4153-9cd7-4c7894f56099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b8518ab9e74a1798426049084009a0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:05.286304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-bc145459-4afb-4153-9cd7-4c7894f56099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b8518ab9e74a1798426049084009a0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:05.287064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-bc145459-4afb-4153-9cd7-4c7894f56099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b8518ab9e74a1798426049084009a0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:05.302153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1117/2218] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:05 2022] DELETE /identity/v3/users/30b8518ab9e74a1798426049084009a0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:05.307062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917a888-4818-4223-a75f-98eaa06cdead None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.307810 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917a888-4818-4223-a75f-98eaa06cdead None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.307810 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917a888-4818-4223-a75f-98eaa06cdead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.357744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-e917a888-4818-4223-a75f-98eaa06cdead None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:05.359114 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e917a888-4818-4223-a75f-98eaa06cdead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:05.386174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1102/2219] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:05.390804 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047ac36-d8d3-4e4e-8f4e-ecf263de4aa8 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.392693 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2047ac36-d8d3-4e4e-8f4e-ecf263de4aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:05.480082 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1118/2220] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:05.501273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917a888-4818-4223-a75f-98eaa06cdead None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.503240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e917a888-4818-4223-a75f-98eaa06cdead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:05.519119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047ac36-d8d3-4e4e-8f4e-ecf263de4aa8 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.524468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87d862-4afd-4894-b4c5-b2e66c5a9942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.525608 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87d862-4afd-4894-b4c5-b2e66c5a9942 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.526428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87d862-4afd-4894-b4c5-b2e66c5a9942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.526428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87d862-4afd-4894-b4c5-b2e66c5a9942 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.529040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87d862-4afd-4894-b4c5-b2e66c5a9942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.531738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87d862-4afd-4894-b4c5-b2e66c5a9942 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.571257 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1103/2221] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:05 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:05.575615 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87d862-4afd-4894-b4c5-b2e66c5a9942 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.666824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917a888-4818-4223-a75f-98eaa06cdead None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.702331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87d862-4afd-4894-b4c5-b2e66c5a9942 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.719255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afe722-efa7-454b-8c0e-eaa492de3b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.720865 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe722-efa7-454b-8c0e-eaa492de3b87 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.721365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe722-efa7-454b-8c0e-eaa492de3b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.721852 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe722-efa7-454b-8c0e-eaa492de3b87 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.722816 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afe722-efa7-454b-8c0e-eaa492de3b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.725620 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afe722-efa7-454b-8c0e-eaa492de3b87 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.755553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbfde7-d6f3-4771-8110-0855181e8872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.756248 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbfde7-d6f3-4771-8110-0855181e8872 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.756660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbfde7-d6f3-4771-8110-0855181e8872 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.756947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbfde7-d6f3-4771-8110-0855181e8872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.765982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1104/2222] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:05 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:05.768848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbfde7-d6f3-4771-8110-0855181e8872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.769876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afe722-efa7-454b-8c0e-eaa492de3b87 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.770317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbfde7-d6f3-4771-8110-0855181e8872 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.782420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1119/2223] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:05.783874 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afe722-efa7-454b-8c0e-eaa492de3b87 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.788941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c307402-98c9-4818-8167-99b2b8821516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.789560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c307402-98c9-4818-8167-99b2b8821516 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.791537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c307402-98c9-4818-8167-99b2b8821516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.792152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c307402-98c9-4818-8167-99b2b8821516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.792857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c307402-98c9-4818-8167-99b2b8821516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.794499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c307402-98c9-4818-8167-99b2b8821516 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.812675 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbfde7-d6f3-4771-8110-0855181e8872 service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.815128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1105/2224] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:05.820517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:05.828645 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbfde7-d6f3-4771-8110-0855181e8872 service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.847856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa509c3-62b5-433f-83aa-7da88cca0b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:05.848636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa509c3-62b5-433f-83aa-7da88cca0b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:05.849035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa509c3-62b5-433f-83aa-7da88cca0b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:05.849422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa509c3-62b5-433f-83aa-7da88cca0b0b admin admin] PATH_INFO: `/v3/projects/76cd919d03c44b7f86c24d0c8c2c20b5/users/de4197831efd4706a7c1d7e1bd897e19/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:05.881690 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa509c3-62b5-433f-83aa-7da88cca0b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=76cd919d03c44b7f86c24d0c8c2c20b5, user_id=de4197831efd4706a7c1d7e1bd897e19, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:05.884886 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa509c3-62b5-433f-83aa-7da88cca0b0b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:05.913459 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1120/2225] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:05 2022] PUT /identity/v3/projects/76cd919d03c44b7f86c24d0c8c2c20b5/users/de4197831efd4706a7c1d7e1bd897e19/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:05.924729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c307402-98c9-4818-8167-99b2b8821516 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:05.948027 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c307402-98c9-4818-8167-99b2b8821516 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:05.979062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:06.072577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899c151-b5be-4662-81d9-f51835f8335f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:06.073599 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899c151-b5be-4662-81d9-f51835f8335f admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:06.073840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899c151-b5be-4662-81d9-f51835f8335f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:06.074036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899c151-b5be-4662-81d9-f51835f8335f admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:06.074862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899c151-b5be-4662-81d9-f51835f8335f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:06.076365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899c151-b5be-4662-81d9-f51835f8335f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:06.090462 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1106/2226] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:06.095201 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa509c3-62b5-433f-83aa-7da88cca0b0b admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:06.108918 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa509c3-62b5-433f-83aa-7da88cca0b0b admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:06.115320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fb4f9-618e-4de9-8727-390c4d6c8501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:06.117133 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fb4f9-618e-4de9-8727-390c4d6c8501 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:06.117634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fb4f9-618e-4de9-8727-390c4d6c8501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:06.118107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fb4f9-618e-4de9-8727-390c4d6c8501 admin admin] PATH_INFO: `/v3/projects/76cd919d03c44b7f86c24d0c8c2c20b5/users/de4197831efd4706a7c1d7e1bd897e19/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:06.123896 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fb4f9-618e-4de9-8727-390c4d6c8501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76cd919d03c44b7f86c24d0c8c2c20b5, user_id=de4197831efd4706a7c1d7e1bd897e19, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:06.127103 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fb4f9-618e-4de9-8727-390c4d6c8501 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:06.141029 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1121/2227] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:06 2022] PUT /identity/v3/projects/76cd919d03c44b7f86c24d0c8c2c20b5/users/de4197831efd4706a7c1d7e1bd897e19/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:06.151870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdd8b6-a3e5-4668-ba59-82bc9321e0e0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:06.152217 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdd8b6-a3e5-4668-ba59-82bc9321e0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:06.152422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdd8b6-a3e5-4668-ba59-82bc9321e0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:06.195045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-17bdd8b6-a3e5-4668-ba59-82bc9321e0e0 None None] MFA Rules not processed for user `de4197831efd4706a7c1d7e1bd897e19`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:06.196644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-17bdd8b6-a3e5-4668-ba59-82bc9321e0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:06.197002 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fb4f9-618e-4de9-8727-390c4d6c8501 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:06.199332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7d8fb4f9-618e-4de9-8727-390c4d6c8501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:06.332232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1107/2228] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:06.371887 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fb4f9-618e-4de9-8727-390c4d6c8501 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:06.387005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdd8b6-a3e5-4668-ba59-82bc9321e0e0 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:06.388145 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-17bdd8b6-a3e5-4668-ba59-82bc9321e0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:06.394970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:06.395775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:06.396146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:06.397928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] PATH_INFO: `/v3/projects/fbfa5a69300c4975875ff7e363fba388` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:06.401222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbfa5a69300c4975875ff7e363fba388)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:06.405154 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:06.527194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbfa5a69300c4975875ff7e363fba388', 'request_id': 'req-ab226278-2433-49ce-b1cb-e3517f50bf02'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:06.541365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbfa5a69300c4975875ff7e363fba388', 'request_id': 'req-ab226278-2433-49ce-b1cb-e3517f50bf02'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:06.550514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdd8b6-a3e5-4668-ba59-82bc9321e0e0 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:06.563591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbfa5a69300c4975875ff7e363fba388', 'request_id': 'req-ab226278-2433-49ce-b1cb-e3517f50bf02'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:06.587749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] The token cache is being invalidate because project fbfa5a69300c4975875ff7e363fba388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:06.588155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:06.589210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:06.602634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1122/2229] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:06 2022] DELETE /identity/v3/projects/fbfa5a69300c4975875ff7e363fba388 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:06.630872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3645ece-851f-4e1a-9161-90a9daec43b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:06.631647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645ece-851f-4e1a-9161-90a9daec43b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:06.631925 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645ece-851f-4e1a-9161-90a9daec43b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:06.632198 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645ece-851f-4e1a-9161-90a9daec43b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:06.635292 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f3645ece-851f-4e1a-9161-90a9daec43b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:06.645786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:06.759800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3645ece-851f-4e1a-9161-90a9daec43b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:06.763975 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3645ece-851f-4e1a-9161-90a9daec43b2 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:06.810953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1108/2230] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:07.601984 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:07.604336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:07.616457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab226278-2433-49ce-b1cb-e3517f50bf02 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:07.623277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4cba1-1380-4484-87d1-ce0c31366a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:07.624035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4cba1-1380-4484-87d1-ce0c31366a2e service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:07.624383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4cba1-1380-4484-87d1-ce0c31366a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:07.624722 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4cba1-1380-4484-87d1-ce0c31366a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:07.626741 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7fb4cba1-1380-4484-87d1-ce0c31366a2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:07.691948 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:07.693389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4cba1-1380-4484-87d1-ce0c31366a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:07.695402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4cba1-1380-4484-87d1-ce0c31366a2e service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:07.708550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1123/2231] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:12.337123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3645ece-851f-4e1a-9161-90a9daec43b2 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:12.340882 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f3645ece-851f-4e1a-9161-90a9daec43b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:12.372390 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3645ece-851f-4e1a-9161-90a9daec43b2 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:12.382016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c4e2c-f3b9-4e9a-9ae9-641d0d2b89a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:12.382430 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c4e2c-f3b9-4e9a-9ae9-641d0d2b89a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:12.382744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c4e2c-f3b9-4e9a-9ae9-641d0d2b89a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:12.383168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c4e2c-f3b9-4e9a-9ae9-641d0d2b89a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:12.386755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-743c4e2c-f3b9-4e9a-9ae9-641d0d2b89a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:12.485062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c4e2c-f3b9-4e9a-9ae9-641d0d2b89a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:12.486440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c4e2c-f3b9-4e9a-9ae9-641d0d2b89a7 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:12.497407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1109/2232] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:13.189624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4cba1-1380-4484-87d1-ce0c31366a2e service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.191549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7fb4cba1-1380-4484-87d1-ce0c31366a2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:13.290880 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4cba1-1380-4484-87d1-ce0c31366a2e service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.305486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdcedd-e98d-4521-8093-b42dc93153be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.306255 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdcedd-e98d-4521-8093-b42dc93153be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.306539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdcedd-e98d-4521-8093-b42dc93153be admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.306857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdcedd-e98d-4521-8093-b42dc93153be admin admin] PATH_INFO: `/v3/users/7c225e6300f644fa805e4d85948b88bd` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.308926 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdcedd-e98d-4521-8093-b42dc93153be admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c225e6300f644fa805e4d85948b88bd)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.310321 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdcedd-e98d-4521-8093-b42dc93153be admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.382973 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-aebdcedd-e98d-4521-8093-b42dc93153be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c225e6300f644fa805e4d85948b88bd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:13.401589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-aebdcedd-e98d-4521-8093-b42dc93153be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c225e6300f644fa805e4d85948b88bd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:13.417549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-aebdcedd-e98d-4521-8093-b42dc93153be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c225e6300f644fa805e4d85948b88bd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:13.429742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-aebdcedd-e98d-4521-8093-b42dc93153be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c225e6300f644fa805e4d85948b88bd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:13.430815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-aebdcedd-e98d-4521-8093-b42dc93153be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c225e6300f644fa805e4d85948b88bd'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:13.438060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1124/2233] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:13 2022] DELETE /identity/v3/users/7c225e6300f644fa805e4d85948b88bd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:13.445789 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6abfd1-f902-4119-a84e-cfac383e7e02 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.445789 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6abfd1-f902-4119-a84e-cfac383e7e02 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.445789 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6abfd1-f902-4119-a84e-cfac383e7e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.486399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-fc6abfd1-f902-4119-a84e-cfac383e7e02 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:13.487771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fc6abfd1-f902-4119-a84e-cfac383e7e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:13.510737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e12e7-6cad-4a90-a82d-4516f1b3c96f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.511254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e12e7-6cad-4a90-a82d-4516f1b3c96f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.511708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e12e7-6cad-4a90-a82d-4516f1b3c96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.553758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c47e12e7-6cad-4a90-a82d-4516f1b3c96f None None] MFA Rules not processed for user `67ad333d849f44dfa4ab6fa4ea9839f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:13.555315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c47e12e7-6cad-4a90-a82d-4516f1b3c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:13.575092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1110/2234] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:13.586472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6abfd1-f902-4119-a84e-cfac383e7e02 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:13.589181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fc6abfd1-f902-4119-a84e-cfac383e7e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:13.648812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:13.655738 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1125/2235] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:13.678743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6abfd1-f902-4119-a84e-cfac383e7e02 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:13.685384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231353d-03e2-41e8-9540-f33ac4c0acb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:13.686313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231353d-03e2-41e8-9540-f33ac4c0acb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:13.686794 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231353d-03e2-41e8-9540-f33ac4c0acb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:13.687226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231353d-03e2-41e8-9540-f33ac4c0acb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:13.701906 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231353d-03e2-41e8-9540-f33ac4c0acb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:13.704382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231353d-03e2-41e8-9540-f33ac4c0acb5 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:13.718692 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1111/2236] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:14.171351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e12e7-6cad-4a90-a82d-4516f1b3c96f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:14.172994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c47e12e7-6cad-4a90-a82d-4516f1b3c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:14.195395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e12e7-6cad-4a90-a82d-4516f1b3c96f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:14.203002 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:14.203769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:14.203985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:14.204448 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] PATH_INFO: `/v3/projects/ae10ecadd1794034abc01cd89748af87` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:14.205861 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae10ecadd1794034abc01cd89748af87)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:14.208183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:14.228276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:14.265356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae10ecadd1794034abc01cd89748af87', 'request_id': 'req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:14.276609 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae10ecadd1794034abc01cd89748af87', 'request_id': 'req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:14.294644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae10ecadd1794034abc01cd89748af87', 'request_id': 'req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:14.310584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] The token cache is being invalidate because project ae10ecadd1794034abc01cd89748af87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:14.311216 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:14.312600 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:14.315496 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1126/2237] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:14 2022] DELETE /identity/v3/projects/ae10ecadd1794034abc01cd89748af87 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:14.321619 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231353d-03e2-41e8-9540-f33ac4c0acb5 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:14.334471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231353d-03e2-41e8-9540-f33ac4c0acb5 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:14.412479 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fef7f1-6a24-4b24-bf7e-30f0b8b07d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:14.413812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef7f1-6a24-4b24-bf7e-30f0b8b07d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:14.414486 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef7f1-6a24-4b24-bf7e-30f0b8b07d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:14.414897 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef7f1-6a24-4b24-bf7e-30f0b8b07d7d admin admin] PATH_INFO: `/v3/users/8b3643e544d342c08667899fe1bb0917` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:14.417047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fef7f1-6a24-4b24-bf7e-30f0b8b07d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3643e544d342c08667899fe1bb0917)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:14.420991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fef7f1-6a24-4b24-bf7e-30f0b8b07d7d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:14.485760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-56fef7f1-6a24-4b24-bf7e-30f0b8b07d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3643e544d342c08667899fe1bb0917'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:14.486312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-56fef7f1-6a24-4b24-bf7e-30f0b8b07d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3643e544d342c08667899fe1bb0917'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:14.487311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-56fef7f1-6a24-4b24-bf7e-30f0b8b07d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3643e544d342c08667899fe1bb0917'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:14.499695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-56fef7f1-6a24-4b24-bf7e-30f0b8b07d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3643e544d342c08667899fe1bb0917'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:14.510556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-56fef7f1-6a24-4b24-bf7e-30f0b8b07d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3643e544d342c08667899fe1bb0917'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:14.537237 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1112/2238] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:14 2022] DELETE /identity/v3/users/8b3643e544d342c08667899fe1bb0917 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:15.000577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:15.002201 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:15.018913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbd63a-45eb-4ffe-8f28-cb977e387cfc admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:15.075007 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fef7f1-6a24-4b24-bf7e-30f0b8b07d7d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:15.077066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-56fef7f1-6a24-4b24-bf7e-30f0b8b07d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:15.098064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdea20e-da5d-409b-a891-c4862e29af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:15.099086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea20e-da5d-409b-a891-c4862e29af13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.099683 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea20e-da5d-409b-a891-c4862e29af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.100512 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea20e-da5d-409b-a891-c4862e29af13 admin admin] PATH_INFO: `/v3/projects/1f2d29f407494c2c9e2f16a45b860483` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.102065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdea20e-da5d-409b-a891-c4862e29af13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f2d29f407494c2c9e2f16a45b860483)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:15.104680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdea20e-da5d-409b-a891-c4862e29af13 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:15.162175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fef7f1-6a24-4b24-bf7e-30f0b8b07d7d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:15.168039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:15.169645 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8fdea20e-da5d-409b-a891-c4862e29af13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f2d29f407494c2c9e2f16a45b860483', 'request_id': 'req-8fdea20e-da5d-409b-a891-c4862e29af13'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.179645 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8fdea20e-da5d-409b-a891-c4862e29af13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f2d29f407494c2c9e2f16a45b860483', 'request_id': 'req-8fdea20e-da5d-409b-a891-c4862e29af13'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.188876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8fdea20e-da5d-409b-a891-c4862e29af13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f2d29f407494c2c9e2f16a45b860483', 'request_id': 'req-8fdea20e-da5d-409b-a891-c4862e29af13'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.207640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8fdea20e-da5d-409b-a891-c4862e29af13 admin admin] The token cache is being invalidate because project 1f2d29f407494c2c9e2f16a45b860483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:15.208293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8fdea20e-da5d-409b-a891-c4862e29af13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.209142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8fdea20e-da5d-409b-a891-c4862e29af13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.211288 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1127/2239] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:14 2022] DELETE /identity/v3/projects/1f2d29f407494c2c9e2f16a45b860483 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:15.218957 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d6f7b-a7e4-4009-906e-06750c7cdaa2 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.219306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d6f7b-a7e4-4009-906e-06750c7cdaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.219696 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d6f7b-a7e4-4009-906e-06750c7cdaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.228062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fabaa-a01c-4748-ad96-5d4202e91c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:15.228708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fabaa-a01c-4748-ad96-5d4202e91c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.229010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fabaa-a01c-4748-ad96-5d4202e91c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.229284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fabaa-a01c-4748-ad96-5d4202e91c7e admin admin] PATH_INFO: `/v3/users/47faec989a20475b9885f19337bd1b19` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.230666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fabaa-a01c-4748-ad96-5d4202e91c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=47faec989a20475b9885f19337bd1b19)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:15.232727 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fabaa-a01c-4748-ad96-5d4202e91c7e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:15.245409 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-175d6f7b-a7e4-4009-906e-06750c7cdaa2 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:15.245743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-175d6f7b-a7e4-4009-906e-06750c7cdaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:15.253972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1128/2240] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:15.262621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa569c16-0445-4ab3-be5e-f0994028dfef None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.262917 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa569c16-0445-4ab3-be5e-f0994028dfef None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.263283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa569c16-0445-4ab3-be5e-f0994028dfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.292742 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-fa569c16-0445-4ab3-be5e-f0994028dfef None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:15.294718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-fa569c16-0445-4ab3-be5e-f0994028dfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:15.301151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b92fabaa-a01c-4748-ad96-5d4202e91c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47faec989a20475b9885f19337bd1b19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.301151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b92fabaa-a01c-4748-ad96-5d4202e91c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47faec989a20475b9885f19337bd1b19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.301151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b92fabaa-a01c-4748-ad96-5d4202e91c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47faec989a20475b9885f19337bd1b19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.305871 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1129/2241] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:15.310303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b92fabaa-a01c-4748-ad96-5d4202e91c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47faec989a20475b9885f19337bd1b19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.311831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa569c16-0445-4ab3-be5e-f0994028dfef None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:15.320109 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b92fabaa-a01c-4748-ad96-5d4202e91c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47faec989a20475b9885f19337bd1b19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:15.324294 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa569c16-0445-4ab3-be5e-f0994028dfef None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:15.334820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef880d68-55d3-43da-9d54-1789de23dec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:15.335784 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef880d68-55d3-43da-9d54-1789de23dec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.335784 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef880d68-55d3-43da-9d54-1789de23dec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.336107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef880d68-55d3-43da-9d54-1789de23dec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.336723 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef880d68-55d3-43da-9d54-1789de23dec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:15.337032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef880d68-55d3-43da-9d54-1789de23dec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:15.338715 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef880d68-55d3-43da-9d54-1789de23dec7 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:15.344983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1113/2242] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:15 2022] DELETE /identity/v3/users/47faec989a20475b9885f19337bd1b19 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:15.348831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db282f-071f-44af-8425-01ab18452d6d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.349120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db282f-071f-44af-8425-01ab18452d6d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.349395 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db282f-071f-44af-8425-01ab18452d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.354285 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1130/2243] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:04:15.359274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef880d68-55d3-43da-9d54-1789de23dec7 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:15.370931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-57db282f-071f-44af-8425-01ab18452d6d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:15.371784 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef880d68-55d3-43da-9d54-1789de23dec7 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:15.372159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-57db282f-071f-44af-8425-01ab18452d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:15.376165 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:15.441146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c704e0-300a-43ec-b500-01bb54c00cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:15.441655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c704e0-300a-43ec-b500-01bb54c00cba admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.441931 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c704e0-300a-43ec-b500-01bb54c00cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.442231 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c704e0-300a-43ec-b500-01bb54c00cba admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.442883 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c704e0-300a-43ec-b500-01bb54c00cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:15.445140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c704e0-300a-43ec-b500-01bb54c00cba admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:15.454644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1114/2244] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:15.462968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db282f-071f-44af-8425-01ab18452d6d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:15.464664 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-57db282f-071f-44af-8425-01ab18452d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:15.486641 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1131/2245] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:15 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:15.491532 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c704e0-300a-43ec-b500-01bb54c00cba admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:15.513367 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:15.553526 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db282f-071f-44af-8425-01ab18452d6d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:15.582178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c704e0-300a-43ec-b500-01bb54c00cba admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:15.589697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f3342-17a3-4cea-a363-aa632c715e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:15.590145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f3342-17a3-4cea-a363-aa632c715e11 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.591388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f3342-17a3-4cea-a363-aa632c715e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.591665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f3342-17a3-4cea-a363-aa632c715e11 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.592328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f3342-17a3-4cea-a363-aa632c715e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:15.594924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f3342-17a3-4cea-a363-aa632c715e11 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:15.632287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1132/2246] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:15 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:15.634557 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d4d46-db2e-4221-90a3-df3e04d00fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:15.635222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d4d46-db2e-4221-90a3-df3e04d00fcc service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.635678 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d4d46-db2e-4221-90a3-df3e04d00fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.635959 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d4d46-db2e-4221-90a3-df3e04d00fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.638163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f3342-17a3-4cea-a363-aa632c715e11 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:15.649128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d4d46-db2e-4221-90a3-df3e04d00fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:15.650704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d4d46-db2e-4221-90a3-df3e04d00fcc service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:15.651503 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f3342-17a3-4cea-a363-aa632c715e11 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:15.657630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2c808-ec5f-4bbd-be8c-b8ac290426ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:15.658563 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2c808-ec5f-4bbd-be8c-b8ac290426ae admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.659242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2c808-ec5f-4bbd-be8c-b8ac290426ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.659524 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2c808-ec5f-4bbd-be8c-b8ac290426ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.660200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2c808-ec5f-4bbd-be8c-b8ac290426ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:15.662259 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2c808-ec5f-4bbd-be8c-b8ac290426ae admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:15.668680 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1115/2247] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:15.678713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1133/2248] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:15.680210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d4d46-db2e-4221-90a3-df3e04d00fcc service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:15.691317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d4d46-db2e-4221-90a3-df3e04d00fcc service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:15.699432 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7c63e-d17d-4670-aea9-ec3ca2953baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:15.700422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c63e-d17d-4670-aea9-ec3ca2953baf admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.700908 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c63e-d17d-4670-aea9-ec3ca2953baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.701429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7c63e-d17d-4670-aea9-ec3ca2953baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.702462 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7c63e-d17d-4670-aea9-ec3ca2953baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:15.704952 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7c63e-d17d-4670-aea9-ec3ca2953baf admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:15.723418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1116/2249] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:15.725501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2c808-ec5f-4bbd-be8c-b8ac290426ae admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:15.743568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2c808-ec5f-4bbd-be8c-b8ac290426ae admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:15.750099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25eea54-07cd-4a5a-8b41-75cb009aeb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:15.750823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25eea54-07cd-4a5a-8b41-75cb009aeb9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.751107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25eea54-07cd-4a5a-8b41-75cb009aeb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.751386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25eea54-07cd-4a5a-8b41-75cb009aeb9b admin admin] PATH_INFO: `/v3/projects/b35f54e53035452b91724bd32ad15275/users/d212802591f24e4badbe87ac8098c66a/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.771423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25eea54-07cd-4a5a-8b41-75cb009aeb9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35f54e53035452b91724bd32ad15275, user_id=d212802591f24e4badbe87ac8098c66a, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:15.773657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25eea54-07cd-4a5a-8b41-75cb009aeb9b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:15.790985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1134/2250] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:15 2022] PUT /identity/v3/projects/b35f54e53035452b91724bd32ad15275/users/d212802591f24e4badbe87ac8098c66a/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:15.804103 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94627-e990-4001-b83f-f1bed71fd3da None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.804103 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94627-e990-4001-b83f-f1bed71fd3da None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.804603 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94627-e990-4001-b83f-f1bed71fd3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.837726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-47f94627-e990-4001-b83f-f1bed71fd3da None None] MFA Rules not processed for user `d212802591f24e4badbe87ac8098c66a`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:15.838999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-47f94627-e990-4001-b83f-f1bed71fd3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:15.917032 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1117/2251] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:15.922324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25eea54-07cd-4a5a-8b41-75cb009aeb9b admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:15.962441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a9e91-dee7-4701-9882-9df5e4dcf664 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:15.963263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a9e91-dee7-4701-9882-9df5e4dcf664 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:15.964420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a9e91-dee7-4701-9882-9df5e4dcf664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:15.991543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7a9a9e91-dee7-4701-9882-9df5e4dcf664 None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:15.993165 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7a9a9e91-dee7-4701-9882-9df5e4dcf664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:16.013606 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:16.046738 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25eea54-07cd-4a5a-8b41-75cb009aeb9b admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.054157 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31508963-3c72-411f-9079-b16668cc178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.054845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31508963-3c72-411f-9079-b16668cc178b admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.055124 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31508963-3c72-411f-9079-b16668cc178b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.057633 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31508963-3c72-411f-9079-b16668cc178b admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.058361 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31508963-3c72-411f-9079-b16668cc178b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.063194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31508963-3c72-411f-9079-b16668cc178b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.099758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1118/2252] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 16:04:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:16.131314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a9e91-dee7-4701-9882-9df5e4dcf664 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.132988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7a9a9e91-dee7-4701-9882-9df5e4dcf664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:16.156513 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1135/2253] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:15 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:16.159403 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31508963-3c72-411f-9079-b16668cc178b admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.164990 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:16.268468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a9e91-dee7-4701-9882-9df5e4dcf664 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.331790 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31508963-3c72-411f-9079-b16668cc178b admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.344447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed25b45-1ac0-48d6-9712-7857f9ab490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.345633 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed25b45-1ac0-48d6-9712-7857f9ab490d admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.346228 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed25b45-1ac0-48d6-9712-7857f9ab490d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.346788 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed25b45-1ac0-48d6-9712-7857f9ab490d admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.348549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed25b45-1ac0-48d6-9712-7857f9ab490d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.351452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed25b45-1ac0-48d6-9712-7857f9ab490d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.367799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b30be-775e-43e2-aae2-e0773316aabc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.368535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b30be-775e-43e2-aae2-e0773316aabc service swift] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.369667 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b30be-775e-43e2-aae2-e0773316aabc service swift] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.369956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b30be-775e-43e2-aae2-e0773316aabc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.392306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1136/2254] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:16 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:16.393219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed25b45-1ac0-48d6-9712-7857f9ab490d admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.398942 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-6ed25b45-1ac0-48d6-9712-7857f9ab490d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:16.413852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed25b45-1ac0-48d6-9712-7857f9ab490d admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.419951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.420618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.421062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.421340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] PATH_INFO: `/v3/projects/e4156cdd4a21419cab3523fba52c55bc` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.422702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4156cdd4a21419cab3523fba52c55bc)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.424978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.470995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b30be-775e-43e2-aae2-e0773316aabc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.473534 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b30be-775e-43e2-aae2-e0773316aabc service swift] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.484149 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1119/2255] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:04:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 16:04:16.485340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4156cdd4a21419cab3523fba52c55bc', 'request_id': 'req-16eee284-9da7-4fa6-9854-b1f7757f5f66'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.485475 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b30be-775e-43e2-aae2-e0773316aabc service swift] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.502255 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4156cdd4a21419cab3523fba52c55bc', 'request_id': 'req-16eee284-9da7-4fa6-9854-b1f7757f5f66'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.513085 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4156cdd4a21419cab3523fba52c55bc', 'request_id': 'req-16eee284-9da7-4fa6-9854-b1f7757f5f66'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.514391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b30be-775e-43e2-aae2-e0773316aabc service swift] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.529711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] The token cache is being invalidate because project e4156cdd4a21419cab3523fba52c55bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:16.530309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.537585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.542373 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1137/2256] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:16 2022] DELETE /identity/v3/projects/e4156cdd4a21419cab3523fba52c55bc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:16.543623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.545649 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:16.671121 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:16.696434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:16.714276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eee284-9da7-4fa6-9854-b1f7757f5f66 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.715256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95564ccd-6a16-4bd8-8efa-ac823b413b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.718129 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95564ccd-6a16-4bd8-8efa-ac823b413b39 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.719041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95564ccd-6a16-4bd8-8efa-ac823b413b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.720381 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95564ccd-6a16-4bd8-8efa-ac823b413b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.722211 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95564ccd-6a16-4bd8-8efa-ac823b413b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.724356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95564ccd-6a16-4bd8-8efa-ac823b413b39 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.726121 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc8bbf-8ecb-4235-87cc-5d705d498fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.727219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc8bbf-8ecb-4235-87cc-5d705d498fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.727591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc8bbf-8ecb-4235-87cc-5d705d498fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.728014 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc8bbf-8ecb-4235-87cc-5d705d498fc1 admin admin] PATH_INFO: `/v3/users/8b73cb6bf81c4cda9ac28156b33a5e67` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.730113 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc8bbf-8ecb-4235-87cc-5d705d498fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b73cb6bf81c4cda9ac28156b33a5e67)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.734336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc8bbf-8ecb-4235-87cc-5d705d498fc1 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.745002 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1120/2257] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:16.750553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95564ccd-6a16-4bd8-8efa-ac823b413b39 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.755057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-95564ccd-6a16-4bd8-8efa-ac823b413b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:16.798333 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95564ccd-6a16-4bd8-8efa-ac823b413b39 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:16.811045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb5e6c-212d-4060-98a0-0430ad224ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:16.813044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb5e6c-212d-4060-98a0-0430ad224ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:16.814160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb5e6c-212d-4060-98a0-0430ad224ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:16.815459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb5e6c-212d-4060-98a0-0430ad224ef8 admin admin] PATH_INFO: `/v3/projects/3ba56682a6754910baf16873a9ae27e3/users/1f97f680d88b4261a3242415937b4032/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:16.832028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-76fc8bbf-8ecb-4235-87cc-5d705d498fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b73cb6bf81c4cda9ac28156b33a5e67'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.857495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb5e6c-212d-4060-98a0-0430ad224ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba56682a6754910baf16873a9ae27e3, user_id=1f97f680d88b4261a3242415937b4032, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:16.860573 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-76fc8bbf-8ecb-4235-87cc-5d705d498fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b73cb6bf81c4cda9ac28156b33a5e67'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.864745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb5e6c-212d-4060-98a0-0430ad224ef8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:16.874807 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-76fc8bbf-8ecb-4235-87cc-5d705d498fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b73cb6bf81c4cda9ac28156b33a5e67'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.891717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-76fc8bbf-8ecb-4235-87cc-5d705d498fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b73cb6bf81c4cda9ac28156b33a5e67'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.892841 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-76fc8bbf-8ecb-4235-87cc-5d705d498fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b73cb6bf81c4cda9ac28156b33a5e67'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:16.899025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1121/2258] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:16 2022] PUT /identity/v3/projects/3ba56682a6754910baf16873a9ae27e3/users/1f97f680d88b4261a3242415937b4032/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:16.905146 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb5e6c-212d-4060-98a0-0430ad224ef8 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:16.907909 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-45bb5e6c-212d-4060-98a0-0430ad224ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:16.912886 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1138/2259] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:16 2022] DELETE /identity/v3/users/8b73cb6bf81c4cda9ac28156b33a5e67 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:17.103201 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb5e6c-212d-4060-98a0-0430ad224ef8 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:17.233623 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bac03b-55a6-4d63-9d97-2133fcc9ca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:17.234443 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bac03b-55a6-4d63-9d97-2133fcc9ca88 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:17.234768 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bac03b-55a6-4d63-9d97-2133fcc9ca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:17.235100 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bac03b-55a6-4d63-9d97-2133fcc9ca88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:17.235936 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bac03b-55a6-4d63-9d97-2133fcc9ca88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:17.238069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bac03b-55a6-4d63-9d97-2133fcc9ca88 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:17.263242 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1122/2260] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:17.267806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc8bbf-8ecb-4235-87cc-5d705d498fc1 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:17.285614 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc8bbf-8ecb-4235-87cc-5d705d498fc1 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:17.298903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0285b7-6a0b-4a77-9fd6-bdba3d01ba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:17.299673 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0285b7-6a0b-4a77-9fd6-bdba3d01ba21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:17.300070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0285b7-6a0b-4a77-9fd6-bdba3d01ba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:17.300508 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0285b7-6a0b-4a77-9fd6-bdba3d01ba21 admin admin] PATH_INFO: `/v3/projects/3ba56682a6754910baf16873a9ae27e3/users/1f97f680d88b4261a3242415937b4032/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:17.307823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0285b7-6a0b-4a77-9fd6-bdba3d01ba21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba56682a6754910baf16873a9ae27e3, user_id=1f97f680d88b4261a3242415937b4032, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:17.311254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0285b7-6a0b-4a77-9fd6-bdba3d01ba21 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:17.345360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1139/2261] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:17 2022] PUT /identity/v3/projects/3ba56682a6754910baf16873a9ae27e3/users/1f97f680d88b4261a3242415937b4032/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:17.350348 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc1824-e8b9-4892-aca6-8eef073b3a08 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:17.350566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc1824-e8b9-4892-aca6-8eef073b3a08 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:17.351108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc1824-e8b9-4892-aca6-8eef073b3a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:17.425426 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-24dc1824-e8b9-4892-aca6-8eef073b3a08 None None] MFA Rules not processed for user `1f97f680d88b4261a3242415937b4032`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:17.426723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-24dc1824-e8b9-4892-aca6-8eef073b3a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:17.617024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:17.647673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1123/2262] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:17.663409 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0285b7-6a0b-4a77-9fd6-bdba3d01ba21 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:17.672320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-dc0285b7-6a0b-4a77-9fd6-bdba3d01ba21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:17.851648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc1824-e8b9-4892-aca6-8eef073b3a08 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:17.854140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-24dc1824-e8b9-4892-aca6-8eef073b3a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:17.917955 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0285b7-6a0b-4a77-9fd6-bdba3d01ba21 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:17.931301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cf991-118d-4879-8aac-760d457e4c18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:17.932080 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cf991-118d-4879-8aac-760d457e4c18 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:17.932358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cf991-118d-4879-8aac-760d457e4c18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:17.932625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cf991-118d-4879-8aac-760d457e4c18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:17.968294 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cf991-118d-4879-8aac-760d457e4c18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:17.972953 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cf991-118d-4879-8aac-760d457e4c18 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:18.028111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1140/2263] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:18.092538 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc1824-e8b9-4892-aca6-8eef073b3a08 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:18.111937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:18.112697 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.113621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.113621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] PATH_INFO: `/v3/projects/fe2660d802a74f5f82ab389e1280710c` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.116323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2660d802a74f5f82ab389e1280710c)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:18.120931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:18.151899 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cf991-118d-4879-8aac-760d457e4c18 service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:18.163762 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cf991-118d-4879-8aac-760d457e4c18 service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:18.173776 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e9758-bfb7-4046-9443-ab33723c1eb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:18.181837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e9758-bfb7-4046-9443-ab33723c1eb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.182159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e9758-bfb7-4046-9443-ab33723c1eb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.182416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e9758-bfb7-4046-9443-ab33723c1eb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.186871 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7a1e9758-bfb7-4046-9443-ab33723c1eb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:18.234854 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2660d802a74f5f82ab389e1280710c', 'request_id': 'req-e4032eeb-0953-46b9-b511-966b95a4346a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.243401 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2660d802a74f5f82ab389e1280710c', 'request_id': 'req-e4032eeb-0953-46b9-b511-966b95a4346a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.257895 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2660d802a74f5f82ab389e1280710c', 'request_id': 'req-e4032eeb-0953-46b9-b511-966b95a4346a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.286051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] The token cache is being invalidate because project fe2660d802a74f5f82ab389e1280710c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:18.287398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.290005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.291752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:18.298955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1124/2264] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:17 2022] DELETE /identity/v3/projects/fe2660d802a74f5f82ab389e1280710c => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:18.298955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:18.300491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:18.333386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e9758-bfb7-4046-9443-ab33723c1eb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:18.334967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e9758-bfb7-4046-9443-ab33723c1eb5 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:18.352229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1141/2265] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:18.466179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4032eeb-0953-46b9-b511-966b95a4346a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:18.492652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66567e6e-2734-422b-8b98-77a24838d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:18.493388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66567e6e-2734-422b-8b98-77a24838d629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.493754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66567e6e-2734-422b-8b98-77a24838d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.494062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66567e6e-2734-422b-8b98-77a24838d629 admin admin] PATH_INFO: `/v3/users/de4197831efd4706a7c1d7e1bd897e19` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.495454 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66567e6e-2734-422b-8b98-77a24838d629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4197831efd4706a7c1d7e1bd897e19)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:18.497429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66567e6e-2734-422b-8b98-77a24838d629 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:18.566945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:18.617054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-66567e6e-2734-422b-8b98-77a24838d629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4197831efd4706a7c1d7e1bd897e19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.618292 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-66567e6e-2734-422b-8b98-77a24838d629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4197831efd4706a7c1d7e1bd897e19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.619131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-66567e6e-2734-422b-8b98-77a24838d629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4197831efd4706a7c1d7e1bd897e19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.635359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-66567e6e-2734-422b-8b98-77a24838d629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4197831efd4706a7c1d7e1bd897e19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.645160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-66567e6e-2734-422b-8b98-77a24838d629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4197831efd4706a7c1d7e1bd897e19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:18.672214 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1125/2266] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:18 2022] DELETE /identity/v3/users/de4197831efd4706a7c1d7e1bd897e19 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:18.765393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e9758-bfb7-4046-9443-ab33723c1eb5 service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:18.781238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e9758-bfb7-4046-9443-ab33723c1eb5 service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:18.889164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f399289-8514-4af0-a2dd-ebb02a561c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:18.889902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399289-8514-4af0-a2dd-ebb02a561c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:18.890569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399289-8514-4af0-a2dd-ebb02a561c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:18.890569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f399289-8514-4af0-a2dd-ebb02a561c9f admin admin] PATH_INFO: `/v3/users/d212802591f24e4badbe87ac8098c66a` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:18.897893 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f399289-8514-4af0-a2dd-ebb02a561c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d212802591f24e4badbe87ac8098c66a)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:18.900130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f399289-8514-4af0-a2dd-ebb02a561c9f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:18.990667 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5f399289-8514-4af0-a2dd-ebb02a561c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd212802591f24e4badbe87ac8098c66a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.012084 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5f399289-8514-4af0-a2dd-ebb02a561c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd212802591f24e4badbe87ac8098c66a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.032546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5f399289-8514-4af0-a2dd-ebb02a561c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd212802591f24e4badbe87ac8098c66a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.047962 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5f399289-8514-4af0-a2dd-ebb02a561c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd212802591f24e4badbe87ac8098c66a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.048856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-5f399289-8514-4af0-a2dd-ebb02a561c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd212802591f24e4badbe87ac8098c66a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.055967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1142/2267] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:18 2022] DELETE /identity/v3/users/d212802591f24e4badbe87ac8098c66a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:19.060902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e43145-b0e4-408d-8127-bf2267e26588 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.061193 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e43145-b0e4-408d-8127-bf2267e26588 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.061469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e43145-b0e4-408d-8127-bf2267e26588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.082788 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f5e43145-b0e4-408d-8127-bf2267e26588 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:19.083496 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f399289-8514-4af0-a2dd-ebb02a561c9f admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.084107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f5e43145-b0e4-408d-8127-bf2267e26588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:19.085507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5f399289-8514-4af0-a2dd-ebb02a561c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:19.190679 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1126/2268] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:19.201230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e43145-b0e4-408d-8127-bf2267e26588 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.202873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f5e43145-b0e4-408d-8127-bf2267e26588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:19.225152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f399289-8514-4af0-a2dd-ebb02a561c9f admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.234171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.235831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.236435 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.236828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18 admin admin] PATH_INFO: `/v3/projects/76cd919d03c44b7f86c24d0c8c2c20b5` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.247519 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76cd919d03c44b7f86c24d0c8c2c20b5)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:19.247519 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:19.260196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:19.347602 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e43145-b0e4-408d-8127-bf2267e26588 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.363943 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76cd919d03c44b7f86c24d0c8c2c20b5', 'request_id': 'req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.375172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76cd919d03c44b7f86c24d0c8c2c20b5', 'request_id': 'req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.386482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76cd919d03c44b7f86c24d0c8c2c20b5', 'request_id': 'req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.400577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18 admin admin] The token cache is being invalidate because project 76cd919d03c44b7f86c24d0c8c2c20b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:19.400717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.401574 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e98f5bf5-53ed-4e21-a1d4-c8f0d2c8ee18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.406641 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1143/2269] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:19 2022] DELETE /identity/v3/projects/76cd919d03c44b7f86c24d0c8c2c20b5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:19.409473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a022426-f3da-458b-9d21-569a525d5a2f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.409747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a022426-f3da-458b-9d21-569a525d5a2f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.410015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a022426-f3da-458b-9d21-569a525d5a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.429685 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8bd92-1f99-42f6-8fb9-3d39338ba38b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.430296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8bd92-1f99-42f6-8fb9-3d39338ba38b service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.430568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8bd92-1f99-42f6-8fb9-3d39338ba38b service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.430857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8bd92-1f99-42f6-8fb9-3d39338ba38b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.432818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d0d8bd92-1f99-42f6-8fb9-3d39338ba38b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:19.433985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1a022426-f3da-458b-9d21-569a525d5a2f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:19.435227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1a022426-f3da-458b-9d21-569a525d5a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:19.457088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:19.523132 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8bd92-1f99-42f6-8fb9-3d39338ba38b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:19.524626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8bd92-1f99-42f6-8fb9-3d39338ba38b service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:19.532284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1144/2270] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:19.536070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1127/2271] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:19.540927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cb74e-6c1c-4cac-9918-ae7617b122f3 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.541213 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cb74e-6c1c-4cac-9918-ae7617b122f3 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.541625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cb74e-6c1c-4cac-9918-ae7617b122f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.562031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-2a1cb74e-6c1c-4cac-9918-ae7617b122f3 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:19.563282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-2a1cb74e-6c1c-4cac-9918-ae7617b122f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:19.571921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1145/2272] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:19.576519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8bd92-1f99-42f6-8fb9-3d39338ba38b service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.587108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8bd92-1f99-42f6-8fb9-3d39338ba38b service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.592425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9841e35-8292-4da5-8d5a-c6d4246adc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.593042 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9841e35-8292-4da5-8d5a-c6d4246adc9a admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.593320 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9841e35-8292-4da5-8d5a-c6d4246adc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.593617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9841e35-8292-4da5-8d5a-c6d4246adc9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.594295 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9841e35-8292-4da5-8d5a-c6d4246adc9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:19.594631 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9841e35-8292-4da5-8d5a-c6d4246adc9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:19.596260 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9841e35-8292-4da5-8d5a-c6d4246adc9a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:19.609966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1128/2273] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:04:19.614464 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cb74e-6c1c-4cac-9918-ae7617b122f3 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.624172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cb74e-6c1c-4cac-9918-ae7617b122f3 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.629130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2757ff-cc78-4e9c-ba50-6df26c78741d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.629762 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2757ff-cc78-4e9c-ba50-6df26c78741d admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.630027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2757ff-cc78-4e9c-ba50-6df26c78741d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.630299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2757ff-cc78-4e9c-ba50-6df26c78741d admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.630983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2757ff-cc78-4e9c-ba50-6df26c78741d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:19.632908 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2757ff-cc78-4e9c-ba50-6df26c78741d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:19.699320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1146/2274] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:19 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:19.703339 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9841e35-8292-4da5-8d5a-c6d4246adc9a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.722995 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9841e35-8292-4da5-8d5a-c6d4246adc9a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.864244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8b03c-6068-485f-a8eb-939f6436f386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.865031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8b03c-6068-485f-a8eb-939f6436f386 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.865197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8b03c-6068-485f-a8eb-939f6436f386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.865550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8b03c-6068-485f-a8eb-939f6436f386 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.866119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8b03c-6068-485f-a8eb-939f6436f386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:19.868108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8b03c-6068-485f-a8eb-939f6436f386 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:19.872611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2757ff-cc78-4e9c-ba50-6df26c78741d admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.874457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ba2757ff-cc78-4e9c-ba50-6df26c78741d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:19.887705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2757ff-cc78-4e9c-ba50-6df26c78741d admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.894176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.894862 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.895187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.895469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] PATH_INFO: `/v3/projects/b35f54e53035452b91724bd32ad15275` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.906508 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35f54e53035452b91724bd32ad15275)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:19.908825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:19.939186 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1129/2275] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:19 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:19.940672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8b03c-6068-485f-a8eb-939f6436f386 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.954744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8b03c-6068-485f-a8eb-939f6436f386 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.960118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f75865-d221-4ffc-ab54-54dde920a6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:19.960741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f75865-d221-4ffc-ab54-54dde920a6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:19.961022 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f75865-d221-4ffc-ab54-54dde920a6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:19.961295 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f75865-d221-4ffc-ab54-54dde920a6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:19.961953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f75865-d221-4ffc-ab54-54dde920a6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:19.963652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f75865-d221-4ffc-ab54-54dde920a6d8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:19.974547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35f54e53035452b91724bd32ad15275', 'request_id': 'req-acfb6515-32fd-4be2-9255-acde0cc954a4'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.975017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1130/2276] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:19.978504 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f75865-d221-4ffc-ab54-54dde920a6d8 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:19.983343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35f54e53035452b91724bd32ad15275', 'request_id': 'req-acfb6515-32fd-4be2-9255-acde0cc954a4'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.989649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f75865-d221-4ffc-ab54-54dde920a6d8 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:19.989828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35f54e53035452b91724bd32ad15275', 'request_id': 'req-acfb6515-32fd-4be2-9255-acde0cc954a4'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:19.994696 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:20.001749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] The token cache is being invalidate because project b35f54e53035452b91724bd32ad15275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:20.002049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.002846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.005166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1147/2277] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:19 2022] DELETE /identity/v3/projects/b35f54e53035452b91724bd32ad15275 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:20.008951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:20.010335 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:20.059712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fea218-8382-401c-806c-8605aa9bfa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:20.060410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fea218-8382-401c-806c-8605aa9bfa09 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.060723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fea218-8382-401c-806c-8605aa9bfa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.060999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fea218-8382-401c-806c-8605aa9bfa09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.061662 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fea218-8382-401c-806c-8605aa9bfa09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:20.063415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fea218-8382-401c-806c-8605aa9bfa09 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:20.076414 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1131/2278] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:20.081440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fea218-8382-401c-806c-8605aa9bfa09 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:20.083419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-25fea218-8382-401c-806c-8605aa9bfa09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:20.085590 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb6515-32fd-4be2-9255-acde0cc954a4 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:20.091320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5192a-cd44-4680-97d3-8da96b34607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:20.092173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5192a-cd44-4680-97d3-8da96b34607d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.092384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5192a-cd44-4680-97d3-8da96b34607d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.092835 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5192a-cd44-4680-97d3-8da96b34607d admin admin] PATH_INFO: `/v3/users/1f97f680d88b4261a3242415937b4032` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.094136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5192a-cd44-4680-97d3-8da96b34607d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f97f680d88b4261a3242415937b4032)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:20.096433 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5192a-cd44-4680-97d3-8da96b34607d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:20.098862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fea218-8382-401c-806c-8605aa9bfa09 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:20.115340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44f350-5481-48cd-a24a-343b05a6ca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:20.116080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44f350-5481-48cd-a24a-343b05a6ca0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.116422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44f350-5481-48cd-a24a-343b05a6ca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.116756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44f350-5481-48cd-a24a-343b05a6ca0d admin admin] PATH_INFO: `/v3/projects/a709cbc3c6ff4e59abe1392f3ada9493/users/f07080b5e10142c09ac7bd2e4f9102e3/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.135808 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:20.145706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44f350-5481-48cd-a24a-343b05a6ca0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a709cbc3c6ff4e59abe1392f3ada9493, user_id=f07080b5e10142c09ac7bd2e4f9102e3, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:20.149186 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44f350-5481-48cd-a24a-343b05a6ca0d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:20.166837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1132/2279] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:20 2022] PUT /identity/v3/projects/a709cbc3c6ff4e59abe1392f3ada9493/users/f07080b5e10142c09ac7bd2e4f9102e3/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:20.181026 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b1dd0-4b85-4d11-8228-6eb6d365a607 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.181371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b1dd0-4b85-4d11-8228-6eb6d365a607 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.181586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b1dd0-4b85-4d11-8228-6eb6d365a607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.201699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a8d5192a-cd44-4680-97d3-8da96b34607d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f97f680d88b4261a3242415937b4032'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.216072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a8d5192a-cd44-4680-97d3-8da96b34607d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f97f680d88b4261a3242415937b4032'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.220978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-ed5b1dd0-4b85-4d11-8228-6eb6d365a607 None None] MFA Rules not processed for user `f07080b5e10142c09ac7bd2e4f9102e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:20.222672 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ed5b1dd0-4b85-4d11-8228-6eb6d365a607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:20.229484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a8d5192a-cd44-4680-97d3-8da96b34607d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f97f680d88b4261a3242415937b4032'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.259903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a8d5192a-cd44-4680-97d3-8da96b34607d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f97f680d88b4261a3242415937b4032'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.261531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a8d5192a-cd44-4680-97d3-8da96b34607d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f97f680d88b4261a3242415937b4032'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:20.275783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1148/2280] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:20 2022] DELETE /identity/v3/users/1f97f680d88b4261a3242415937b4032 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:20.364478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1133/2281] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:20.380856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5192a-cd44-4680-97d3-8da96b34607d admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:20.384471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a8d5192a-cd44-4680-97d3-8da96b34607d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:20.596947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5192a-cd44-4680-97d3-8da96b34607d admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:20.608688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aef87a-23ab-4c10-b9d6-8f9789ba1ca7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7c46f4dc084a948bd09ca9b86c2748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:20.609446 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aef87a-23ab-4c10-b9d6-8f9789ba1ca7 service glance] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:20.609671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aef87a-23ab-4c10-b9d6-8f9789ba1ca7 service glance] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:20.609938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aef87a-23ab-4c10-b9d6-8f9789ba1ca7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:20.747057 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:20.827891 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aef87a-23ab-4c10-b9d6-8f9789ba1ca7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:20.830833 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aef87a-23ab-4c10-b9d6-8f9789ba1ca7 service glance] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:20.845434 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1149/2282] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:21.007678 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b1dd0-4b85-4d11-8228-6eb6d365a607 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.010118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ed5b1dd0-4b85-4d11-8228-6eb6d365a607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:21.118923 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b1dd0-4b85-4d11-8228-6eb6d365a607 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.185560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd549882-9b03-48ba-91b8-98284f5976c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.186422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd549882-9b03-48ba-91b8-98284f5976c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.186897 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd549882-9b03-48ba-91b8-98284f5976c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.187437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd549882-9b03-48ba-91b8-98284f5976c0 admin admin] PATH_INFO: `/v3/projects/3ba56682a6754910baf16873a9ae27e3` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.188712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd549882-9b03-48ba-91b8-98284f5976c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba56682a6754910baf16873a9ae27e3)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.190919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd549882-9b03-48ba-91b8-98284f5976c0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.252468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:21.285896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd549882-9b03-48ba-91b8-98284f5976c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba56682a6754910baf16873a9ae27e3', 'request_id': 'req-bd549882-9b03-48ba-91b8-98284f5976c0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:21.292144 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd549882-9b03-48ba-91b8-98284f5976c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba56682a6754910baf16873a9ae27e3', 'request_id': 'req-bd549882-9b03-48ba-91b8-98284f5976c0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:21.303862 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd549882-9b03-48ba-91b8-98284f5976c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba56682a6754910baf16873a9ae27e3', 'request_id': 'req-bd549882-9b03-48ba-91b8-98284f5976c0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:21.321441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd549882-9b03-48ba-91b8-98284f5976c0 admin admin] The token cache is being invalidate because project 3ba56682a6754910baf16873a9ae27e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:21.321776 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd549882-9b03-48ba-91b8-98284f5976c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:21.322536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd549882-9b03-48ba-91b8-98284f5976c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:21.330531 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1134/2283] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:21 2022] DELETE /identity/v3/projects/3ba56682a6754910baf16873a9ae27e3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:21.332897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0128921-7157-4612-adc1-51a72fcede82 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.333429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0128921-7157-4612-adc1-51a72fcede82 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.333809 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0128921-7157-4612-adc1-51a72fcede82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.369057 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-e0128921-7157-4612-adc1-51a72fcede82 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:21.370513 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e0128921-7157-4612-adc1-51a72fcede82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:21.446646 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1150/2284] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:21.457016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd335-0ad4-4a24-a4e0-1c8e65c6addd None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.457416 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd335-0ad4-4a24-a4e0-1c8e65c6addd None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.457792 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd335-0ad4-4a24-a4e0-1c8e65c6addd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.482094 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3d0bd335-0ad4-4a24-a4e0-1c8e65c6addd None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:21.487951 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3d0bd335-0ad4-4a24-a4e0-1c8e65c6addd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:21.501574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1135/2285] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:21.505675 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0128921-7157-4612-adc1-51a72fcede82 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.519183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0128921-7157-4612-adc1-51a72fcede82 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.527651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5de10b-3a82-4173-98ab-efe1e2ceca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.528634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5de10b-3a82-4173-98ab-efe1e2ceca19 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.529058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5de10b-3a82-4173-98ab-efe1e2ceca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.529464 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5de10b-3a82-4173-98ab-efe1e2ceca19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.531256 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5de10b-3a82-4173-98ab-efe1e2ceca19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:21.531795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5de10b-3a82-4173-98ab-efe1e2ceca19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.536480 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5de10b-3a82-4173-98ab-efe1e2ceca19 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.553162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1151/2286] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:04:21.554485 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bd335-0ad4-4a24-a4e0-1c8e65c6addd None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.565751 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bd335-0ad4-4a24-a4e0-1c8e65c6addd None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.570890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebee079-e9e8-4e58-8a09-35868f04bdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.571501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee079-e9e8-4e58-8a09-35868f04bdf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.572071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee079-e9e8-4e58-8a09-35868f04bdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.572192 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee079-e9e8-4e58-8a09-35868f04bdf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.572858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebee079-e9e8-4e58-8a09-35868f04bdf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.575151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebee079-e9e8-4e58-8a09-35868f04bdf8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.615494 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1136/2287] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:21 2022] POST /identity/v3/projects => generated 359 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:21.619160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5de10b-3a82-4173-98ab-efe1e2ceca19 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.631730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5de10b-3a82-4173-98ab-efe1e2ceca19 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.692796 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce53a3-a5ea-4241-9c12-8eac071d737e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.693486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce53a3-a5ea-4241-9c12-8eac071d737e admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.693728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce53a3-a5ea-4241-9c12-8eac071d737e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.694005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce53a3-a5ea-4241-9c12-8eac071d737e admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.694699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce53a3-a5ea-4241-9c12-8eac071d737e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.696694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce53a3-a5ea-4241-9c12-8eac071d737e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.738204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1152/2288] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:21 2022] POST /identity/v3/users => generated 280 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:21.743870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebee079-e9e8-4e58-8a09-35868f04bdf8 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.763370 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebee079-e9e8-4e58-8a09-35868f04bdf8 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.770763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbbc23-b168-4840-b219-00207deae3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.771295 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbbc23-b168-4840-b219-00207deae3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.772413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbbc23-b168-4840-b219-00207deae3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.772568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbbc23-b168-4840-b219-00207deae3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.773594 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbbc23-b168-4840-b219-00207deae3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.775053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbbc23-b168-4840-b219-00207deae3a3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.786902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1137/2289] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:21.791698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce53a3-a5ea-4241-9c12-8eac071d737e admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.803389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce53a3-a5ea-4241-9c12-8eac071d737e admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.809343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff4bb9-a3be-4530-96b9-3637e2a528a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.810113 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4bb9-a3be-4530-96b9-3637e2a528a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.810512 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4bb9-a3be-4530-96b9-3637e2a528a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.811012 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff4bb9-a3be-4530-96b9-3637e2a528a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.812081 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff4bb9-a3be-4530-96b9-3637e2a528a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.814882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff4bb9-a3be-4530-96b9-3637e2a528a7 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.829794 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1153/2290] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:21.834134 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbbc23-b168-4840-b219-00207deae3a3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:21.850413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbbc23-b168-4840-b219-00207deae3a3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:21.858403 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee5a01-01da-44e0-8887-473361a7a2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:21.859302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5a01-01da-44e0-8887-473361a7a2aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.859965 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5a01-01da-44e0-8887-473361a7a2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.859965 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee5a01-01da-44e0-8887-473361a7a2aa admin admin] PATH_INFO: `/v3/projects/063ecbf31fc54e5298972784e007b5ef/users/1a21b928860a43a8b97614c7f47553c3/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.882302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee5a01-01da-44e0-8887-473361a7a2aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=063ecbf31fc54e5298972784e007b5ef, user_id=1a21b928860a43a8b97614c7f47553c3, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:21.885031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee5a01-01da-44e0-8887-473361a7a2aa admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:21.899887 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1138/2291] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:21 2022] PUT /identity/v3/projects/063ecbf31fc54e5298972784e007b5ef/users/1a21b928860a43a8b97614c7f47553c3/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:21.912407 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7ff78-66a7-477d-9098-ab4c3a3d5d39 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:21.912995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7ff78-66a7-477d-9098-ab4c3a3d5d39 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:21.913227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7ff78-66a7-477d-9098-ab4c3a3d5d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:21.991748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-39c7ff78-66a7-477d-9098-ab4c3a3d5d39 None None] MFA Rules not processed for user `1a21b928860a43a8b97614c7f47553c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:21.993170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-39c7ff78-66a7-477d-9098-ab4c3a3d5d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:22.029519 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:22.135892 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1154/2292] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:22.184619 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee5a01-01da-44e0-8887-473361a7a2aa admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:22.186512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f7ee5a01-01da-44e0-8887-473361a7a2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:22.294083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee5a01-01da-44e0-8887-473361a7a2aa admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:22.300060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bcac0-dcb2-471a-8993-87628a7bf163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:22.301297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bcac0-dcb2-471a-8993-87628a7bf163 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.301731 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bcac0-dcb2-471a-8993-87628a7bf163 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.302165 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bcac0-dcb2-471a-8993-87628a7bf163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:22.314809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33bcac0-dcb2-471a-8993-87628a7bf163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:22.329955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33bcac0-dcb2-471a-8993-87628a7bf163 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:22.344420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1139/2293] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:22.365106 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7ff78-66a7-477d-9098-ab4c3a3d5d39 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:22.575351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7ff78-66a7-477d-9098-ab4c3a3d5d39 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:22.582310 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72ab5a-94d8-4fc0-8e86-2813f18c4ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:22.583419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72ab5a-94d8-4fc0-8e86-2813f18c4ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.583839 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72ab5a-94d8-4fc0-8e86-2813f18c4ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.584306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72ab5a-94d8-4fc0-8e86-2813f18c4ece admin admin] PATH_INFO: `/v3/users/1a21b928860a43a8b97614c7f47553c3` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:22.586191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72ab5a-94d8-4fc0-8e86-2813f18c4ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a21b928860a43a8b97614c7f47553c3)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:22.589588 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72ab5a-94d8-4fc0-8e86-2813f18c4ece admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:22.665420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4c72ab5a-94d8-4fc0-8e86-2813f18c4ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a21b928860a43a8b97614c7f47553c3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:22.680915 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4c72ab5a-94d8-4fc0-8e86-2813f18c4ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a21b928860a43a8b97614c7f47553c3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:22.691187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4c72ab5a-94d8-4fc0-8e86-2813f18c4ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a21b928860a43a8b97614c7f47553c3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:22.701607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4c72ab5a-94d8-4fc0-8e86-2813f18c4ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a21b928860a43a8b97614c7f47553c3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:22.703554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4c72ab5a-94d8-4fc0-8e86-2813f18c4ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a21b928860a43a8b97614c7f47553c3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:22.715513 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1155/2294] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:22 2022] DELETE /identity/v3/users/1a21b928860a43a8b97614c7f47553c3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:22.719977 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369874ee-9ea4-4d05-9957-ea43a055e5cc None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.720253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369874ee-9ea4-4d05-9957-ea43a055e5cc None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.720528 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369874ee-9ea4-4d05-9957-ea43a055e5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:22.743136 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-369874ee-9ea4-4d05-9957-ea43a055e5cc None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:22.744153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-369874ee-9ea4-4d05-9957-ea43a055e5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:22.804177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:22.819079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1140/2295] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:22.829594 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72ab5a-94d8-4fc0-8e86-2813f18c4ece admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:22.831070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4c72ab5a-94d8-4fc0-8e86-2813f18c4ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:22.885260 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:22.907881 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72ab5a-94d8-4fc0-8e86-2813f18c4ece admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:22.911979 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a96ba6-8582-403a-9dca-7954f246c9ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:22.912634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a96ba6-8582-403a-9dca-7954f246c9ee service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:22.912940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a96ba6-8582-403a-9dca-7954f246c9ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:22.913219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a96ba6-8582-403a-9dca-7954f246c9ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:22.932000 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a96ba6-8582-403a-9dca-7954f246c9ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:22.933666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a96ba6-8582-403a-9dca-7954f246c9ee service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:22.947098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1156/2296] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:23.352927 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369874ee-9ea4-4d05-9957-ea43a055e5cc None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:23.355369 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-369874ee-9ea4-4d05-9957-ea43a055e5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:23.380920 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369874ee-9ea4-4d05-9957-ea43a055e5cc None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:23.391962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:23.392220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:23.392693 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:23.393056 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc admin admin] PATH_INFO: `/v3/projects/063ecbf31fc54e5298972784e007b5ef` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:23.394551 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=063ecbf31fc54e5298972784e007b5ef)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:23.396730 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:23.491688 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '063ecbf31fc54e5298972784e007b5ef', 'request_id': 'req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:23.497351 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '063ecbf31fc54e5298972784e007b5ef', 'request_id': 'req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:23.505784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '063ecbf31fc54e5298972784e007b5ef', 'request_id': 'req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:23.518783 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc admin admin] The token cache is being invalidate because project 063ecbf31fc54e5298972784e007b5ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:23.519076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:23.519823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e25c25fd-7af6-43ac-b077-fc2cf3ede3cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:23.521842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1141/2297] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:23 2022] DELETE /identity/v3/projects/063ecbf31fc54e5298972784e007b5ef => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:23.527260 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d05e-90aa-4aed-ab7e-54a353704b5e None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:23.527260 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d05e-90aa-4aed-ab7e-54a353704b5e None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:23.530969 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d05e-90aa-4aed-ab7e-54a353704b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:23.550704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c370d05e-90aa-4aed-ab7e-54a353704b5e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:23.552132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c370d05e-90aa-4aed-ab7e-54a353704b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:23.622977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1157/2298] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:23.632375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff04d4-2c5f-4930-af75-db636ede0762 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:23.632830 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff04d4-2c5f-4930-af75-db636ede0762 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:23.633442 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff04d4-2c5f-4930-af75-db636ede0762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:23.682635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9aff04d4-2c5f-4930-af75-db636ede0762 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:23.684215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9aff04d4-2c5f-4930-af75-db636ede0762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:23.699377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1142/2299] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:23.700102 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370d05e-90aa-4aed-ab7e-54a353704b5e None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:23.712362 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370d05e-90aa-4aed-ab7e-54a353704b5e None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:23.719550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0c907-27c6-4a11-84ad-4ebe9f52033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:23.720597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0c907-27c6-4a11-84ad-4ebe9f52033f admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:23.721024 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0c907-27c6-4a11-84ad-4ebe9f52033f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:23.721431 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0c907-27c6-4a11-84ad-4ebe9f52033f admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:23.722318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0c907-27c6-4a11-84ad-4ebe9f52033f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:23.723084 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0c907-27c6-4a11-84ad-4ebe9f52033f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:23.725140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0c907-27c6-4a11-84ad-4ebe9f52033f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:23.739434 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1158/2300] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:04:23.753125 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff04d4-2c5f-4930-af75-db636ede0762 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:23.754180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff04d4-2c5f-4930-af75-db636ede0762 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:23.768202 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af8460-e3ac-4304-b881-f90c2569d558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:23.769293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af8460-e3ac-4304-b881-f90c2569d558 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:23.769836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af8460-e3ac-4304-b881-f90c2569d558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:23.770373 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af8460-e3ac-4304-b881-f90c2569d558 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:23.771619 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af8460-e3ac-4304-b881-f90c2569d558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:23.775285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af8460-e3ac-4304-b881-f90c2569d558 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:23.836303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1143/2301] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:23 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:23.841060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0c907-27c6-4a11-84ad-4ebe9f52033f admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:23.852973 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0c907-27c6-4a11-84ad-4ebe9f52033f admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:23.925322 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b30dd9-2e94-49b2-99c4-8ca03ad40e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:23.925979 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b30dd9-2e94-49b2-99c4-8ca03ad40e3a admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:23.926250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b30dd9-2e94-49b2-99c4-8ca03ad40e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:23.926519 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b30dd9-2e94-49b2-99c4-8ca03ad40e3a admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:23.927217 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b30dd9-2e94-49b2-99c4-8ca03ad40e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:23.929558 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b30dd9-2e94-49b2-99c4-8ca03ad40e3a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:23.952677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1159/2302] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:23 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:04:23.957026 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af8460-e3ac-4304-b881-f90c2569d558 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:23.969339 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af8460-e3ac-4304-b881-f90c2569d558 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:23.977015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60b245-a9a2-41a2-985e-617644305ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:23.977836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60b245-a9a2-41a2-985e-617644305ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:23.978212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60b245-a9a2-41a2-985e-617644305ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:23.978578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60b245-a9a2-41a2-985e-617644305ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:23.979394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60b245-a9a2-41a2-985e-617644305ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:23.981185 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60b245-a9a2-41a2-985e-617644305ac8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:24.004840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1144/2303] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:24.009083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b30dd9-2e94-49b2-99c4-8ca03ad40e3a admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:24.022311 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b30dd9-2e94-49b2-99c4-8ca03ad40e3a admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:24.028822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa38168-78fd-4b35-82ec-2ac16f9a3157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:24.029474 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa38168-78fd-4b35-82ec-2ac16f9a3157 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:24.029749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa38168-78fd-4b35-82ec-2ac16f9a3157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:24.030026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa38168-78fd-4b35-82ec-2ac16f9a3157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:24.030784 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa38168-78fd-4b35-82ec-2ac16f9a3157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:24.032481 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa38168-78fd-4b35-82ec-2ac16f9a3157 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:24.044763 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1160/2304] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:24.049182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60b245-a9a2-41a2-985e-617644305ac8 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:24.059896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60b245-a9a2-41a2-985e-617644305ac8 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:24.064778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31e8cf-1935-4140-a144-a560a963445e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:24.065459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31e8cf-1935-4140-a144-a560a963445e admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:24.065738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31e8cf-1935-4140-a144-a560a963445e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:24.066013 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e31e8cf-1935-4140-a144-a560a963445e admin admin] PATH_INFO: `/v3/projects/dd288bf253374297875fd352e5f7bf11/users/ff1d2f6850ab48768c84b22528168deb/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:24.104915 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31e8cf-1935-4140-a144-a560a963445e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd288bf253374297875fd352e5f7bf11, user_id=ff1d2f6850ab48768c84b22528168deb, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:24.120997 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e31e8cf-1935-4140-a144-a560a963445e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:24.143534 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1145/2305] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:24 2022] PUT /identity/v3/projects/dd288bf253374297875fd352e5f7bf11/users/ff1d2f6850ab48768c84b22528168deb/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:24.155285 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37381a-03c3-4d3f-a0e4-b6ce94745064 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:24.155846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37381a-03c3-4d3f-a0e4-b6ce94745064 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:24.156272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37381a-03c3-4d3f-a0e4-b6ce94745064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:24.186956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-4e37381a-03c3-4d3f-a0e4-b6ce94745064 None None] MFA Rules not processed for user `ff1d2f6850ab48768c84b22528168deb`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:24.188207 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4e37381a-03c3-4d3f-a0e4-b6ce94745064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:24.245068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:24.274797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1161/2306] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:24.286629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31e8cf-1935-4140-a144-a560a963445e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:24.392651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e31e8cf-1935-4140-a144-a560a963445e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:24.398309 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f94ea1-016c-4623-bcdb-d5695b6410e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:24.399150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f94ea1-016c-4623-bcdb-d5695b6410e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:24.399472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f94ea1-016c-4623-bcdb-d5695b6410e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:24.399863 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f94ea1-016c-4623-bcdb-d5695b6410e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:24.400517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f94ea1-016c-4623-bcdb-d5695b6410e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:24.403062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f94ea1-016c-4623-bcdb-d5695b6410e8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:24.429550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:24.437415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1146/2307] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:24 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:24.441752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37381a-03c3-4d3f-a0e4-b6ce94745064 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:24.453596 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37381a-03c3-4d3f-a0e4-b6ce94745064 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:24.536935 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4bff-b3f8-425f-8eed-a2fa50b08ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:24.537900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4bff-b3f8-425f-8eed-a2fa50b08ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:24.538381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4bff-b3f8-425f-8eed-a2fa50b08ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:24.538902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4bff-b3f8-425f-8eed-a2fa50b08ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:24.539739 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd4bff-b3f8-425f-8eed-a2fa50b08ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:24.542869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd4bff-b3f8-425f-8eed-a2fa50b08ea8 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:24.589393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1162/2308] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:24 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:24.596326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f94ea1-016c-4623-bcdb-d5695b6410e8 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:24.621039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f94ea1-016c-4623-bcdb-d5695b6410e8 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:24.630192 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21446ab1-6cbb-484d-ab60-9a43543a4bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:24.631877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21446ab1-6cbb-484d-ab60-9a43543a4bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:24.632401 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21446ab1-6cbb-484d-ab60-9a43543a4bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:24.632891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21446ab1-6cbb-484d-ab60-9a43543a4bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:24.634036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21446ab1-6cbb-484d-ab60-9a43543a4bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:24.637263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21446ab1-6cbb-484d-ab60-9a43543a4bbe admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:24.658287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1147/2309] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:24.659395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4bff-b3f8-425f-8eed-a2fa50b08ea8 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:24.671453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4bff-b3f8-425f-8eed-a2fa50b08ea8 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:24.677158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8436d-bee1-4db5-9a1c-e8c290effb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:24.677928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8436d-bee1-4db5-9a1c-e8c290effb85 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:24.678208 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8436d-bee1-4db5-9a1c-e8c290effb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:24.678488 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8436d-bee1-4db5-9a1c-e8c290effb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:24.679181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8436d-bee1-4db5-9a1c-e8c290effb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:24.680862 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8436d-bee1-4db5-9a1c-e8c290effb85 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:24.692093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1163/2310] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:04:24.698378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21446ab1-6cbb-484d-ab60-9a43543a4bbe admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:24.711690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21446ab1-6cbb-484d-ab60-9a43543a4bbe admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:24.716712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfcc7e-7708-4fe1-98bc-e3ef8734052a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:24.717392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfcc7e-7708-4fe1-98bc-e3ef8734052a admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:24.717670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfcc7e-7708-4fe1-98bc-e3ef8734052a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:24.717945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfcc7e-7708-4fe1-98bc-e3ef8734052a admin admin] PATH_INFO: `/v3/projects/852e1043a9314f5dbcfa76d9ada290e4/users/e710678b6ac147d4a5e00c3fc3d57d34/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:24.736000 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfcc7e-7708-4fe1-98bc-e3ef8734052a admin admin] RBAC: Authorizing `identity:create_grant(project_id=852e1043a9314f5dbcfa76d9ada290e4, user_id=e710678b6ac147d4a5e00c3fc3d57d34, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:24.744715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfcc7e-7708-4fe1-98bc-e3ef8734052a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:24.764290 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1148/2311] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:24 2022] PUT /identity/v3/projects/852e1043a9314f5dbcfa76d9ada290e4/users/e710678b6ac147d4a5e00c3fc3d57d34/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:24.774682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d551fc9-a614-408f-b277-446472d5672f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:24.775056 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d551fc9-a614-408f-b277-446472d5672f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:24.775368 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d551fc9-a614-408f-b277-446472d5672f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:24.812130 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-5d551fc9-a614-408f-b277-446472d5672f None None] MFA Rules not processed for user `e710678b6ac147d4a5e00c3fc3d57d34`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:24.813272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5d551fc9-a614-408f-b277-446472d5672f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:24.912350 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1164/2312] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:24.913846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfcc7e-7708-4fe1-98bc-e3ef8734052a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:24.983642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfcc7e-7708-4fe1-98bc-e3ef8734052a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:24.988516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc550a9-226d-44e8-bae9-c89e65a34a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:24.989145 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc550a9-226d-44e8-bae9-c89e65a34a4b admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:24.989424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc550a9-226d-44e8-bae9-c89e65a34a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:24.989697 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc550a9-226d-44e8-bae9-c89e65a34a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:24.990419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc550a9-226d-44e8-bae9-c89e65a34a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:24.992405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc550a9-226d-44e8-bae9-c89e65a34a4b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:25.034114 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1149/2313] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:24 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:25.038782 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d551fc9-a614-408f-b277-446472d5672f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:25.051353 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d551fc9-a614-408f-b277-446472d5672f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:25.117223 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:25.134986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce8715-6a5b-42ba-81b7-e9b8c5824e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:25.135617 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce8715-6a5b-42ba-81b7-e9b8c5824e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:25.135897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce8715-6a5b-42ba-81b7-e9b8c5824e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:25.136169 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce8715-6a5b-42ba-81b7-e9b8c5824e37 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:25.136872 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce8715-6a5b-42ba-81b7-e9b8c5824e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:25.138888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce8715-6a5b-42ba-81b7-e9b8c5824e37 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:25.169306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1165/2314] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:25 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:25.173199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc550a9-226d-44e8-bae9-c89e65a34a4b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:25.184975 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc550a9-226d-44e8-bae9-c89e65a34a4b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:25.190075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95985a12-0f8a-424e-b3d4-ee50033554a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:25.190821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95985a12-0f8a-424e-b3d4-ee50033554a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:25.191096 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95985a12-0f8a-424e-b3d4-ee50033554a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:25.191456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95985a12-0f8a-424e-b3d4-ee50033554a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:25.192190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95985a12-0f8a-424e-b3d4-ee50033554a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:25.193947 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95985a12-0f8a-424e-b3d4-ee50033554a9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:25.207166 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1150/2315] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:25.211456 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce8715-6a5b-42ba-81b7-e9b8c5824e37 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:25.221841 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce8715-6a5b-42ba-81b7-e9b8c5824e37 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:25.226746 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf78172-5d6c-4019-9af1-fe414ffae890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:25.227407 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78172-5d6c-4019-9af1-fe414ffae890 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:25.227720 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78172-5d6c-4019-9af1-fe414ffae890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:25.227954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78172-5d6c-4019-9af1-fe414ffae890 admin admin] PATH_INFO: `/v3/projects/3a4a38aa376e483d9991e0fbc270570a/users/78c9c700b32d4fbe95eafdd40b711d84/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:25.244485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf78172-5d6c-4019-9af1-fe414ffae890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4a38aa376e483d9991e0fbc270570a, user_id=78c9c700b32d4fbe95eafdd40b711d84, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:25.247669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf78172-5d6c-4019-9af1-fe414ffae890 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:25.277654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1166/2316] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:25 2022] PUT /identity/v3/projects/3a4a38aa376e483d9991e0fbc270570a/users/78c9c700b32d4fbe95eafdd40b711d84/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:25.278954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95985a12-0f8a-424e-b3d4-ee50033554a9 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:25.301258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95985a12-0f8a-424e-b3d4-ee50033554a9 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:25.372749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5472b9b-48f2-49b0-8d15-508b67740038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:25.373184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5472b9b-48f2-49b0-8d15-508b67740038 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:25.373487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5472b9b-48f2-49b0-8d15-508b67740038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:25.373764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5472b9b-48f2-49b0-8d15-508b67740038 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:25.374398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5472b9b-48f2-49b0-8d15-508b67740038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:25.376035 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5472b9b-48f2-49b0-8d15-508b67740038 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:25.387865 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1151/2317] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:25.400280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf78172-5d6c-4019-9af1-fe414ffae890 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:25.411203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf78172-5d6c-4019-9af1-fe414ffae890 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:25.416222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a44ba-48f4-41c2-a76a-3047af2d9d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:25.416906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a44ba-48f4-41c2-a76a-3047af2d9d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:25.417190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a44ba-48f4-41c2-a76a-3047af2d9d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:25.417432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a44ba-48f4-41c2-a76a-3047af2d9d17 admin admin] PATH_INFO: `/v3/projects/3a4a38aa376e483d9991e0fbc270570a/users/78c9c700b32d4fbe95eafdd40b711d84/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:25.419897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a44ba-48f4-41c2-a76a-3047af2d9d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4a38aa376e483d9991e0fbc270570a, user_id=78c9c700b32d4fbe95eafdd40b711d84, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:25.422646 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a44ba-48f4-41c2-a76a-3047af2d9d17 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:25.436042 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1167/2318] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:25 2022] PUT /identity/v3/projects/3a4a38aa376e483d9991e0fbc270570a/users/78c9c700b32d4fbe95eafdd40b711d84/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:04:25.446635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c501c5-2341-4417-ae05-648cd44a34b7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:25.447214 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c501c5-2341-4417-ae05-648cd44a34b7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:25.447214 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c501c5-2341-4417-ae05-648cd44a34b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:25.478787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-99c501c5-2341-4417-ae05-648cd44a34b7 None None] MFA Rules not processed for user `78c9c700b32d4fbe95eafdd40b711d84`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:25.480040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-99c501c5-2341-4417-ae05-648cd44a34b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:25.511712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:25.573483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1152/2319] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:25.588041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a44ba-48f4-41c2-a76a-3047af2d9d17 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:25.590243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3c0a44ba-48f4-41c2-a76a-3047af2d9d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:25.689141 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a44ba-48f4-41c2-a76a-3047af2d9d17 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:25.693808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067c3b5-cd9c-4ede-83b0-58e33a8ef734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:25.694541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067c3b5-cd9c-4ede-83b0-58e33a8ef734 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:25.694957 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067c3b5-cd9c-4ede-83b0-58e33a8ef734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:25.695270 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067c3b5-cd9c-4ede-83b0-58e33a8ef734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:25.785884 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067c3b5-cd9c-4ede-83b0-58e33a8ef734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:25.788821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067c3b5-cd9c-4ede-83b0-58e33a8ef734 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:25.806364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1168/2320] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:27.485081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c501c5-2341-4417-ae05-648cd44a34b7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:27.497372 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c501c5-2341-4417-ae05-648cd44a34b7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:27.501431 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2a67a-42c9-4b75-beeb-1bf565c321c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:27.502055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2a67a-42c9-4b75-beeb-1bf565c321c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:27.502338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2a67a-42c9-4b75-beeb-1bf565c321c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:27.502647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2a67a-42c9-4b75-beeb-1bf565c321c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:27.568581 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2a67a-42c9-4b75-beeb-1bf565c321c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:27.570793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2a67a-42c9-4b75-beeb-1bf565c321c5 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:27.584035 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1153/2321] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:28.278269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067c3b5-cd9c-4ede-83b0-58e33a8ef734 service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:28.287440 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067c3b5-cd9c-4ede-83b0-58e33a8ef734 service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:28.292151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98af4a3-c43f-4d0d-b842-e63beffa62be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:28.292780 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98af4a3-c43f-4d0d-b842-e63beffa62be service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:28.293058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98af4a3-c43f-4d0d-b842-e63beffa62be service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:28.293377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98af4a3-c43f-4d0d-b842-e63beffa62be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:28.310163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98af4a3-c43f-4d0d-b842-e63beffa62be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:28.312191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98af4a3-c43f-4d0d-b842-e63beffa62be service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:28.327005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1169/2322] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:32.384266 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2a67a-42c9-4b75-beeb-1bf565c321c5 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:32.510167 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2a67a-42c9-4b75-beeb-1bf565c321c5 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:32.516933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7652a1-0d44-407f-a09c-f8779ee583d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:32.517602 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7652a1-0d44-407f-a09c-f8779ee583d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:32.517878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7652a1-0d44-407f-a09c-f8779ee583d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:32.518367 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7652a1-0d44-407f-a09c-f8779ee583d7 admin admin] PATH_INFO: `/v3/users/ff1d2f6850ab48768c84b22528168deb` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:32.521650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7652a1-0d44-407f-a09c-f8779ee583d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1d2f6850ab48768c84b22528168deb)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:32.523667 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7652a1-0d44-407f-a09c-f8779ee583d7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:32.588463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5d7652a1-0d44-407f-a09c-f8779ee583d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1d2f6850ab48768c84b22528168deb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:32.589426 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5d7652a1-0d44-407f-a09c-f8779ee583d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1d2f6850ab48768c84b22528168deb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:32.590172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5d7652a1-0d44-407f-a09c-f8779ee583d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1d2f6850ab48768c84b22528168deb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:32.598963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5d7652a1-0d44-407f-a09c-f8779ee583d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1d2f6850ab48768c84b22528168deb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:32.603661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:32.607965 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5d7652a1-0d44-407f-a09c-f8779ee583d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1d2f6850ab48768c84b22528168deb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:32.653572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1154/2323] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:32 2022] DELETE /identity/v3/users/ff1d2f6850ab48768c84b22528168deb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:32.654506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05a1e9-abee-41a8-9584-bd1759609bd6 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:32.655028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05a1e9-abee-41a8-9584-bd1759609bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:32.655139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05a1e9-abee-41a8-9584-bd1759609bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:32.683327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-bd05a1e9-abee-41a8-9584-bd1759609bd6 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:32.702158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bd05a1e9-abee-41a8-9584-bd1759609bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:32.775601 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:32.811427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1170/2324] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:32.829687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7652a1-0d44-407f-a09c-f8779ee583d7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:32.832258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5d7652a1-0d44-407f-a09c-f8779ee583d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:32.915632 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7652a1-0d44-407f-a09c-f8779ee583d7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:32.919686 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a7948-9fbf-44b4-af8c-db5ee66004ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:32.920603 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a7948-9fbf-44b4-af8c-db5ee66004ed service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:32.920886 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a7948-9fbf-44b4-af8c-db5ee66004ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:32.921319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a7948-9fbf-44b4-af8c-db5ee66004ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:32.935779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a7948-9fbf-44b4-af8c-db5ee66004ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:32.937260 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a7948-9fbf-44b4-af8c-db5ee66004ed service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:32.947793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1155/2325] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:04:33.662454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05a1e9-abee-41a8-9584-bd1759609bd6 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:33.665675 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bd05a1e9-abee-41a8-9584-bd1759609bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:33.702977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05a1e9-abee-41a8-9584-bd1759609bd6 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:33.727592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1343b-2be4-4fc9-9e58-135056ea0b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:33.728997 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1343b-2be4-4fc9-9e58-135056ea0b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:33.729279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1343b-2be4-4fc9-9e58-135056ea0b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:33.729544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1343b-2be4-4fc9-9e58-135056ea0b04 admin admin] PATH_INFO: `/v3/projects/dd288bf253374297875fd352e5f7bf11` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:33.730774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1343b-2be4-4fc9-9e58-135056ea0b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd288bf253374297875fd352e5f7bf11)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:33.732665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1343b-2be4-4fc9-9e58-135056ea0b04 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:33.802387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-9ee1343b-2be4-4fc9-9e58-135056ea0b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd288bf253374297875fd352e5f7bf11', 'request_id': 'req-9ee1343b-2be4-4fc9-9e58-135056ea0b04'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.813120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-9ee1343b-2be4-4fc9-9e58-135056ea0b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd288bf253374297875fd352e5f7bf11', 'request_id': 'req-9ee1343b-2be4-4fc9-9e58-135056ea0b04'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.826533 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-9ee1343b-2be4-4fc9-9e58-135056ea0b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd288bf253374297875fd352e5f7bf11', 'request_id': 'req-9ee1343b-2be4-4fc9-9e58-135056ea0b04'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.853883 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-9ee1343b-2be4-4fc9-9e58-135056ea0b04 admin admin] The token cache is being invalidate because project dd288bf253374297875fd352e5f7bf11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:33.854567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-9ee1343b-2be4-4fc9-9e58-135056ea0b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.856448 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-9ee1343b-2be4-4fc9-9e58-135056ea0b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:33.866946 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1171/2326] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:33 2022] DELETE /identity/v3/projects/dd288bf253374297875fd352e5f7bf11 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:33.867058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a7948-9fbf-44b4-af8c-db5ee66004ed service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:33.869686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462870ba-f5be-4648-a1aa-f3263af28dea None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:33.870044 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462870ba-f5be-4648-a1aa-f3263af28dea None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:33.870408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462870ba-f5be-4648-a1aa-f3263af28dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:33.882243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a7948-9fbf-44b4-af8c-db5ee66004ed service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:33.893979 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-462870ba-f5be-4648-a1aa-f3263af28dea None None] MFA Rules not processed for user `4d3445e9462b42cd82ea10ed54193c89`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:33.895465 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-462870ba-f5be-4648-a1aa-f3263af28dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:33.977435 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8fb7b-8ab8-41a3-a1de-26c65a7cb7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:33.978094 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8fb7b-8ab8-41a3-a1de-26c65a7cb7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:33.978358 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8fb7b-8ab8-41a3-a1de-26c65a7cb7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:33.978797 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8fb7b-8ab8-41a3-a1de-26c65a7cb7f4 admin admin] PATH_INFO: `/v3/users/e710678b6ac147d4a5e00c3fc3d57d34` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:33.980056 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8fb7b-8ab8-41a3-a1de-26c65a7cb7f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e710678b6ac147d4a5e00c3fc3d57d34)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:33.982495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8fb7b-8ab8-41a3-a1de-26c65a7cb7f4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:33.993084 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1172/2327] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:04:34.068925 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f1d8fb7b-8ab8-41a3-a1de-26c65a7cb7f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e710678b6ac147d4a5e00c3fc3d57d34'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.069827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f1d8fb7b-8ab8-41a3-a1de-26c65a7cb7f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e710678b6ac147d4a5e00c3fc3d57d34'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.070560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f1d8fb7b-8ab8-41a3-a1de-26c65a7cb7f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e710678b6ac147d4a5e00c3fc3d57d34'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.080035 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f1d8fb7b-8ab8-41a3-a1de-26c65a7cb7f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e710678b6ac147d4a5e00c3fc3d57d34'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.088882 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f1d8fb7b-8ab8-41a3-a1de-26c65a7cb7f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e710678b6ac147d4a5e00c3fc3d57d34'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.107547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:34.116346 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1156/2328] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:33 2022] DELETE /identity/v3/users/e710678b6ac147d4a5e00c3fc3d57d34 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:34.599025 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462870ba-f5be-4648-a1aa-f3263af28dea None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:34.603250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-462870ba-f5be-4648-a1aa-f3263af28dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:34.647067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462870ba-f5be-4648-a1aa-f3263af28dea None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:34.772999 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:34.773704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:34.774051 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:34.774305 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] PATH_INFO: `/v3/projects/852e1043a9314f5dbcfa76d9ada290e4` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:34.775947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=852e1043a9314f5dbcfa76d9ada290e4)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:34.778091 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:34.799032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:34.853869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852e1043a9314f5dbcfa76d9ada290e4', 'request_id': 'req-527640fc-2e00-4054-bcd2-e889c0a7a8c3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.867509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852e1043a9314f5dbcfa76d9ada290e4', 'request_id': 'req-527640fc-2e00-4054-bcd2-e889c0a7a8c3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.875688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852e1043a9314f5dbcfa76d9ada290e4', 'request_id': 'req-527640fc-2e00-4054-bcd2-e889c0a7a8c3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.890642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] The token cache is being invalidate because project 852e1043a9314f5dbcfa76d9ada290e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:34.891222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.892905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:34.894925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1173/2329] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:34 2022] DELETE /identity/v3/projects/852e1043a9314f5dbcfa76d9ada290e4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:34.911268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8fb7b-8ab8-41a3-a1de-26c65a7cb7f4 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:34.911268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f1d8fb7b-8ab8-41a3-a1de-26c65a7cb7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:34.920606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8fb7b-8ab8-41a3-a1de-26c65a7cb7f4 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:35.010157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0e4fa-5dcb-4d0c-8982-992ea4dafa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:35.010871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0e4fa-5dcb-4d0c-8982-992ea4dafa98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:35.011149 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0e4fa-5dcb-4d0c-8982-992ea4dafa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:35.011509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0e4fa-5dcb-4d0c-8982-992ea4dafa98 admin admin] PATH_INFO: `/v3/users/78c9c700b32d4fbe95eafdd40b711d84` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:35.013070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0e4fa-5dcb-4d0c-8982-992ea4dafa98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c9c700b32d4fbe95eafdd40b711d84)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:35.015236 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0e4fa-5dcb-4d0c-8982-992ea4dafa98 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:35.069971 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7ef0e4fa-5dcb-4d0c-8982-992ea4dafa98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c9c700b32d4fbe95eafdd40b711d84'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.070752 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7ef0e4fa-5dcb-4d0c-8982-992ea4dafa98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c9c700b32d4fbe95eafdd40b711d84'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.071473 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7ef0e4fa-5dcb-4d0c-8982-992ea4dafa98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c9c700b32d4fbe95eafdd40b711d84'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.080279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7ef0e4fa-5dcb-4d0c-8982-992ea4dafa98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c9c700b32d4fbe95eafdd40b711d84'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.088785 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7ef0e4fa-5dcb-4d0c-8982-992ea4dafa98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c9c700b32d4fbe95eafdd40b711d84'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.131892 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1157/2330] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:34 2022] DELETE /identity/v3/users/78c9c700b32d4fbe95eafdd40b711d84 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:35.489781 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:35.491490 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:35.512304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527640fc-2e00-4054-bcd2-e889c0a7a8c3 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:35.615235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:35.615874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:35.616847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:35.617128 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] PATH_INFO: `/v3/projects/3a4a38aa376e483d9991e0fbc270570a` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:35.618328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4a38aa376e483d9991e0fbc270570a)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:35.620359 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:35.692785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4a38aa376e483d9991e0fbc270570a', 'request_id': 'req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.703678 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4a38aa376e483d9991e0fbc270570a', 'request_id': 'req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.711134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4a38aa376e483d9991e0fbc270570a', 'request_id': 'req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.732471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] The token cache is being invalidate because project 3a4a38aa376e483d9991e0fbc270570a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:35.733179 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.733922 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:35.735785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1174/2331] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:35 2022] DELETE /identity/v3/projects/3a4a38aa376e483d9991e0fbc270570a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:40.202141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f658ac7-1e82-44b9-a3ee-b9b021d1c848 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:40.202733 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f658ac7-1e82-44b9-a3ee-b9b021d1c848 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:40.202733 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f658ac7-1e82-44b9-a3ee-b9b021d1c848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:40.236773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1f658ac7-1e82-44b9-a3ee-b9b021d1c848 None None] MFA Rules not processed for user `0a01c075e69b49aa8f44968ed2cca1b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:40.236773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1f658ac7-1e82-44b9-a3ee-b9b021d1c848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:40.307120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1158/2332] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:45.728037 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=69,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:45.866774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:45.868351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:45.931845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e0b56-0bed-4299-97e5-f7b6bcf4cbf0 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:45.935822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08b928-6e4e-4be1-b19a-2e783ba085fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:45.936429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08b928-6e4e-4be1-b19a-2e783ba085fb service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:45.936712 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08b928-6e4e-4be1-b19a-2e783ba085fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:45.936985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08b928-6e4e-4be1-b19a-2e783ba085fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:45.938864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3a08b928-6e4e-4be1-b19a-2e783ba085fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:46.009305 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08b928-6e4e-4be1-b19a-2e783ba085fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:46.012062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08b928-6e4e-4be1-b19a-2e783ba085fb service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:46.022196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1175/2333] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:47.357279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f658ac7-1e82-44b9-a3ee-b9b021d1c848 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:47.359127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1f658ac7-1e82-44b9-a3ee-b9b021d1c848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:47.390436 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:47.442364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f658ac7-1e82-44b9-a3ee-b9b021d1c848 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:47.449841 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f6899-064b-4288-82d7-d6e60e85ae9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:47.450483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f6899-064b-4288-82d7-d6e60e85ae9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:47.450825 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f6899-064b-4288-82d7-d6e60e85ae9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:47.451101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f6899-064b-4288-82d7-d6e60e85ae9f admin admin] PATH_INFO: `/v3/users/f07080b5e10142c09ac7bd2e4f9102e3` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:47.452490 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f6899-064b-4288-82d7-d6e60e85ae9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07080b5e10142c09ac7bd2e4f9102e3)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:47.454522 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f6899-064b-4288-82d7-d6e60e85ae9f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:47.514875 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f17f6899-064b-4288-82d7-d6e60e85ae9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07080b5e10142c09ac7bd2e4f9102e3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:47.515560 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f17f6899-064b-4288-82d7-d6e60e85ae9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07080b5e10142c09ac7bd2e4f9102e3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:47.516192 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f17f6899-064b-4288-82d7-d6e60e85ae9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07080b5e10142c09ac7bd2e4f9102e3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:47.525860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f17f6899-064b-4288-82d7-d6e60e85ae9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07080b5e10142c09ac7bd2e4f9102e3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:47.540956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f17f6899-064b-4288-82d7-d6e60e85ae9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07080b5e10142c09ac7bd2e4f9102e3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:47.567671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1159/2334] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:04:47 2022] DELETE /identity/v3/users/f07080b5e10142c09ac7bd2e4f9102e3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:47.572443 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e50b8-be6d-472e-acca-9ac0159feb24 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:47.573713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e50b8-be6d-472e-acca-9ac0159feb24 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:47.574065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e50b8-be6d-472e-acca-9ac0159feb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:47.597169 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-112e50b8-be6d-472e-acca-9ac0159feb24 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:47.598950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-112e50b8-be6d-472e-acca-9ac0159feb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:47.675654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1176/2335] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:47.684834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f6899-064b-4288-82d7-d6e60e85ae9f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:47.686415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f17f6899-064b-4288-82d7-d6e60e85ae9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:47.748565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f6899-064b-4288-82d7-d6e60e85ae9f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:47.752477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2da27-1da2-4ce2-bcb8-f6fcb95b4d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:47.753088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2da27-1da2-4ce2-bcb8-f6fcb95b4d98 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:47.753371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2da27-1da2-4ce2-bcb8-f6fcb95b4d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:47.753623 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2da27-1da2-4ce2-bcb8-f6fcb95b4d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:47.763878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2da27-1da2-4ce2-bcb8-f6fcb95b4d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:47.765356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2da27-1da2-4ce2-bcb8-f6fcb95b4d98 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:47.776406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1160/2336] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:48.135647 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e50b8-be6d-472e-acca-9ac0159feb24 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:48.137324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-112e50b8-be6d-472e-acca-9ac0159feb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:48.157510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e50b8-be6d-472e-acca-9ac0159feb24 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:48.162691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffcd47-f629-4002-b937-e795b4619799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:48.163342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffcd47-f629-4002-b937-e795b4619799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:48.163625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffcd47-f629-4002-b937-e795b4619799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:48.163979 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffcd47-f629-4002-b937-e795b4619799 admin admin] PATH_INFO: `/v3/projects/a709cbc3c6ff4e59abe1392f3ada9493` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:48.165330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffcd47-f629-4002-b937-e795b4619799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a709cbc3c6ff4e59abe1392f3ada9493)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:48.167981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffcd47-f629-4002-b937-e795b4619799 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:48.219954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:48.223229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-dfffcd47-f629-4002-b937-e795b4619799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a709cbc3c6ff4e59abe1392f3ada9493', 'request_id': 'req-dfffcd47-f629-4002-b937-e795b4619799'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:48.231924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-dfffcd47-f629-4002-b937-e795b4619799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a709cbc3c6ff4e59abe1392f3ada9493', 'request_id': 'req-dfffcd47-f629-4002-b937-e795b4619799'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:48.239758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-dfffcd47-f629-4002-b937-e795b4619799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a709cbc3c6ff4e59abe1392f3ada9493', 'request_id': 'req-dfffcd47-f629-4002-b937-e795b4619799'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:48.257633 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-dfffcd47-f629-4002-b937-e795b4619799 admin admin] The token cache is being invalidate because project a709cbc3c6ff4e59abe1392f3ada9493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:04:48.257927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-dfffcd47-f629-4002-b937-e795b4619799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:48.258750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-dfffcd47-f629-4002-b937-e795b4619799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:04:48.261603 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1177/2337] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:04:48 2022] DELETE /identity/v3/projects/a709cbc3c6ff4e59abe1392f3ada9493 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:48.266709 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37398d20-50dc-4432-933e-98dc0bcbd934 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:48.266998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37398d20-50dc-4432-933e-98dc0bcbd934 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:48.267275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37398d20-50dc-4432-933e-98dc0bcbd934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:48.291168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-37398d20-50dc-4432-933e-98dc0bcbd934 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:48.292408 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-37398d20-50dc-4432-933e-98dc0bcbd934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:48.379613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:48.406153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1161/2338] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:48.415040 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab6921-c67c-4397-a638-76b33c663198 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:48.415391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab6921-c67c-4397-a638-76b33c663198 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:48.415756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab6921-c67c-4397-a638-76b33c663198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:48.472447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-e6ab6921-c67c-4397-a638-76b33c663198 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:48.476840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e6ab6921-c67c-4397-a638-76b33c663198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:48.506284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1178/2339] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:48.510525 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37398d20-50dc-4432-933e-98dc0bcbd934 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:48.523470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37398d20-50dc-4432-933e-98dc0bcbd934 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:48.528024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424ad4-d6a0-4072-8e56-d061af732437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:48.528759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424ad4-d6a0-4072-8e56-d061af732437 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:48.529146 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424ad4-d6a0-4072-8e56-d061af732437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:48.529533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424ad4-d6a0-4072-8e56-d061af732437 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:48.530385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5424ad4-d6a0-4072-8e56-d061af732437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:04:48.530827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5424ad4-d6a0-4072-8e56-d061af732437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:48.532911 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5424ad4-d6a0-4072-8e56-d061af732437 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:48.555987 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab6921-c67c-4397-a638-76b33c663198 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:48.562507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1162/2340] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:04:48.566544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab6921-c67c-4397-a638-76b33c663198 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:48.573359 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ae5d9-c521-45aa-9075-ab297f15dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:48.574577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ae5d9-c521-45aa-9075-ab297f15dd25 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:48.575089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ae5d9-c521-45aa-9075-ab297f15dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:48.575702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ae5d9-c521-45aa-9075-ab297f15dd25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:48.578909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ae5d9-c521-45aa-9075-ab297f15dd25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:48.588391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ae5d9-c521-45aa-9075-ab297f15dd25 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:48.682017 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1179/2341] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:04:48 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:48.686010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424ad4-d6a0-4072-8e56-d061af732437 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:48.700372 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424ad4-d6a0-4072-8e56-d061af732437 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:48.764048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643824da-565b-4611-8852-a2fa8a8002b3 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:48.764759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643824da-565b-4611-8852-a2fa8a8002b3 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:48.765188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643824da-565b-4611-8852-a2fa8a8002b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:48.794651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-643824da-565b-4611-8852-a2fa8a8002b3 None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:48.797373 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-643824da-565b-4611-8852-a2fa8a8002b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:48.889642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e6ca7-9674-48d9-a620-7d152bf7639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:48.890299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6ca7-9674-48d9-a620-7d152bf7639d admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:48.890587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6ca7-9674-48d9-a620-7d152bf7639d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:48.890952 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6ca7-9674-48d9-a620-7d152bf7639d admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:48.891624 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e6ca7-9674-48d9-a620-7d152bf7639d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:48.899390 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e6ca7-9674-48d9-a620-7d152bf7639d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:48.963055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1163/2342] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:04:48 2022] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:04:48.963055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e6ca7-9674-48d9-a620-7d152bf7639d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:48.978424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e6ca7-9674-48d9-a620-7d152bf7639d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:48.982235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1180/2343] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 16:04:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:48.986439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cec92-ba08-4b92-90a2-7dc5edd54205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:48.987476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cec92-ba08-4b92-90a2-7dc5edd54205 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:48.987897 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cec92-ba08-4b92-90a2-7dc5edd54205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:48.988331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cec92-ba08-4b92-90a2-7dc5edd54205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:48.989148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cec92-ba08-4b92-90a2-7dc5edd54205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:48.991593 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cec92-ba08-4b92-90a2-7dc5edd54205 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:48.994936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643824da-565b-4611-8852-a2fa8a8002b3 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:48.996585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-643824da-565b-4611-8852-a2fa8a8002b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:49.042439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1164/2344] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:49.043645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cec92-ba08-4b92-90a2-7dc5edd54205 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:49.056644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cec92-ba08-4b92-90a2-7dc5edd54205 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:49.063160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca61f0-a00f-409b-9637-abda1b8e5c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:49.064059 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca61f0-a00f-409b-9637-abda1b8e5c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:49.064482 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca61f0-a00f-409b-9637-abda1b8e5c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:49.064895 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca61f0-a00f-409b-9637-abda1b8e5c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:49.066719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca61f0-a00f-409b-9637-abda1b8e5c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:49.068932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca61f0-a00f-409b-9637-abda1b8e5c8d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:49.089306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1165/2345] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:04:49.090410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca61f0-a00f-409b-9637-abda1b8e5c8d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:49.102451 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca61f0-a00f-409b-9637-abda1b8e5c8d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:49.122216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e3c19-d201-4767-811d-effd97f61f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:49.123129 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e3c19-d201-4767-811d-effd97f61f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:49.124209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e3c19-d201-4767-811d-effd97f61f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:49.125017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e3c19-d201-4767-811d-effd97f61f97 admin admin] PATH_INFO: `/v3/projects/6eb26db6e2094c16a0bf7550f9d02691/users/a3f4c013ada6466d95d391d41474acaa/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:49.144092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e3c19-d201-4767-811d-effd97f61f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb26db6e2094c16a0bf7550f9d02691, user_id=a3f4c013ada6466d95d391d41474acaa, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:49.146718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643824da-565b-4611-8852-a2fa8a8002b3 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:49.148487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e3c19-d201-4767-811d-effd97f61f97 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:49.164604 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ae8f5-e31b-4cab-854d-ec78a54cb7f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:49.165821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ae8f5-e31b-4cab-854d-ec78a54cb7f1 service swift] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:49.166304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ae8f5-e31b-4cab-854d-ec78a54cb7f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:49.167183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ae8f5-e31b-4cab-854d-ec78a54cb7f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:49.175374 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1166/2346] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:04:49 2022] PUT /identity/v3/projects/6eb26db6e2094c16a0bf7550f9d02691/users/a3f4c013ada6466d95d391d41474acaa/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:04:49.180404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa6efa-709f-406e-912b-15ef83905ef3 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:49.180688 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa6efa-709f-406e-912b-15ef83905ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:49.180927 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa6efa-709f-406e-912b-15ef83905ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:49.214446 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ae8f5-e31b-4cab-854d-ec78a54cb7f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:49.216143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ae8f5-e31b-4cab-854d-ec78a54cb7f1 service swift] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:49.235743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1181/2347] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:04:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 16:04:49.241118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-40aa6efa-709f-406e-912b-15ef83905ef3 None None] MFA Rules not processed for user `a3f4c013ada6466d95d391d41474acaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:04:49.242617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-40aa6efa-709f-406e-912b-15ef83905ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:49.338227 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1167/2348] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:04:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:04:49.351567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ae8f5-e31b-4cab-854d-ec78a54cb7f1 service swift] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:04:49.353882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-cb3ae8f5-e31b-4cab-854d-ec78a54cb7f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:04:49.474412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:49.500861 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ae8f5-e31b-4cab-854d-ec78a54cb7f1 service swift] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:04:49.622100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fd9fc-1ffe-4da1-848f-141895cd81aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:04:49.623309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd9fc-1ffe-4da1-848f-141895cd81aa service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:04:49.623591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd9fc-1ffe-4da1-848f-141895cd81aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:04:49.623866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd9fc-1ffe-4da1-848f-141895cd81aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:04:49.641954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fd9fc-1ffe-4da1-848f-141895cd81aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:04:49.643603 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fd9fc-1ffe-4da1-848f-141895cd81aa service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:04:49.657096 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1182/2349] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:04:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:04:59.331458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=93,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:04:59.649707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=28 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:06.313429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c7e56-7219-4314-82f3-10600f96e9a9 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.314028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c7e56-7219-4314-82f3-10600f96e9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.314028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c7e56-7219-4314-82f3-10600f96e9a9 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.315378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1168/2350] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 22 16:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:05:06.321614 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528d962-7f31-46b4-8da0-d6ed628a9762 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.322259 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528d962-7f31-46b4-8da0-d6ed628a9762 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.322259 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528d962-7f31-46b4-8da0-d6ed628a9762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.345610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-f528d962-7f31-46b4-8da0-d6ed628a9762 None None] MFA Rules not processed for user `20e4a18ab77642baa9adb9a4b49fbcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:06.346874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f528d962-7f31-46b4-8da0-d6ed628a9762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:06.427725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1183/2351] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 22 16:05:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:06.441340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c7e56-7219-4314-82f3-10600f96e9a9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:06.443209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-025c7e56-7219-4314-82f3-10600f96e9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:06.513171 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c7e56-7219-4314-82f3-10600f96e9a9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:06.517059 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46587-3a3a-478c-90bf-b379a4e34a19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7c46f4dc084a948bd09ca9b86c2748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:06.517663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46587-3a3a-478c-90bf-b379a4e34a19 service glance] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.517969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46587-3a3a-478c-90bf-b379a4e34a19 service glance] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.518230 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46587-3a3a-478c-90bf-b379a4e34a19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.530543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b46587-3a3a-478c-90bf-b379a4e34a19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:06.532130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b46587-3a3a-478c-90bf-b379a4e34a19 service glance] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:06.545413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1169/2352] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:06.623805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d26a40-38d6-401e-a361-9894424b1282 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.624071 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d26a40-38d6-401e-a361-9894424b1282 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.624333 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d26a40-38d6-401e-a361-9894424b1282 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.625704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1184/2353] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 22 16:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:05:06.630830 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba8d88-6117-4d47-9f79-65cbb721f89d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.631202 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba8d88-6117-4d47-9f79-65cbb721f89d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.631605 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba8d88-6117-4d47-9f79-65cbb721f89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.653558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f0ba8d88-6117-4d47-9f79-65cbb721f89d None None] MFA Rules not processed for user `104abc0b38524a2f95ffe96c5872362c`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:06.654845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f0ba8d88-6117-4d47-9f79-65cbb721f89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:06.713933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1170/2354] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 22 16:05:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:06.728728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d26a40-38d6-401e-a361-9894424b1282 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:06.730691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-57d26a40-38d6-401e-a361-9894424b1282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:06.744868 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d26a40-38d6-401e-a361-9894424b1282 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:06.748783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd2a90-4fe3-4e79-aa86-d6ffded1e166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:06.749450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd2a90-4fe3-4e79-aa86-d6ffded1e166 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.749729 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd2a90-4fe3-4e79-aa86-d6ffded1e166 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.749991 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd2a90-4fe3-4e79-aa86-d6ffded1e166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.758112 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd2a90-4fe3-4e79-aa86-d6ffded1e166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:06.759656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd2a90-4fe3-4e79-aa86-d6ffded1e166 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:06.768225 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1185/2355] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:06.872339 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcc16f-b0e5-4828-8e3a-b1cf2add9253 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.872339 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcc16f-b0e5-4828-8e3a-b1cf2add9253 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.872339 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcc16f-b0e5-4828-8e3a-b1cf2add9253 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.873793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1171/2356] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 22 16:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:05:06.879428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff9f55-5bd3-41bc-81aa-bd3e957e182a None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.879795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff9f55-5bd3-41bc-81aa-bd3e957e182a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.880062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff9f55-5bd3-41bc-81aa-bd3e957e182a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.900668 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-ceff9f55-5bd3-41bc-81aa-bd3e957e182a None None] MFA Rules not processed for user `20e4a18ab77642baa9adb9a4b49fbcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:06.901891 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ceff9f55-5bd3-41bc-81aa-bd3e957e182a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:06.911593 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1186/2357] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 22 16:05:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:06.922925 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcc16f-b0e5-4828-8e3a-b1cf2add9253 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:06.935626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcc16f-b0e5-4828-8e3a-b1cf2add9253 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:06.939629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1c759-19c2-46e9-8eb1-7e2b7fd54fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:06.940248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1c759-19c2-46e9-8eb1-7e2b7fd54fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:06.940520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1c759-19c2-46e9-8eb1-7e2b7fd54fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:06.940785 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1c759-19c2-46e9-8eb1-7e2b7fd54fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:06.952700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1c759-19c2-46e9-8eb1-7e2b7fd54fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:06.954229 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1c759-19c2-46e9-8eb1-7e2b7fd54fd7 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:06.965607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1172/2358] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:09.391838 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1b55-6f12-4abb-9d6e-f490ac53a88b None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:09.392348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1b55-6f12-4abb-9d6e-f490ac53a88b None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:09.392348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1b55-6f12-4abb-9d6e-f490ac53a88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:09.412811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-f9aa1b55-6f12-4abb-9d6e-f490ac53a88b None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:09.414028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f9aa1b55-6f12-4abb-9d6e-f490ac53a88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:09.474569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1187/2359] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 16:05:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:09.487402 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1c759-19c2-46e9-8eb1-7e2b7fd54fd7 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:09.561666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1c759-19c2-46e9-8eb1-7e2b7fd54fd7 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:09.567918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec471bb-ec8f-4375-bd27-8a7389cff973 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:09.568514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec471bb-ec8f-4375-bd27-8a7389cff973 service swift] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:09.568786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec471bb-ec8f-4375-bd27-8a7389cff973 service swift] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:09.569052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec471bb-ec8f-4375-bd27-8a7389cff973 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:09.577354 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec471bb-ec8f-4375-bd27-8a7389cff973 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:09.578983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec471bb-ec8f-4375-bd27-8a7389cff973 service swift] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:09.586824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1173/2360] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:05:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:05:19.467503 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=65 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:19.583699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=87 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:24.710049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa1b55-6f12-4abb-9d6e-f490ac53a88b None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:24.777329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa1b55-6f12-4abb-9d6e-f490ac53a88b None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:24.783451 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2555921-27bb-4a65-9b9c-b86161f05003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:24.784080 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2555921-27bb-4a65-9b9c-b86161f05003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:24.784415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2555921-27bb-4a65-9b9c-b86161f05003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:24.784672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2555921-27bb-4a65-9b9c-b86161f05003 admin admin] PATH_INFO: `/v3/users/a3f4c013ada6466d95d391d41474acaa` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:24.785901 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2555921-27bb-4a65-9b9c-b86161f05003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f4c013ada6466d95d391d41474acaa)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:24.787882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2555921-27bb-4a65-9b9c-b86161f05003 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:24.848107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-f2555921-27bb-4a65-9b9c-b86161f05003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f4c013ada6466d95d391d41474acaa'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:24.863736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-f2555921-27bb-4a65-9b9c-b86161f05003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f4c013ada6466d95d391d41474acaa'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:24.872892 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-f2555921-27bb-4a65-9b9c-b86161f05003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f4c013ada6466d95d391d41474acaa'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:24.884320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-f2555921-27bb-4a65-9b9c-b86161f05003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f4c013ada6466d95d391d41474acaa'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:24.885140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-f2555921-27bb-4a65-9b9c-b86161f05003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f4c013ada6466d95d391d41474acaa'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:24.892694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1188/2361] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:05:24 2022] DELETE /identity/v3/users/a3f4c013ada6466d95d391d41474acaa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:24.897438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc4634-83c1-47a9-8f35-093f40f10555 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:24.897977 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc4634-83c1-47a9-8f35-093f40f10555 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:24.897977 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc4634-83c1-47a9-8f35-093f40f10555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:24.918202 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1ddc4634-83c1-47a9-8f35-093f40f10555 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:24.919501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1ddc4634-83c1-47a9-8f35-093f40f10555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:24.993174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1174/2362] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:25.003954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2555921-27bb-4a65-9b9c-b86161f05003 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:25.006055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f2555921-27bb-4a65-9b9c-b86161f05003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:25.067478 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2555921-27bb-4a65-9b9c-b86161f05003 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:25.072639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7954c3-b87c-493a-9b21-9dc46e891833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:25.073636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7954c3-b87c-493a-9b21-9dc46e891833 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:25.073917 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7954c3-b87c-493a-9b21-9dc46e891833 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:25.074190 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7954c3-b87c-493a-9b21-9dc46e891833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:25.085458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7954c3-b87c-493a-9b21-9dc46e891833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:25.087032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7954c3-b87c-493a-9b21-9dc46e891833 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:25.098041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1189/2363] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:25.404937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc4634-83c1-47a9-8f35-093f40f10555 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:25.406522 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1ddc4634-83c1-47a9-8f35-093f40f10555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:25.419004 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc4634-83c1-47a9-8f35-093f40f10555 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:25.424758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c6048-89aa-4d31-aef5-e3341b7d2698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:25.425433 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c6048-89aa-4d31-aef5-e3341b7d2698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:25.425705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c6048-89aa-4d31-aef5-e3341b7d2698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:25.425992 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c6048-89aa-4d31-aef5-e3341b7d2698 admin admin] PATH_INFO: `/v3/projects/6eb26db6e2094c16a0bf7550f9d02691` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:25.427489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c6048-89aa-4d31-aef5-e3341b7d2698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb26db6e2094c16a0bf7550f9d02691)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:25.429428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c6048-89aa-4d31-aef5-e3341b7d2698 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:25.480240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d03c6048-89aa-4d31-aef5-e3341b7d2698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb26db6e2094c16a0bf7550f9d02691', 'request_id': 'req-d03c6048-89aa-4d31-aef5-e3341b7d2698'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:25.486645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d03c6048-89aa-4d31-aef5-e3341b7d2698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb26db6e2094c16a0bf7550f9d02691', 'request_id': 'req-d03c6048-89aa-4d31-aef5-e3341b7d2698'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:25.494748 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d03c6048-89aa-4d31-aef5-e3341b7d2698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb26db6e2094c16a0bf7550f9d02691', 'request_id': 'req-d03c6048-89aa-4d31-aef5-e3341b7d2698'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:25.505957 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d03c6048-89aa-4d31-aef5-e3341b7d2698 admin admin] The token cache is being invalidate because project 6eb26db6e2094c16a0bf7550f9d02691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:05:25.506174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d03c6048-89aa-4d31-aef5-e3341b7d2698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:25.506829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d03c6048-89aa-4d31-aef5-e3341b7d2698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:05:25.508408 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1175/2364] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:05:25 2022] DELETE /identity/v3/projects/6eb26db6e2094c16a0bf7550f9d02691 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:25.513735 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601609-49da-49d1-ab0b-7bf8711c0a23 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:25.514009 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601609-49da-49d1-ab0b-7bf8711c0a23 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:25.514279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601609-49da-49d1-ab0b-7bf8711c0a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:25.536439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-67601609-49da-49d1-ab0b-7bf8711c0a23 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:25.538259 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-67601609-49da-49d1-ab0b-7bf8711c0a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:25.561955 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:25.622100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1190/2365] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:25.630097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9f051-cc00-4350-bcf0-008866adcb73 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:25.630418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9f051-cc00-4350-bcf0-008866adcb73 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:25.630695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9f051-cc00-4350-bcf0-008866adcb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:25.652682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0ba9f051-cc00-4350-bcf0-008866adcb73 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:25.653922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0ba9f051-cc00-4350-bcf0-008866adcb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:25.663297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1176/2366] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:25.667358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67601609-49da-49d1-ab0b-7bf8711c0a23 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:25.679510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67601609-49da-49d1-ab0b-7bf8711c0a23 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:25.686348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ece6c-a3e0-4caa-a13b-742a6801a909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:25.687245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ece6c-a3e0-4caa-a13b-742a6801a909 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:25.687678 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ece6c-a3e0-4caa-a13b-742a6801a909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:25.688153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ece6c-a3e0-4caa-a13b-742a6801a909 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:25.688843 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ece6c-a3e0-4caa-a13b-742a6801a909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:05:25.689151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ece6c-a3e0-4caa-a13b-742a6801a909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:25.690823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ece6c-a3e0-4caa-a13b-742a6801a909 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:25.706643 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1191/2367] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:05:25.708287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9f051-cc00-4350-bcf0-008866adcb73 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:25.718742 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9f051-cc00-4350-bcf0-008866adcb73 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:25.725041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26825a-a7c7-487d-b97f-0ce7e6eae754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:25.725675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26825a-a7c7-487d-b97f-0ce7e6eae754 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:25.725948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26825a-a7c7-487d-b97f-0ce7e6eae754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:25.726220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26825a-a7c7-487d-b97f-0ce7e6eae754 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:25.726905 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26825a-a7c7-487d-b97f-0ce7e6eae754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:25.735787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26825a-a7c7-487d-b97f-0ce7e6eae754 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:25.773008 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1177/2368] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:05:25 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:25.777093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ece6c-a3e0-4caa-a13b-742a6801a909 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:25.787778 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ece6c-a3e0-4caa-a13b-742a6801a909 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:25.848189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80d0e7-fa65-49ce-879d-ca6a8d344133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:25.848808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80d0e7-fa65-49ce-879d-ca6a8d344133 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:25.849087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80d0e7-fa65-49ce-879d-ca6a8d344133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:25.849358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80d0e7-fa65-49ce-879d-ca6a8d344133 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:25.850031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80d0e7-fa65-49ce-879d-ca6a8d344133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:25.851999 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80d0e7-fa65-49ce-879d-ca6a8d344133 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:25.876071 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1192/2369] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:05:25 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:25.880296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26825a-a7c7-487d-b97f-0ce7e6eae754 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:25.890870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26825a-a7c7-487d-b97f-0ce7e6eae754 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:25.895824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a16fe-0c8f-4b07-9c93-091266273f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:25.896467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a16fe-0c8f-4b07-9c93-091266273f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:25.896722 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a16fe-0c8f-4b07-9c93-091266273f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:25.896992 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a16fe-0c8f-4b07-9c93-091266273f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:25.897676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a16fe-0c8f-4b07-9c93-091266273f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:25.899333 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a16fe-0c8f-4b07-9c93-091266273f23 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:25.913814 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1178/2370] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:25.917866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80d0e7-fa65-49ce-879d-ca6a8d344133 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:25.928030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80d0e7-fa65-49ce-879d-ca6a8d344133 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:25.933299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd0632-ff47-4d33-8373-88fe84fd84e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:25.933921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd0632-ff47-4d33-8373-88fe84fd84e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:25.934196 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd0632-ff47-4d33-8373-88fe84fd84e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:25.934464 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd0632-ff47-4d33-8373-88fe84fd84e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:25.935160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd0632-ff47-4d33-8373-88fe84fd84e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:25.936820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd0632-ff47-4d33-8373-88fe84fd84e7 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:25.949560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1193/2371] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:25.955553 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a16fe-0c8f-4b07-9c93-091266273f23 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:25.972086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a16fe-0c8f-4b07-9c93-091266273f23 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:25.978924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e769a6-6b95-489b-9ed6-e773b7588363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:25.980036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e769a6-6b95-489b-9ed6-e773b7588363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:25.980319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e769a6-6b95-489b-9ed6-e773b7588363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:25.980594 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e769a6-6b95-489b-9ed6-e773b7588363 admin admin] PATH_INFO: `/v3/projects/cd634e51f5e64bd18f959c4877370ce7/users/d68d011a3b014ee696a3e89b06085569/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:25.999842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e769a6-6b95-489b-9ed6-e773b7588363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd634e51f5e64bd18f959c4877370ce7, user_id=d68d011a3b014ee696a3e89b06085569, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:26.003610 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e769a6-6b95-489b-9ed6-e773b7588363 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:26.019914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1179/2372] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:05:25 2022] PUT /identity/v3/projects/cd634e51f5e64bd18f959c4877370ce7/users/d68d011a3b014ee696a3e89b06085569/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:26.026291 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7282883-1df1-4e95-aaee-4b4d72d9947f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:26.026583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7282883-1df1-4e95-aaee-4b4d72d9947f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:26.026894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7282883-1df1-4e95-aaee-4b4d72d9947f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:26.046086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-b7282883-1df1-4e95-aaee-4b4d72d9947f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:26.047366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-b7282883-1df1-4e95-aaee-4b4d72d9947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:26.117377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1194/2373] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:26.126964 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e769a6-6b95-489b-9ed6-e773b7588363 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:26.129152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d6e769a6-6b95-489b-9ed6-e773b7588363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:26.151944 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:26.192905 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e769a6-6b95-489b-9ed6-e773b7588363 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:26.196739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8d0e6-85aa-476e-a71a-5209e65cc2aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:26.197342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d0e6-85aa-476e-a71a-5209e65cc2aa service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:26.197616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d0e6-85aa-476e-a71a-5209e65cc2aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:26.197885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d0e6-85aa-476e-a71a-5209e65cc2aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:26.208267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8d0e6-85aa-476e-a71a-5209e65cc2aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:26.209814 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8d0e6-85aa-476e-a71a-5209e65cc2aa service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:26.220361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1180/2374] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:30.005461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41885cfa-151a-40a8-93bd-1ab629417ce6 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:30.006333 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41885cfa-151a-40a8-93bd-1ab629417ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:30.006333 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41885cfa-151a-40a8-93bd-1ab629417ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:30.032323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-41885cfa-151a-40a8-93bd-1ab629417ce6 None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:30.033222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-41885cfa-151a-40a8-93bd-1ab629417ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:30.061951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:30.103441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1195/2375] 10.222.0.77 () {58 vars in 967 bytes} [Mon Aug 22 16:05:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:30.117702 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8d0e6-85aa-476e-a71a-5209e65cc2aa service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:30.118758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-88e8d0e6-85aa-476e-a71a-5209e65cc2aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:30.216082 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8d0e6-85aa-476e-a71a-5209e65cc2aa service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:30.224399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405c897-276e-4af7-9807-b21c51436bb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:30.225289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405c897-276e-4af7-9807-b21c51436bb6 service swift] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:30.225563 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405c897-276e-4af7-9807-b21c51436bb6 service swift] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:30.225844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405c897-276e-4af7-9807-b21c51436bb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:30.240683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405c897-276e-4af7-9807-b21c51436bb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:30.242341 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405c897-276e-4af7-9807-b21c51436bb6 service swift] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:30.274874 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1181/2376] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:05:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:05:30.422457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18599c-5445-4894-806b-2e60a7cf9b69 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:30.422803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18599c-5445-4894-806b-2e60a7cf9b69 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:30.423078 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18599c-5445-4894-806b-2e60a7cf9b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:30.459499 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-7f18599c-5445-4894-806b-2e60a7cf9b69 None None] MFA Rules not processed for user `d68d011a3b014ee696a3e89b06085569`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:30.460869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7f18599c-5445-4894-806b-2e60a7cf9b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:30.578366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1196/2377] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:05:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:30.582955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405c897-276e-4af7-9807-b21c51436bb6 service swift] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:30.597893 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405c897-276e-4af7-9807-b21c51436bb6 service swift] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:30.615502 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c54698-865f-4dfa-a1c8-95f24b33bd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:30.616318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c54698-865f-4dfa-a1c8-95f24b33bd1a admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:30.616698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c54698-865f-4dfa-a1c8-95f24b33bd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:30.617050 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c54698-865f-4dfa-a1c8-95f24b33bd1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:30.617765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c54698-865f-4dfa-a1c8-95f24b33bd1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:30.621627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c54698-865f-4dfa-a1c8-95f24b33bd1a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:30.677312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18599c-5445-4894-806b-2e60a7cf9b69 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:30.687106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1182/2378] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:05:30 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:30.698339 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18599c-5445-4894-806b-2e60a7cf9b69 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:30.779210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622af1d-c30a-47b9-8abd-55bf246d5697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:30.780006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622af1d-c30a-47b9-8abd-55bf246d5697 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:30.780381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622af1d-c30a-47b9-8abd-55bf246d5697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:30.780748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622af1d-c30a-47b9-8abd-55bf246d5697 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:30.781483 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622af1d-c30a-47b9-8abd-55bf246d5697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:30.783938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622af1d-c30a-47b9-8abd-55bf246d5697 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:30.811438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1197/2379] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:05:30 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:05:30.816185 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c54698-865f-4dfa-a1c8-95f24b33bd1a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:30.828993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c54698-865f-4dfa-a1c8-95f24b33bd1a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:30.833752 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a9ae6-3931-4d40-9910-f9576cbb63aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:30.834548 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a9ae6-3931-4d40-9910-f9576cbb63aa admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:30.834998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a9ae6-3931-4d40-9910-f9576cbb63aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:30.835179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a9ae6-3931-4d40-9910-f9576cbb63aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:30.835831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a9ae6-3931-4d40-9910-f9576cbb63aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:30.837617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a9ae6-3931-4d40-9910-f9576cbb63aa admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:30.850993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1183/2380] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:30.855299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622af1d-c30a-47b9-8abd-55bf246d5697 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:30.866687 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622af1d-c30a-47b9-8abd-55bf246d5697 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:30.871777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a530dd-55df-4708-b05e-5d1703fd8664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:30.872460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a530dd-55df-4708-b05e-5d1703fd8664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:30.873018 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a530dd-55df-4708-b05e-5d1703fd8664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:30.873297 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a530dd-55df-4708-b05e-5d1703fd8664 admin admin] PATH_INFO: `/v3/projects/779428413fe74e578d1736a7c6eec224/users/78b78754292c4019ae3bcf40965caa69/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:30.890626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a530dd-55df-4708-b05e-5d1703fd8664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779428413fe74e578d1736a7c6eec224, user_id=78b78754292c4019ae3bcf40965caa69, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:30.893677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a530dd-55df-4708-b05e-5d1703fd8664 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:30.910483 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1198/2381] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:05:30 2022] PUT /identity/v3/projects/779428413fe74e578d1736a7c6eec224/users/78b78754292c4019ae3bcf40965caa69/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:05:30.914745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a9ae6-3931-4d40-9910-f9576cbb63aa admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:30.926310 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a9ae6-3931-4d40-9910-f9576cbb63aa admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:30.997515 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b890f-6fb4-49d6-8d9d-91fee7b8af9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:30.998147 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b890f-6fb4-49d6-8d9d-91fee7b8af9f admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:30.998422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b890f-6fb4-49d6-8d9d-91fee7b8af9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:30.998732 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b890f-6fb4-49d6-8d9d-91fee7b8af9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:30.999401 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b890f-6fb4-49d6-8d9d-91fee7b8af9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:31.001275 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b890f-6fb4-49d6-8d9d-91fee7b8af9f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:31.013445 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1184/2382] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:05:31.018164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a530dd-55df-4708-b05e-5d1703fd8664 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:31.029746 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a530dd-55df-4708-b05e-5d1703fd8664 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:31.034688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d71298-0abb-4a5f-8446-84965103c4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:31.035499 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d71298-0abb-4a5f-8446-84965103c4d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:31.035870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d71298-0abb-4a5f-8446-84965103c4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:31.036221 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d71298-0abb-4a5f-8446-84965103c4d4 admin admin] PATH_INFO: `/v3/projects/779428413fe74e578d1736a7c6eec224/users/78b78754292c4019ae3bcf40965caa69/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:31.038427 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d71298-0abb-4a5f-8446-84965103c4d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779428413fe74e578d1736a7c6eec224, user_id=78b78754292c4019ae3bcf40965caa69, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:31.041473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d71298-0abb-4a5f-8446-84965103c4d4 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:31.052897 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1199/2383] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:05:31 2022] PUT /identity/v3/projects/779428413fe74e578d1736a7c6eec224/users/78b78754292c4019ae3bcf40965caa69/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:05:35.528141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59541-5cbd-47f2-949d-b808b32b7692 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:35.528882 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59541-5cbd-47f2-949d-b808b32b7692 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:35.528882 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59541-5cbd-47f2-949d-b808b32b7692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:35.564925 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-deb59541-5cbd-47f2-949d-b808b32b7692 None None] MFA Rules not processed for user `78b78754292c4019ae3bcf40965caa69`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:35.566093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-deb59541-5cbd-47f2-949d-b808b32b7692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:35.570450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:35.653706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1185/2384] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:05:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:05:35.669878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d71298-0abb-4a5f-8446-84965103c4d4 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:35.672459 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f9d71298-0abb-4a5f-8446-84965103c4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:35.697204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:35.778728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d71298-0abb-4a5f-8446-84965103c4d4 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:35.784971 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b225ab4-c277-4bc1-b2f5-7535b4dee381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:35.785898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225ab4-c277-4bc1-b2f5-7535b4dee381 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:35.786405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225ab4-c277-4bc1-b2f5-7535b4dee381 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:35.786944 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225ab4-c277-4bc1-b2f5-7535b4dee381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:35.891104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b225ab4-c277-4bc1-b2f5-7535b4dee381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:35.892912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b225ab4-c277-4bc1-b2f5-7535b4dee381 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:35.911662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1200/2385] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:37.103195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c19f46-1987-4799-a657-e5b49e385d85 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:37.103681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c19f46-1987-4799-a657-e5b49e385d85 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:37.103967 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c19f46-1987-4799-a657-e5b49e385d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:37.124176 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e2c19f46-1987-4799-a657-e5b49e385d85 None None] MFA Rules not processed for user `d68d011a3b014ee696a3e89b06085569`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:37.125420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e2c19f46-1987-4799-a657-e5b49e385d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:37.133238 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1186/2386] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:05:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:05:39.840364 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b225ab4-c277-4bc1-b2f5-7535b4dee381 service nova] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:05:39.843165 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9b225ab4-c277-4bc1-b2f5-7535b4dee381 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:39.934321 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b225ab4-c277-4bc1-b2f5-7535b4dee381 service nova] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:05:39.939728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199d14a-31ca-4128-9954-b0395e89a9cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be9a664d10d438382b9e359b26ba86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:05:39.940358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199d14a-31ca-4128-9954-b0395e89a9cd service placement] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:39.940635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199d14a-31ca-4128-9954-b0395e89a9cd service placement] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:39.940904 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199d14a-31ca-4128-9954-b0395e89a9cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:39.943230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4199d14a-31ca-4128-9954-b0395e89a9cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:39.965383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199d14a-31ca-4128-9954-b0395e89a9cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:05:39.967154 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199d14a-31ca-4128-9954-b0395e89a9cd service placement] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:05:39.979347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1201/2387] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:05:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:05:47.117707 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=30 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:49.974382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=81 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:05:54.678455 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5b1f5-f045-45e7-893d-059e620986c0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:05:54.679233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5b1f5-f045-45e7-893d-059e620986c0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:05:54.679233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5b1f5-f045-45e7-893d-059e620986c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:05:54.700532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4ff5b1f5-f045-45e7-893d-059e620986c0 None None] MFA Rules not processed for user `4d3445e9462b42cd82ea10ed54193c89`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:05:54.701782 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4ff5b1f5-f045-45e7-893d-059e620986c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:05:54.762857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1187/2388] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:06:04.754621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=25 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:10.715626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199d14a-31ca-4128-9954-b0395e89a9cd service placement] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:06:10.786708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199d14a-31ca-4128-9954-b0395e89a9cd service placement] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:06:10.790733 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc447d-015f-4463-a6c0-924b0ae42d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:06:10.791355 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc447d-015f-4463-a6c0-924b0ae42d18 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:06:10.791693 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc447d-015f-4463-a6c0-924b0ae42d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:06:10.791964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc447d-015f-4463-a6c0-924b0ae42d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:06:10.802974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc447d-015f-4463-a6c0-924b0ae42d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:06:10.804531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc447d-015f-4463-a6c0-924b0ae42d18 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:06:10.815594 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1202/2389] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:06:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:06:13.612942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673facb-46a1-44ab-99e1-5139f47e4906 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:06:13.613513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673facb-46a1-44ab-99e1-5139f47e4906 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:06:13.613513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673facb-46a1-44ab-99e1-5139f47e4906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:06:13.634079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6673facb-46a1-44ab-99e1-5139f47e4906 None None] MFA Rules not processed for user `0a01c075e69b49aa8f44968ed2cca1b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:06:13.635220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6673facb-46a1-44ab-99e1-5139f47e4906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:06:13.720154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1188/2390] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:06:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:06:20.810462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=26 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:23.712842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=25 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:24.705144 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba23f3f-e058-4fa2-831d-4f25b1f652e8 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:06:24.705703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba23f3f-e058-4fa2-831d-4f25b1f652e8 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:06:24.705703 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba23f3f-e058-4fa2-831d-4f25b1f652e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:06:24.726946 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1ba23f3f-e058-4fa2-831d-4f25b1f652e8 None None] MFA Rules not processed for user `9c75b97977c2433fb27aa21e4f82ce2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:06:24.728182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1ba23f3f-e058-4fa2-831d-4f25b1f652e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:06:24.785400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1203/2391] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:06:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:06:34.778074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=25 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:50.266207 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1536f-f72d-4551-87ee-67a53372b767 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:06:50.266732 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1536f-f72d-4551-87ee-67a53372b767 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:06:50.266850 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1536f-f72d-4551-87ee-67a53372b767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:06:50.288194 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-73c1536f-f72d-4551-87ee-67a53372b767 None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:06:50.289424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-73c1536f-f72d-4551-87ee-67a53372b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:06:50.351722 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1189/2392] 10.222.0.77 () {58 vars in 967 bytes} [Mon Aug 22 16:06:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:06:50.400541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba23f3f-e058-4fa2-831d-4f25b1f652e8 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:06:50.479493 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba23f3f-e058-4fa2-831d-4f25b1f652e8 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:06:50.485156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b2cf5-4240-462d-803e-0ca66ab4eecd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:06:50.485778 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b2cf5-4240-462d-803e-0ca66ab4eecd service swift] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:06:50.486056 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b2cf5-4240-462d-803e-0ca66ab4eecd service swift] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:06:50.486348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b2cf5-4240-462d-803e-0ca66ab4eecd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:06:50.495586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b2cf5-4240-462d-803e-0ca66ab4eecd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:06:50.497199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b2cf5-4240-462d-803e-0ca66ab4eecd service swift] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:06:50.505612 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1204/2393] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:06:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:06:57.524621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1536f-f72d-4551-87ee-67a53372b767 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:06:57.526249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-73c1536f-f72d-4551-87ee-67a53372b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:06:57.604694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1536f-f72d-4551-87ee-67a53372b767 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:06:57.609839 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35501a6b-e3ee-4703-a536-f6c3b866654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:06:57.610405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35501a6b-e3ee-4703-a536-f6c3b866654a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:06:57.610725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35501a6b-e3ee-4703-a536-f6c3b866654a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:06:57.611005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35501a6b-e3ee-4703-a536-f6c3b866654a admin admin] PATH_INFO: `/v3/users/67ad333d849f44dfa4ab6fa4ea9839f1` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:06:57.612220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35501a6b-e3ee-4703-a536-f6c3b866654a admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ad333d849f44dfa4ab6fa4ea9839f1)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:06:57.614199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35501a6b-e3ee-4703-a536-f6c3b866654a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:06:57.662533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-35501a6b-e3ee-4703-a536-f6c3b866654a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ad333d849f44dfa4ab6fa4ea9839f1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:57.663224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-35501a6b-e3ee-4703-a536-f6c3b866654a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ad333d849f44dfa4ab6fa4ea9839f1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:57.663810 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-35501a6b-e3ee-4703-a536-f6c3b866654a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ad333d849f44dfa4ab6fa4ea9839f1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:57.670758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-35501a6b-e3ee-4703-a536-f6c3b866654a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ad333d849f44dfa4ab6fa4ea9839f1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:57.678735 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-35501a6b-e3ee-4703-a536-f6c3b866654a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ad333d849f44dfa4ab6fa4ea9839f1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:57.696390 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1190/2394] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:06:57 2022] DELETE /identity/v3/users/67ad333d849f44dfa4ab6fa4ea9839f1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:06:57.895413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b2cf5-4240-462d-803e-0ca66ab4eecd service swift] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:06:57.908502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b2cf5-4240-462d-803e-0ca66ab4eecd service swift] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:06:57.974975 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:06:57.975618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:06:57.975947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:06:57.976240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] PATH_INFO: `/v3/projects/3c59f1d5ec1743f78c2fdd4e3e43051e` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:06:57.977578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c59f1d5ec1743f78c2fdd4e3e43051e)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:06:57.979553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:06:58.030730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c59f1d5ec1743f78c2fdd4e3e43051e', 'request_id': 'req-ad01d7f0-33e6-4860-95d3-ff6a106c2484'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.039066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c59f1d5ec1743f78c2fdd4e3e43051e', 'request_id': 'req-ad01d7f0-33e6-4860-95d3-ff6a106c2484'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.046102 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c59f1d5ec1743f78c2fdd4e3e43051e', 'request_id': 'req-ad01d7f0-33e6-4860-95d3-ff6a106c2484'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.056509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] The token cache is being invalidate because project 3c59f1d5ec1743f78c2fdd4e3e43051e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:06:58.056793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.057490 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.059145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1205/2395] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:06:57 2022] DELETE /identity/v3/projects/3c59f1d5ec1743f78c2fdd4e3e43051e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:06:58.064962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35501a6b-e3ee-4703-a536-f6c3b866654a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:06:58.066828 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-35501a6b-e3ee-4703-a536-f6c3b866654a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:06:58.080633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35501a6b-e3ee-4703-a536-f6c3b866654a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:06:58.102054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:58.142376 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1c490-267d-40b0-a99d-bde04c01a586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:06:58.143093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1c490-267d-40b0-a99d-bde04c01a586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:06:58.143368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1c490-267d-40b0-a99d-bde04c01a586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:06:58.143727 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1c490-267d-40b0-a99d-bde04c01a586 admin admin] PATH_INFO: `/v3/users/f8c741e7a5154dd3b5d9822510d54495` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:06:58.144828 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1c490-267d-40b0-a99d-bde04c01a586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c741e7a5154dd3b5d9822510d54495)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:06:58.146812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1c490-267d-40b0-a99d-bde04c01a586 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:06:58.198721 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f5c1c490-267d-40b0-a99d-bde04c01a586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c741e7a5154dd3b5d9822510d54495'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.200229 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f5c1c490-267d-40b0-a99d-bde04c01a586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c741e7a5154dd3b5d9822510d54495'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.201287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f5c1c490-267d-40b0-a99d-bde04c01a586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c741e7a5154dd3b5d9822510d54495'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.210669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f5c1c490-267d-40b0-a99d-bde04c01a586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c741e7a5154dd3b5d9822510d54495'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.220462 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f5c1c490-267d-40b0-a99d-bde04c01a586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c741e7a5154dd3b5d9822510d54495'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.244365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1191/2396] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:06:58 2022] DELETE /identity/v3/users/f8c741e7a5154dd3b5d9822510d54495 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:06:58.431538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:06:58.433723 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:06:58.448442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01d7f0-33e6-4860-95d3-ff6a106c2484 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:06:58.468464 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:06:58.515593 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:06:58.516242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:06:58.516521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:06:58.516792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] PATH_INFO: `/v3/projects/b5acedb07a0a44339398638851fea04e` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:06:58.517950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5acedb07a0a44339398638851fea04e)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:06:58.520161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:06:58.586319 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5acedb07a0a44339398638851fea04e', 'request_id': 'req-8aca490d-eb1d-458b-9024-b3321e8d6973'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.594942 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5acedb07a0a44339398638851fea04e', 'request_id': 'req-8aca490d-eb1d-458b-9024-b3321e8d6973'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.604346 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5acedb07a0a44339398638851fea04e', 'request_id': 'req-8aca490d-eb1d-458b-9024-b3321e8d6973'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.618279 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] The token cache is being invalidate because project b5acedb07a0a44339398638851fea04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:06:58.619112 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.619690 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:06:58.621448 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1206/2397] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:06:58 2022] DELETE /identity/v3/projects/b5acedb07a0a44339398638851fea04e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:08.240313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:08.614677 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:13.988290 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34387-a5f5-48ba-91c8-fc85a376cab9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:13.988793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34387-a5f5-48ba-91c8-fc85a376cab9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:13.988889 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34387-a5f5-48ba-91c8-fc85a376cab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:14.008073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-05a34387-a5f5-48ba-91c8-fc85a376cab9 None None] MFA Rules not processed for user `4d3445e9462b42cd82ea10ed54193c89`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:14.009263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-05a34387-a5f5-48ba-91c8-fc85a376cab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:14.066156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1192/2398] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:07:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:07:24.059367 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=25 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:28.062230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:28.063956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:28.133679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca490d-eb1d-458b-9024-b3321e8d6973 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:28.138357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e3d40-ad10-4ba3-9e68-20a23e66879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:28.139027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3d40-ad10-4ba3-9e68-20a23e66879f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:28.139307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3d40-ad10-4ba3-9e68-20a23e66879f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:28.139575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3d40-ad10-4ba3-9e68-20a23e66879f admin admin] PATH_INFO: `/v3/users/0a01c075e69b49aa8f44968ed2cca1b0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:28.146032 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e3d40-ad10-4ba3-9e68-20a23e66879f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a01c075e69b49aa8f44968ed2cca1b0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:28.148286 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e3d40-ad10-4ba3-9e68-20a23e66879f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:28.197639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e17e3d40-ad10-4ba3-9e68-20a23e66879f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a01c075e69b49aa8f44968ed2cca1b0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:28.210086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e17e3d40-ad10-4ba3-9e68-20a23e66879f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a01c075e69b49aa8f44968ed2cca1b0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:28.217678 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e17e3d40-ad10-4ba3-9e68-20a23e66879f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a01c075e69b49aa8f44968ed2cca1b0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:28.225093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e17e3d40-ad10-4ba3-9e68-20a23e66879f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a01c075e69b49aa8f44968ed2cca1b0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:28.225754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e17e3d40-ad10-4ba3-9e68-20a23e66879f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a01c075e69b49aa8f44968ed2cca1b0'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:28.231830 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1207/2399] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:07:28 2022] DELETE /identity/v3/users/0a01c075e69b49aa8f44968ed2cca1b0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:28.422151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a34387-a5f5-48ba-91c8-fc85a376cab9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:28.439063 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a34387-a5f5-48ba-91c8-fc85a376cab9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:28.499776 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a1a64-225c-435f-b54b-f09955f1b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:28.500419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a1a64-225c-435f-b54b-f09955f1b5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:28.500691 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a1a64-225c-435f-b54b-f09955f1b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:28.500959 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a1a64-225c-435f-b54b-f09955f1b5ab admin admin] PATH_INFO: `/v3/projects/4b3d3cfe0ecb4b9d8efbab1107184d3e` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:28.502146 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a1a64-225c-435f-b54b-f09955f1b5ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3d3cfe0ecb4b9d8efbab1107184d3e)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:28.504097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a1a64-225c-435f-b54b-f09955f1b5ab admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:28.554341 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a79a1a64-225c-435f-b54b-f09955f1b5ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3d3cfe0ecb4b9d8efbab1107184d3e', 'request_id': 'req-a79a1a64-225c-435f-b54b-f09955f1b5ab'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:28.561260 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a79a1a64-225c-435f-b54b-f09955f1b5ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3d3cfe0ecb4b9d8efbab1107184d3e', 'request_id': 'req-a79a1a64-225c-435f-b54b-f09955f1b5ab'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:28.569548 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a79a1a64-225c-435f-b54b-f09955f1b5ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3d3cfe0ecb4b9d8efbab1107184d3e', 'request_id': 'req-a79a1a64-225c-435f-b54b-f09955f1b5ab'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:28.584061 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a79a1a64-225c-435f-b54b-f09955f1b5ab admin admin] The token cache is being invalidate because project 4b3d3cfe0ecb4b9d8efbab1107184d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:07:28.584422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a79a1a64-225c-435f-b54b-f09955f1b5ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:28.585515 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a79a1a64-225c-435f-b54b-f09955f1b5ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:28.587897 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1193/2400] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:07:28 2022] DELETE /identity/v3/projects/4b3d3cfe0ecb4b9d8efbab1107184d3e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:28.594406 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a531b-dcd7-4f75-90ea-3d5d849b0ce0 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:28.594811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a531b-dcd7-4f75-90ea-3d5d849b0ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:28.595175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a531b-dcd7-4f75-90ea-3d5d849b0ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:28.617824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-798a531b-dcd7-4f75-90ea-3d5d849b0ce0 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:28.619104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-798a531b-dcd7-4f75-90ea-3d5d849b0ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:28.682060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1208/2401] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:07:28.691887 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0ce22-4661-4756-bd23-f165c516fbea None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:28.692234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0ce22-4661-4756-bd23-f165c516fbea None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:28.692602 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0ce22-4661-4756-bd23-f165c516fbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:28.715536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e1a0ce22-4661-4756-bd23-f165c516fbea None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:28.716837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e1a0ce22-4661-4756-bd23-f165c516fbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:28.726505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1194/2402] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:07:28.731082 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a531b-dcd7-4f75-90ea-3d5d849b0ce0 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:28.741946 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a531b-dcd7-4f75-90ea-3d5d849b0ce0 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:28.747162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02288a55-d057-4c7e-b2ef-c1f0a1df007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:28.747758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02288a55-d057-4c7e-b2ef-c1f0a1df007d admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:28.748033 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02288a55-d057-4c7e-b2ef-c1f0a1df007d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:28.748411 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02288a55-d057-4c7e-b2ef-c1f0a1df007d admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:28.748938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02288a55-d057-4c7e-b2ef-c1f0a1df007d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:07:28.749240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02288a55-d057-4c7e-b2ef-c1f0a1df007d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:28.750902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02288a55-d057-4c7e-b2ef-c1f0a1df007d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:28.763610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1209/2403] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:07:28.768075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0ce22-4661-4756-bd23-f165c516fbea None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:28.777895 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0ce22-4661-4756-bd23-f165c516fbea None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:28.782732 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b3109-6698-479e-acc8-b59d4f1de0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:28.783335 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b3109-6698-479e-acc8-b59d4f1de0bc admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:28.783611 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b3109-6698-479e-acc8-b59d4f1de0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:28.783877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b3109-6698-479e-acc8-b59d4f1de0bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:28.784499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b3109-6698-479e-acc8-b59d4f1de0bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:28.786404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b3109-6698-479e-acc8-b59d4f1de0bc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:28.819509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1195/2404] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:07:28 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:07:28.824316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02288a55-d057-4c7e-b2ef-c1f0a1df007d admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:28.835493 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02288a55-d057-4c7e-b2ef-c1f0a1df007d admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:28.839852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:28.900577 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c058c-6042-42bd-a03a-afb4facee4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:28.901198 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c058c-6042-42bd-a03a-afb4facee4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:28.901463 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c058c-6042-42bd-a03a-afb4facee4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:28.901731 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c058c-6042-42bd-a03a-afb4facee4c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:28.902357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c058c-6042-42bd-a03a-afb4facee4c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:28.904343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c058c-6042-42bd-a03a-afb4facee4c3 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:28.930327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1210/2405] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:07:28 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:07:28.934660 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b3109-6698-479e-acc8-b59d4f1de0bc admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:28.944946 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b3109-6698-479e-acc8-b59d4f1de0bc admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:28.950589 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395a04f-b57a-435e-87ee-bea2aa584416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:28.951208 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395a04f-b57a-435e-87ee-bea2aa584416 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:28.951482 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395a04f-b57a-435e-87ee-bea2aa584416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:28.951748 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395a04f-b57a-435e-87ee-bea2aa584416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:28.952389 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395a04f-b57a-435e-87ee-bea2aa584416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:28.953958 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395a04f-b57a-435e-87ee-bea2aa584416 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:28.966181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1196/2406] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:07:28.970419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c058c-6042-42bd-a03a-afb4facee4c3 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:28.983571 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c058c-6042-42bd-a03a-afb4facee4c3 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:28.991502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a57bf-16be-45ec-a2b3-0fd05fc95543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:28.992354 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a57bf-16be-45ec-a2b3-0fd05fc95543 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:28.992714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a57bf-16be-45ec-a2b3-0fd05fc95543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:28.993118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a57bf-16be-45ec-a2b3-0fd05fc95543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:28.993767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a57bf-16be-45ec-a2b3-0fd05fc95543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:28.995422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a57bf-16be-45ec-a2b3-0fd05fc95543 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:29.006264 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1211/2407] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:07:29.010743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395a04f-b57a-435e-87ee-bea2aa584416 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:29.021280 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395a04f-b57a-435e-87ee-bea2aa584416 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:29.026405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafb455-277d-4bb8-9f21-172ecb7f214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:29.027115 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb455-277d-4bb8-9f21-172ecb7f214e admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:29.027393 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb455-277d-4bb8-9f21-172ecb7f214e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:29.027669 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafb455-277d-4bb8-9f21-172ecb7f214e admin admin] PATH_INFO: `/v3/projects/00c391c8fcb9474f9001a747cacb577d/users/bafae1c4ca2044e49c92deeffcff6aa8/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:29.042708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafb455-277d-4bb8-9f21-172ecb7f214e admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c391c8fcb9474f9001a747cacb577d, user_id=bafae1c4ca2044e49c92deeffcff6aa8, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:29.045558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafb455-277d-4bb8-9f21-172ecb7f214e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:29.059372 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1197/2408] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:07:29 2022] PUT /identity/v3/projects/00c391c8fcb9474f9001a747cacb577d/users/bafae1c4ca2044e49c92deeffcff6aa8/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:29.069649 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f57c1d-235d-419b-984c-c09530fedec0 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:29.070133 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f57c1d-235d-419b-984c-c09530fedec0 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:29.070133 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f57c1d-235d-419b-984c-c09530fedec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:29.104273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-64f57c1d-235d-419b-984c-c09530fedec0 None None] MFA Rules not processed for user `bafae1c4ca2044e49c92deeffcff6aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:29.105515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-64f57c1d-235d-419b-984c-c09530fedec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:29.177643 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1212/2409] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:07:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:07:29.182262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafb455-277d-4bb8-9f21-172ecb7f214e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:29.216966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:29.255601 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafb455-277d-4bb8-9f21-172ecb7f214e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:29.260517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead02e6e-a89c-491e-ad55-1eafdac80123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:29.261204 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead02e6e-a89c-491e-ad55-1eafdac80123 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:29.261622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead02e6e-a89c-491e-ad55-1eafdac80123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:29.262004 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead02e6e-a89c-491e-ad55-1eafdac80123 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:29.262797 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead02e6e-a89c-491e-ad55-1eafdac80123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:29.265381 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead02e6e-a89c-491e-ad55-1eafdac80123 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:29.297896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1198/2410] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:07:29 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:07:29.306690 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f57c1d-235d-419b-984c-c09530fedec0 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:29.319276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f57c1d-235d-419b-984c-c09530fedec0 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:29.384420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688d566-8b23-4405-9b02-e865e8eca083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:29.385147 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688d566-8b23-4405-9b02-e865e8eca083 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:29.385343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688d566-8b23-4405-9b02-e865e8eca083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:29.385619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688d566-8b23-4405-9b02-e865e8eca083 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:29.386269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688d566-8b23-4405-9b02-e865e8eca083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:29.388507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688d566-8b23-4405-9b02-e865e8eca083 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:29.410995 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1213/2411] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:07:29 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:07:29.415050 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead02e6e-a89c-491e-ad55-1eafdac80123 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:29.426180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead02e6e-a89c-491e-ad55-1eafdac80123 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:29.431532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1d74f-f1bb-40ea-b614-46f54d93ca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:29.432340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1d74f-f1bb-40ea-b614-46f54d93ca77 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:29.432689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1d74f-f1bb-40ea-b614-46f54d93ca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:29.433029 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1d74f-f1bb-40ea-b614-46f54d93ca77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:29.433787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1d74f-f1bb-40ea-b614-46f54d93ca77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:29.435572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1d74f-f1bb-40ea-b614-46f54d93ca77 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:29.461026 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1199/2412] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:07:29.462336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688d566-8b23-4405-9b02-e865e8eca083 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:29.470164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:29.474420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688d566-8b23-4405-9b02-e865e8eca083 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:29.479864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7f1cc-4538-423f-a65a-1ba71aaf0952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:29.480665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7f1cc-4538-423f-a65a-1ba71aaf0952 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:29.481111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7f1cc-4538-423f-a65a-1ba71aaf0952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:29.481496 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7f1cc-4538-423f-a65a-1ba71aaf0952 admin admin] PATH_INFO: `/v3/projects/d05d396951d94d49a41e6564e8b6bc4b/users/7ca39489c72e4203a2113f43030743bb/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:29.497200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7f1cc-4538-423f-a65a-1ba71aaf0952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05d396951d94d49a41e6564e8b6bc4b, user_id=7ca39489c72e4203a2113f43030743bb, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:29.500440 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7f1cc-4538-423f-a65a-1ba71aaf0952 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:29.516243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1214/2413] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:07:29 2022] PUT /identity/v3/projects/d05d396951d94d49a41e6564e8b6bc4b/users/7ca39489c72e4203a2113f43030743bb/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:29.520314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1d74f-f1bb-40ea-b614-46f54d93ca77 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:29.530807 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1d74f-f1bb-40ea-b614-46f54d93ca77 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:29.599918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e90e9-a3ce-426f-99f0-ccc3a2568cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:29.600436 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e90e9-a3ce-426f-99f0-ccc3a2568cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:29.600714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e90e9-a3ce-426f-99f0-ccc3a2568cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:29.600984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e90e9-a3ce-426f-99f0-ccc3a2568cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:29.602311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e90e9-a3ce-426f-99f0-ccc3a2568cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:29.603592 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e90e9-a3ce-426f-99f0-ccc3a2568cc2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:29.614057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1200/2414] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:07:29.618560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7f1cc-4538-423f-a65a-1ba71aaf0952 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:29.630271 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7f1cc-4538-423f-a65a-1ba71aaf0952 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:29.637603 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319641d-c6fa-458b-b83b-5197ff5781f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:29.638284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319641d-c6fa-458b-b83b-5197ff5781f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:29.638563 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319641d-c6fa-458b-b83b-5197ff5781f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:29.638860 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319641d-c6fa-458b-b83b-5197ff5781f5 admin admin] PATH_INFO: `/v3/projects/d05d396951d94d49a41e6564e8b6bc4b/users/7ca39489c72e4203a2113f43030743bb/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:29.640990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319641d-c6fa-458b-b83b-5197ff5781f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05d396951d94d49a41e6564e8b6bc4b, user_id=7ca39489c72e4203a2113f43030743bb, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:29.643743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319641d-c6fa-458b-b83b-5197ff5781f5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:29.655092 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1215/2415] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:07:29 2022] PUT /identity/v3/projects/d05d396951d94d49a41e6564e8b6bc4b/users/7ca39489c72e4203a2113f43030743bb/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:29.666006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b345c-bb6c-455e-8d1a-f6966fb3eb48 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:29.666254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b345c-bb6c-455e-8d1a-f6966fb3eb48 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:29.666524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b345c-bb6c-455e-8d1a-f6966fb3eb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:29.696380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-132b345c-bb6c-455e-8d1a-f6966fb3eb48 None None] MFA Rules not processed for user `7ca39489c72e4203a2113f43030743bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:29.697654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-132b345c-bb6c-455e-8d1a-f6966fb3eb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:29.778177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1201/2416] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:07:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:07:29.790315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319641d-c6fa-458b-b83b-5197ff5781f5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:29.792118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4319641d-c6fa-458b-b83b-5197ff5781f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:29.881152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319641d-c6fa-458b-b83b-5197ff5781f5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:29.886306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e322d-779b-4da7-bd1a-13c1078745ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:29.887224 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e322d-779b-4da7-bd1a-13c1078745ff service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:29.887498 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e322d-779b-4da7-bd1a-13c1078745ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:29.887891 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e322d-779b-4da7-bd1a-13c1078745ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:29.898239 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e322d-779b-4da7-bd1a-13c1078745ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:29.899809 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e322d-779b-4da7-bd1a-13c1078745ff service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:29.911505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1216/2417] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:07:30.000939 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b345c-bb6c-455e-8d1a-f6966fb3eb48 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:30.012814 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b345c-bb6c-455e-8d1a-f6966fb3eb48 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:30.016492 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a12f6-8bb2-4365-bff1-690fd89e4265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:30.017259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a12f6-8bb2-4365-bff1-690fd89e4265 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:30.017528 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a12f6-8bb2-4365-bff1-690fd89e4265 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:30.017804 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a12f6-8bb2-4365-bff1-690fd89e4265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:30.043457 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:30.089036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a12f6-8bb2-4365-bff1-690fd89e4265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:30.090711 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a12f6-8bb2-4365-bff1-690fd89e4265 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:30.100868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1202/2418] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:07:34.923274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e322d-779b-4da7-bd1a-13c1078745ff service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:34.924748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3a1e322d-779b-4da7-bd1a-13c1078745ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:34.985176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e322d-779b-4da7-bd1a-13c1078745ff service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:34.989039 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb468a-fc00-4944-8eb5-86af43405105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:34.989651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb468a-fc00-4944-8eb5-86af43405105 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:34.989925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb468a-fc00-4944-8eb5-86af43405105 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:34.990219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb468a-fc00-4944-8eb5-86af43405105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:34.992152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-2cfb468a-fc00-4944-8eb5-86af43405105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:35.071414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb468a-fc00-4944-8eb5-86af43405105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:35.073210 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb468a-fc00-4944-8eb5-86af43405105 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:35.085706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1217/2419] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:07:36.252565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a12f6-8bb2-4365-bff1-690fd89e4265 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:36.317424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a12f6-8bb2-4365-bff1-690fd89e4265 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:36.322216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862a253-1a72-41b9-aff3-7dc87dfdb760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:36.322921 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862a253-1a72-41b9-aff3-7dc87dfdb760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:36.323202 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862a253-1a72-41b9-aff3-7dc87dfdb760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:36.323473 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862a253-1a72-41b9-aff3-7dc87dfdb760 admin admin] PATH_INFO: `/v3/users/bafae1c4ca2044e49c92deeffcff6aa8` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:36.324623 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862a253-1a72-41b9-aff3-7dc87dfdb760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bafae1c4ca2044e49c92deeffcff6aa8)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:36.326935 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862a253-1a72-41b9-aff3-7dc87dfdb760 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:36.386397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7862a253-1a72-41b9-aff3-7dc87dfdb760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bafae1c4ca2044e49c92deeffcff6aa8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:36.387174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7862a253-1a72-41b9-aff3-7dc87dfdb760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bafae1c4ca2044e49c92deeffcff6aa8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:36.387839 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7862a253-1a72-41b9-aff3-7dc87dfdb760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bafae1c4ca2044e49c92deeffcff6aa8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:36.395060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7862a253-1a72-41b9-aff3-7dc87dfdb760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bafae1c4ca2044e49c92deeffcff6aa8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:36.403200 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7862a253-1a72-41b9-aff3-7dc87dfdb760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bafae1c4ca2044e49c92deeffcff6aa8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:36.419984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1203/2420] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:07:36 2022] DELETE /identity/v3/users/bafae1c4ca2044e49c92deeffcff6aa8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:36.424698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdf0dc-7168-44a1-9aed-78675e54b46d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:36.425204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdf0dc-7168-44a1-9aed-78675e54b46d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:36.425308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdf0dc-7168-44a1-9aed-78675e54b46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:36.444710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-e1bdf0dc-7168-44a1-9aed-78675e54b46d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:36.445946 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e1bdf0dc-7168-44a1-9aed-78675e54b46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:36.451457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:36.511368 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1218/2421] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:07:36.522963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862a253-1a72-41b9-aff3-7dc87dfdb760 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:36.524522 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7862a253-1a72-41b9-aff3-7dc87dfdb760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:36.574772 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:36.591038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862a253-1a72-41b9-aff3-7dc87dfdb760 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:36.594956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38701ccb-6e79-4708-af18-7392b1b06bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:36.595556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701ccb-6e79-4708-af18-7392b1b06bdd service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:36.595831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701ccb-6e79-4708-af18-7392b1b06bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:36.596097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701ccb-6e79-4708-af18-7392b1b06bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:36.605817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38701ccb-6e79-4708-af18-7392b1b06bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:36.607283 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38701ccb-6e79-4708-af18-7392b1b06bdd service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:36.617829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1204/2422] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:07:36.896133 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdf0dc-7168-44a1-9aed-78675e54b46d None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:36.897877 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e1bdf0dc-7168-44a1-9aed-78675e54b46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:36.913725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdf0dc-7168-44a1-9aed-78675e54b46d None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:36.919747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:36.920388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:36.920713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:36.920928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] PATH_INFO: `/v3/projects/00c391c8fcb9474f9001a747cacb577d` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:36.922149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c391c8fcb9474f9001a747cacb577d)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:36.924188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:36.977969 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c391c8fcb9474f9001a747cacb577d', 'request_id': 'req-d2ffbfd3-6058-4de8-8993-2f14207234e5'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:36.989276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c391c8fcb9474f9001a747cacb577d', 'request_id': 'req-d2ffbfd3-6058-4de8-8993-2f14207234e5'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:36.995802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c391c8fcb9474f9001a747cacb577d', 'request_id': 'req-d2ffbfd3-6058-4de8-8993-2f14207234e5'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:37.009774 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] The token cache is being invalidate because project 00c391c8fcb9474f9001a747cacb577d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:07:37.010113 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:37.011093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:37.013249 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1219/2423] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:07:36 2022] DELETE /identity/v3/projects/00c391c8fcb9474f9001a747cacb577d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:37.018673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38701ccb-6e79-4708-af18-7392b1b06bdd service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:37.029509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38701ccb-6e79-4708-af18-7392b1b06bdd service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:37.090964 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e465da-6f5e-409a-8b19-8254110f4cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:37.091598 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e465da-6f5e-409a-8b19-8254110f4cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:37.091868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e465da-6f5e-409a-8b19-8254110f4cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:37.092136 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e465da-6f5e-409a-8b19-8254110f4cbb admin admin] PATH_INFO: `/v3/users/7ca39489c72e4203a2113f43030743bb` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:37.093268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e465da-6f5e-409a-8b19-8254110f4cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca39489c72e4203a2113f43030743bb)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:37.095225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e465da-6f5e-409a-8b19-8254110f4cbb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:37.143079 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d3e465da-6f5e-409a-8b19-8254110f4cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca39489c72e4203a2113f43030743bb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:37.143644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d3e465da-6f5e-409a-8b19-8254110f4cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca39489c72e4203a2113f43030743bb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:37.144255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d3e465da-6f5e-409a-8b19-8254110f4cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca39489c72e4203a2113f43030743bb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:37.151443 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d3e465da-6f5e-409a-8b19-8254110f4cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca39489c72e4203a2113f43030743bb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:37.160028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d3e465da-6f5e-409a-8b19-8254110f4cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca39489c72e4203a2113f43030743bb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:37.183893 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1205/2424] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:07:37 2022] DELETE /identity/v3/users/7ca39489c72e4203a2113f43030743bb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:37.500772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:37.501894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:37.515952 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffbfd3-6058-4de8-8993-2f14207234e5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:37.600808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:37.601522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:37.601813 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:37.602090 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8 admin admin] PATH_INFO: `/v3/projects/d05d396951d94d49a41e6564e8b6bc4b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:37.603401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05d396951d94d49a41e6564e8b6bc4b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:37.605482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:37.644858 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:37.655718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05d396951d94d49a41e6564e8b6bc4b', 'request_id': 'req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:37.664859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05d396951d94d49a41e6564e8b6bc4b', 'request_id': 'req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:37.671541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05d396951d94d49a41e6564e8b6bc4b', 'request_id': 'req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:37.682325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8 admin admin] The token cache is being invalidate because project d05d396951d94d49a41e6564e8b6bc4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:07:37.682639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:37.683342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-dcfdf257-9e7b-4ff6-8a76-9fc1a7b0e9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:37.684921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1220/2425] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:07:37 2022] DELETE /identity/v3/projects/d05d396951d94d49a41e6564e8b6bc4b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:37.690360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4a16e-7a55-4868-afbf-d49c998b60c4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:37.690906 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4a16e-7a55-4868-afbf-d49c998b60c4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:37.691012 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4a16e-7a55-4868-afbf-d49c998b60c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:37.711616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e4b4a16e-7a55-4868-afbf-d49c998b60c4 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:37.712820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e4b4a16e-7a55-4868-afbf-d49c998b60c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:37.780359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1206/2426] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:07:37.793477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7a0df-dea7-4ac3-a5b1-750b72363c45 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:37.793773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7a0df-dea7-4ac3-a5b1-750b72363c45 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:37.794035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7a0df-dea7-4ac3-a5b1-750b72363c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:37.822628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c4f7a0df-dea7-4ac3-a5b1-750b72363c45 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:37.823950 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c4f7a0df-dea7-4ac3-a5b1-750b72363c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:37.835776 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1221/2427] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:07:37.841413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4a16e-7a55-4868-afbf-d49c998b60c4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:37.848979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:37.859790 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4a16e-7a55-4868-afbf-d49c998b60c4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:37.869291 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d06aa-eccd-4fe9-9a56-1542eaba0e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:37.870015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d06aa-eccd-4fe9-9a56-1542eaba0e39 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:37.870294 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d06aa-eccd-4fe9-9a56-1542eaba0e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:37.871150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d06aa-eccd-4fe9-9a56-1542eaba0e39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:37.871267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d06aa-eccd-4fe9-9a56-1542eaba0e39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:07:37.871562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d06aa-eccd-4fe9-9a56-1542eaba0e39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:37.873267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d06aa-eccd-4fe9-9a56-1542eaba0e39 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:37.886054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1207/2428] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:07:37.890934 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7a0df-dea7-4ac3-a5b1-750b72363c45 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:37.901000 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7a0df-dea7-4ac3-a5b1-750b72363c45 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:37.906094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e2bd8-da4f-48b0-ae60-bc55f0d23aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:37.906772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e2bd8-da4f-48b0-ae60-bc55f0d23aff admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:37.907050 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e2bd8-da4f-48b0-ae60-bc55f0d23aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:37.907341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e2bd8-da4f-48b0-ae60-bc55f0d23aff admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:37.907939 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e2bd8-da4f-48b0-ae60-bc55f0d23aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:37.909963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e2bd8-da4f-48b0-ae60-bc55f0d23aff admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:37.939264 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1222/2429] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:07:37 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:07:37.944634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d06aa-eccd-4fe9-9a56-1542eaba0e39 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:37.958143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d06aa-eccd-4fe9-9a56-1542eaba0e39 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:38.023139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d3de-f6a9-4c26-ab8e-df063bdde76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:38.023765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d3de-f6a9-4c26-ab8e-df063bdde76a admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:38.024048 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d3de-f6a9-4c26-ab8e-df063bdde76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:38.024315 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d3de-f6a9-4c26-ab8e-df063bdde76a admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:38.024990 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853d3de-f6a9-4c26-ab8e-df063bdde76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:38.027116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853d3de-f6a9-4c26-ab8e-df063bdde76a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:38.050582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1208/2430] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:07:37 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:07:38.054951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e2bd8-da4f-48b0-ae60-bc55f0d23aff admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:38.065818 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e2bd8-da4f-48b0-ae60-bc55f0d23aff admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:38.071480 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8145f-30cd-4b0b-8d80-f84dc4ab14da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:38.072074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8145f-30cd-4b0b-8d80-f84dc4ab14da admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:38.072378 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8145f-30cd-4b0b-8d80-f84dc4ab14da admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:38.072682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8145f-30cd-4b0b-8d80-f84dc4ab14da admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:38.073315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8145f-30cd-4b0b-8d80-f84dc4ab14da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:38.074967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8145f-30cd-4b0b-8d80-f84dc4ab14da admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:38.086339 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1223/2431] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:07:38.090868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d3de-f6a9-4c26-ab8e-df063bdde76a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:38.102109 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d3de-f6a9-4c26-ab8e-df063bdde76a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:38.107698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bca53-98a6-4e8d-8b2c-9ef9a5f34ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:38.108296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bca53-98a6-4e8d-8b2c-9ef9a5f34ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:38.108573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bca53-98a6-4e8d-8b2c-9ef9a5f34ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:38.108841 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bca53-98a6-4e8d-8b2c-9ef9a5f34ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:38.109481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bca53-98a6-4e8d-8b2c-9ef9a5f34ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:38.111121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bca53-98a6-4e8d-8b2c-9ef9a5f34ac8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:38.123018 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1209/2432] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:07:38.127284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8145f-30cd-4b0b-8d80-f84dc4ab14da admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:38.137658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8145f-30cd-4b0b-8d80-f84dc4ab14da admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:38.142562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3c30e-d1a7-44a3-8f02-3d8b92304587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:38.143235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3c30e-d1a7-44a3-8f02-3d8b92304587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:38.143510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3c30e-d1a7-44a3-8f02-3d8b92304587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:38.143782 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3c30e-d1a7-44a3-8f02-3d8b92304587 admin admin] PATH_INFO: `/v3/projects/c408c67f716f4242b22b7f73998a1fa4/users/8b88a33ed33f4a5dbb891522de0af630/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:38.160587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3c30e-d1a7-44a3-8f02-3d8b92304587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c408c67f716f4242b22b7f73998a1fa4, user_id=8b88a33ed33f4a5dbb891522de0af630, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:38.163342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3c30e-d1a7-44a3-8f02-3d8b92304587 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:38.180001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1224/2433] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:07:38 2022] PUT /identity/v3/projects/c408c67f716f4242b22b7f73998a1fa4/users/8b88a33ed33f4a5dbb891522de0af630/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:07:38.196135 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913862c-0ede-47d8-b70d-665f0c575a83 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:38.196355 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913862c-0ede-47d8-b70d-665f0c575a83 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:38.196625 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913862c-0ede-47d8-b70d-665f0c575a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:38.227382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4913862c-0ede-47d8-b70d-665f0c575a83 None None] MFA Rules not processed for user `8b88a33ed33f4a5dbb891522de0af630`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:38.228764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4913862c-0ede-47d8-b70d-665f0c575a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:38.294651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1210/2434] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:07:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:07:38.299409 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3c30e-d1a7-44a3-8f02-3d8b92304587 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:38.364348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3c30e-d1a7-44a3-8f02-3d8b92304587 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:38.369996 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacd8f1-90e8-4357-a97c-f0116be390d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:38.370614 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacd8f1-90e8-4357-a97c-f0116be390d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:38.370889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacd8f1-90e8-4357-a97c-f0116be390d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:38.371208 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacd8f1-90e8-4357-a97c-f0116be390d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:38.371852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacd8f1-90e8-4357-a97c-f0116be390d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:38.373779 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacd8f1-90e8-4357-a97c-f0116be390d2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:38.404216 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1225/2435] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:07:38 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:07:38.409969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913862c-0ede-47d8-b70d-665f0c575a83 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:38.421303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913862c-0ede-47d8-b70d-665f0c575a83 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:38.475850 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:38.485150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39c845-3016-4076-9688-29111f7b026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:38.487153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39c845-3016-4076-9688-29111f7b026d admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:38.487557 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39c845-3016-4076-9688-29111f7b026d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:38.487963 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39c845-3016-4076-9688-29111f7b026d admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:38.489097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39c845-3016-4076-9688-29111f7b026d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:38.492276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39c845-3016-4076-9688-29111f7b026d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:38.515468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1211/2436] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:07:38 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:07:38.519791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacd8f1-90e8-4357-a97c-f0116be390d2 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:38.530975 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacd8f1-90e8-4357-a97c-f0116be390d2 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:38.536054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72adfbb-244f-439b-bb71-3ab8eac91ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:38.537180 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72adfbb-244f-439b-bb71-3ab8eac91ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:38.537180 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72adfbb-244f-439b-bb71-3ab8eac91ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:38.537403 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72adfbb-244f-439b-bb71-3ab8eac91ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:38.537881 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72adfbb-244f-439b-bb71-3ab8eac91ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:38.540123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72adfbb-244f-439b-bb71-3ab8eac91ce9 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:38.552835 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1226/2437] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:07:38.558016 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39c845-3016-4076-9688-29111f7b026d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:38.568857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39c845-3016-4076-9688-29111f7b026d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:38.574538 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a69aa9-30c5-428a-af82-02b57308b4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:38.575249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a69aa9-30c5-428a-af82-02b57308b4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:38.575844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a69aa9-30c5-428a-af82-02b57308b4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:38.576117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a69aa9-30c5-428a-af82-02b57308b4d6 admin admin] PATH_INFO: `/v3/projects/beb90ffba98b43398c9a4e5ab2eed9aa/users/2005ba5183e14fa6afa89d36800edcf9/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:38.592108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a69aa9-30c5-428a-af82-02b57308b4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb90ffba98b43398c9a4e5ab2eed9aa, user_id=2005ba5183e14fa6afa89d36800edcf9, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:38.594885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a69aa9-30c5-428a-af82-02b57308b4d6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:38.609967 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1212/2438] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:07:38 2022] PUT /identity/v3/projects/beb90ffba98b43398c9a4e5ab2eed9aa/users/2005ba5183e14fa6afa89d36800edcf9/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:38.614517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72adfbb-244f-439b-bb71-3ab8eac91ce9 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:38.625548 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72adfbb-244f-439b-bb71-3ab8eac91ce9 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:38.662959 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:38.668795 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a69aa9-30c5-428a-af82-02b57308b4d6 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:38.670644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-43a69aa9-30c5-428a-af82-02b57308b4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:38.691766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f2ae3-13af-4ea0-b73a-e1b38d4541e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:38.692440 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f2ae3-13af-4ea0-b73a-e1b38d4541e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:38.692719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f2ae3-13af-4ea0-b73a-e1b38d4541e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:38.692992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f2ae3-13af-4ea0-b73a-e1b38d4541e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:38.693665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f2ae3-13af-4ea0-b73a-e1b38d4541e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:38.695331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f2ae3-13af-4ea0-b73a-e1b38d4541e5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:38.706229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1227/2439] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:07:38.710468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f2ae3-13af-4ea0-b73a-e1b38d4541e5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:38.721670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f2ae3-13af-4ea0-b73a-e1b38d4541e5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:38.727083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32a522-a8e8-479e-b669-5a08abd74bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:38.727752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a522-a8e8-479e-b669-5a08abd74bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:38.728034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a522-a8e8-479e-b669-5a08abd74bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:38.728308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32a522-a8e8-479e-b669-5a08abd74bd6 admin admin] PATH_INFO: `/v3/projects/beb90ffba98b43398c9a4e5ab2eed9aa/users/2005ba5183e14fa6afa89d36800edcf9/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:38.731456 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32a522-a8e8-479e-b669-5a08abd74bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb90ffba98b43398c9a4e5ab2eed9aa, user_id=2005ba5183e14fa6afa89d36800edcf9, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:38.733848 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a69aa9-30c5-428a-af82-02b57308b4d6 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:38.734308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32a522-a8e8-479e-b669-5a08abd74bd6 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:38.738034 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61ec50-e3c0-4d68-8cc8-3a44ed5be01d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:38.738656 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61ec50-e3c0-4d68-8cc8-3a44ed5be01d service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:38.738939 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61ec50-e3c0-4d68-8cc8-3a44ed5be01d service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:38.739214 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61ec50-e3c0-4d68-8cc8-3a44ed5be01d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:38.740999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fd61ec50-e3c0-4d68-8cc8-3a44ed5be01d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:38.745379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1228/2440] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:07:38 2022] PUT /identity/v3/projects/beb90ffba98b43398c9a4e5ab2eed9aa/users/2005ba5183e14fa6afa89d36800edcf9/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:07:38.756416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacc23c-2c75-490d-a7b5-abe783d1f27a None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:38.756701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacc23c-2c75-490d-a7b5-abe783d1f27a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:38.757039 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacc23c-2c75-490d-a7b5-abe783d1f27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:38.785691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-7dacc23c-2c75-490d-a7b5-abe783d1f27a None None] MFA Rules not processed for user `2005ba5183e14fa6afa89d36800edcf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:38.786978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7dacc23c-2c75-490d-a7b5-abe783d1f27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:38.816254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61ec50-e3c0-4d68-8cc8-3a44ed5be01d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:38.817717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61ec50-e3c0-4d68-8cc8-3a44ed5be01d service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:38.830239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1213/2441] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:07:38.860218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1229/2442] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:07:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:07:38.872554 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61ec50-e3c0-4d68-8cc8-3a44ed5be01d service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:38.873979 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fd61ec50-e3c0-4d68-8cc8-3a44ed5be01d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:38.933825 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61ec50-e3c0-4d68-8cc8-3a44ed5be01d service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:38.952941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:38.987410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04235dc-deea-41da-bdad-379b175c8410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:38.987978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04235dc-deea-41da-bdad-379b175c8410 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:38.988225 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04235dc-deea-41da-bdad-379b175c8410 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:38.988532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04235dc-deea-41da-bdad-379b175c8410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:39.047902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04235dc-deea-41da-bdad-379b175c8410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:39.048784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04235dc-deea-41da-bdad-379b175c8410 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:39.058030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1214/2443] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:07:40.436511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacc23c-2c75-490d-a7b5-abe783d1f27a None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:40.438165 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7dacc23c-2c75-490d-a7b5-abe783d1f27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:40.453579 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacc23c-2c75-490d-a7b5-abe783d1f27a None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:40.459431 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada980a-2597-4767-8247-b63b61a3c64d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:40.460093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada980a-2597-4767-8247-b63b61a3c64d service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:40.460432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada980a-2597-4767-8247-b63b61a3c64d service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:40.460759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada980a-2597-4767-8247-b63b61a3c64d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:40.472898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada980a-2597-4767-8247-b63b61a3c64d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:40.474371 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada980a-2597-4767-8247-b63b61a3c64d service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:40.485171 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1230/2444] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:07:44.325481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04235dc-deea-41da-bdad-379b175c8410 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:44.401656 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04235dc-deea-41da-bdad-379b175c8410 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:44.406423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df83b7-eb1b-4df9-a7e2-d4e6f322ef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:44.407302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df83b7-eb1b-4df9-a7e2-d4e6f322ef9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:44.407731 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df83b7-eb1b-4df9-a7e2-d4e6f322ef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:44.408076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df83b7-eb1b-4df9-a7e2-d4e6f322ef9b admin admin] PATH_INFO: `/v3/users/8b88a33ed33f4a5dbb891522de0af630` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:44.409510 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df83b7-eb1b-4df9-a7e2-d4e6f322ef9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b88a33ed33f4a5dbb891522de0af630)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:44.411873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df83b7-eb1b-4df9-a7e2-d4e6f322ef9b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:44.470343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f9df83b7-eb1b-4df9-a7e2-d4e6f322ef9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b88a33ed33f4a5dbb891522de0af630'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:44.471195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f9df83b7-eb1b-4df9-a7e2-d4e6f322ef9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b88a33ed33f4a5dbb891522de0af630'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:44.474997 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f9df83b7-eb1b-4df9-a7e2-d4e6f322ef9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b88a33ed33f4a5dbb891522de0af630'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:44.484993 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f9df83b7-eb1b-4df9-a7e2-d4e6f322ef9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b88a33ed33f4a5dbb891522de0af630'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:44.496522 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f9df83b7-eb1b-4df9-a7e2-d4e6f322ef9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b88a33ed33f4a5dbb891522de0af630'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:44.510194 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:44.522760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1215/2445] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:07:44 2022] DELETE /identity/v3/users/8b88a33ed33f4a5dbb891522de0af630 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:44.527642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0a7d4-b0a2-4afc-b527-340e137cc4fb None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:44.528735 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0a7d4-b0a2-4afc-b527-340e137cc4fb None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:44.529699 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0a7d4-b0a2-4afc-b527-340e137cc4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:44.537405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1377b-6d51-48fd-88e6-46203457000a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:44.537696 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1377b-6d51-48fd-88e6-46203457000a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:44.537976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1377b-6d51-48fd-88e6-46203457000a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:44.551243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-93d0a7d4-b0a2-4afc-b527-340e137cc4fb None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:44.552565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-93d0a7d4-b0a2-4afc-b527-340e137cc4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:44.567536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-ecf1377b-6d51-48fd-88e6-46203457000a None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:44.568855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ecf1377b-6d51-48fd-88e6-46203457000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:44.618879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1231/2446] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:07:44.629186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0a7d4-b0a2-4afc-b527-340e137cc4fb None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:44.630842 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-93d0a7d4-b0a2-4afc-b527-340e137cc4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:44.634986 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1216/2447] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 16:07:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:07:44.647729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1377b-6d51-48fd-88e6-46203457000a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:44.649199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ecf1377b-6d51-48fd-88e6-46203457000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:44.666787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:44.693609 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0a7d4-b0a2-4afc-b527-340e137cc4fb None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:44.697461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc97c0e-815f-4dc2-8964-4df281b65c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:44.698070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc97c0e-815f-4dc2-8964-4df281b65c8a service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:44.698347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc97c0e-815f-4dc2-8964-4df281b65c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:44.698669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc97c0e-815f-4dc2-8964-4df281b65c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:44.708615 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc97c0e-815f-4dc2-8964-4df281b65c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:44.710062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc97c0e-815f-4dc2-8964-4df281b65c8a service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:44.720115 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1232/2448] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:07:44.722874 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1377b-6d51-48fd-88e6-46203457000a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:44.729722 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4b850-2c2a-48c4-94bf-27dc60151441 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:44.730835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4b850-2c2a-48c4-94bf-27dc60151441 service swift] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:44.731107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4b850-2c2a-48c4-94bf-27dc60151441 service swift] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:44.731385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4b850-2c2a-48c4-94bf-27dc60151441 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:44.743316 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4b850-2c2a-48c4-94bf-27dc60151441 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:44.745094 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4b850-2c2a-48c4-94bf-27dc60151441 service swift] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:44.757319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1217/2449] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:07:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 16:07:45.153084 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc97c0e-815f-4dc2-8964-4df281b65c8a service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:45.154990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7bc97c0e-815f-4dc2-8964-4df281b65c8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:45.177234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc97c0e-815f-4dc2-8964-4df281b65c8a service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:45.204030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:45.204705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:45.205008 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:45.205283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] PATH_INFO: `/v3/projects/c408c67f716f4242b22b7f73998a1fa4` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:45.207543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c408c67f716f4242b22b7f73998a1fa4)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:45.208706 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:45.280094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c408c67f716f4242b22b7f73998a1fa4', 'request_id': 'req-76475a0e-675d-46bb-a3eb-ac065fd16631'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:45.289750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c408c67f716f4242b22b7f73998a1fa4', 'request_id': 'req-76475a0e-675d-46bb-a3eb-ac065fd16631'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:45.301269 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c408c67f716f4242b22b7f73998a1fa4', 'request_id': 'req-76475a0e-675d-46bb-a3eb-ac065fd16631'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:45.316411 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] The token cache is being invalidate because project c408c67f716f4242b22b7f73998a1fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:07:45.316619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:45.317611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:45.319438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1233/2450] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:07:45 2022] DELETE /identity/v3/projects/c408c67f716f4242b22b7f73998a1fa4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:45.323394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4b850-2c2a-48c4-94bf-27dc60151441 service swift] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:45.334833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4b850-2c2a-48c4-94bf-27dc60151441 service swift] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:45.403353 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9bc3f-ae10-4e7d-8f04-4d4d49673b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:45.404055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9bc3f-ae10-4e7d-8f04-4d4d49673b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:45.404354 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9bc3f-ae10-4e7d-8f04-4d4d49673b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:45.404638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9bc3f-ae10-4e7d-8f04-4d4d49673b12 admin admin] PATH_INFO: `/v3/users/2005ba5183e14fa6afa89d36800edcf9` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:45.405894 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9bc3f-ae10-4e7d-8f04-4d4d49673b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2005ba5183e14fa6afa89d36800edcf9)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:45.407914 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9bc3f-ae10-4e7d-8f04-4d4d49673b12 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:45.455411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:45.474757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-dfe9bc3f-ae10-4e7d-8f04-4d4d49673b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2005ba5183e14fa6afa89d36800edcf9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:45.475412 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-dfe9bc3f-ae10-4e7d-8f04-4d4d49673b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2005ba5183e14fa6afa89d36800edcf9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:45.476009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-dfe9bc3f-ae10-4e7d-8f04-4d4d49673b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2005ba5183e14fa6afa89d36800edcf9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:45.484329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-dfe9bc3f-ae10-4e7d-8f04-4d4d49673b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2005ba5183e14fa6afa89d36800edcf9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:45.496247 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-dfe9bc3f-ae10-4e7d-8f04-4d4d49673b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2005ba5183e14fa6afa89d36800edcf9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:45.517567 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1218/2451] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:07:45 2022] DELETE /identity/v3/users/2005ba5183e14fa6afa89d36800edcf9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:45.862322 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:45.864718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:45.907671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76475a0e-675d-46bb-a3eb-ac065fd16631 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:45.986481 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c808016-2004-431f-94c5-b4e869683181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:45.987170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c808016-2004-431f-94c5-b4e869683181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:45.987442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c808016-2004-431f-94c5-b4e869683181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:45.987697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c808016-2004-431f-94c5-b4e869683181 admin admin] PATH_INFO: `/v3/projects/beb90ffba98b43398c9a4e5ab2eed9aa` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:45.988825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c808016-2004-431f-94c5-b4e869683181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb90ffba98b43398c9a4e5ab2eed9aa)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:45.991348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c808016-2004-431f-94c5-b4e869683181 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:46.064313 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2c808016-2004-431f-94c5-b4e869683181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb90ffba98b43398c9a4e5ab2eed9aa', 'request_id': 'req-2c808016-2004-431f-94c5-b4e869683181'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:46.078399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2c808016-2004-431f-94c5-b4e869683181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb90ffba98b43398c9a4e5ab2eed9aa', 'request_id': 'req-2c808016-2004-431f-94c5-b4e869683181'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:46.081692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:46.090633 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2c808016-2004-431f-94c5-b4e869683181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb90ffba98b43398c9a4e5ab2eed9aa', 'request_id': 'req-2c808016-2004-431f-94c5-b4e869683181'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:46.117247 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2c808016-2004-431f-94c5-b4e869683181 admin admin] The token cache is being invalidate because project beb90ffba98b43398c9a4e5ab2eed9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:07:46.117547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2c808016-2004-431f-94c5-b4e869683181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:46.118215 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2c808016-2004-431f-94c5-b4e869683181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:07:46.119905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1234/2452] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:07:45 2022] DELETE /identity/v3/projects/beb90ffba98b43398c9a4e5ab2eed9aa => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:07:46.126270 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc60a87-c87f-4a27-bf04-2cf1fbfe1c97 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:46.126818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc60a87-c87f-4a27-bf04-2cf1fbfe1c97 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:46.127130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc60a87-c87f-4a27-bf04-2cf1fbfe1c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:46.155775 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-bcc60a87-c87f-4a27-bf04-2cf1fbfe1c97 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:46.157046 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bcc60a87-c87f-4a27-bf04-2cf1fbfe1c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:46.258671 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1219/2453] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:07:46.265423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd25422-095d-442a-aa01-1a9a174572a8 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:46.266083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd25422-095d-442a-aa01-1a9a174572a8 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:46.266572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd25422-095d-442a-aa01-1a9a174572a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:46.288581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-5fd25422-095d-442a-aa01-1a9a174572a8 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:46.290360 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5fd25422-095d-442a-aa01-1a9a174572a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:46.300747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1235/2454] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:07:46.305091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc60a87-c87f-4a27-bf04-2cf1fbfe1c97 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:46.321178 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc60a87-c87f-4a27-bf04-2cf1fbfe1c97 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:46.332896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b18749-4969-4823-b7f5-0e157a0aa1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:46.333879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b18749-4969-4823-b7f5-0e157a0aa1dd admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:46.334237 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b18749-4969-4823-b7f5-0e157a0aa1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:46.334624 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b18749-4969-4823-b7f5-0e157a0aa1dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:46.337558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b18749-4969-4823-b7f5-0e157a0aa1dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:07:46.337558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b18749-4969-4823-b7f5-0e157a0aa1dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:46.338253 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b18749-4969-4823-b7f5-0e157a0aa1dd admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:46.354649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1220/2455] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 16:07:46.357670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd25422-095d-442a-aa01-1a9a174572a8 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:46.374025 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd25422-095d-442a-aa01-1a9a174572a8 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:46.380004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3ebe0-14f4-4115-8de4-a22892f09cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:46.380801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3ebe0-14f4-4115-8de4-a22892f09cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:46.381198 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3ebe0-14f4-4115-8de4-a22892f09cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:46.381540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3ebe0-14f4-4115-8de4-a22892f09cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:46.382352 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3ebe0-14f4-4115-8de4-a22892f09cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:46.384571 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3ebe0-14f4-4115-8de4-a22892f09cf5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:46.430671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1236/2456] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:07:46 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:07:46.436373 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b18749-4969-4823-b7f5-0e157a0aa1dd admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:46.455761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b18749-4969-4823-b7f5-0e157a0aa1dd admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:46.537368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32725b1f-7634-41a0-a752-6bd56a954331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:46.538375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32725b1f-7634-41a0-a752-6bd56a954331 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:46.538712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32725b1f-7634-41a0-a752-6bd56a954331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:46.539180 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32725b1f-7634-41a0-a752-6bd56a954331 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:46.540087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32725b1f-7634-41a0-a752-6bd56a954331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:46.542517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32725b1f-7634-41a0-a752-6bd56a954331 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:46.574775 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1221/2457] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:07:46 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:07:46.576325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3ebe0-14f4-4115-8de4-a22892f09cf5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:46.587761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3ebe0-14f4-4115-8de4-a22892f09cf5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:46.594067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588056a-218e-41d9-bc9a-fc409cd15ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:46.594730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588056a-218e-41d9-bc9a-fc409cd15ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:46.595016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588056a-218e-41d9-bc9a-fc409cd15ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:46.595286 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588056a-218e-41d9-bc9a-fc409cd15ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:46.596262 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588056a-218e-41d9-bc9a-fc409cd15ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:46.597891 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588056a-218e-41d9-bc9a-fc409cd15ee2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:46.613346 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1237/2458] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:07:46.614973 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32725b1f-7634-41a0-a752-6bd56a954331 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:46.628476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32725b1f-7634-41a0-a752-6bd56a954331 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:46.634331 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe20d43-5048-4c58-a7c0-c778838b8a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:46.635163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20d43-5048-4c58-a7c0-c778838b8a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:46.635566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20d43-5048-4c58-a7c0-c778838b8a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:46.635912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20d43-5048-4c58-a7c0-c778838b8a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:46.636655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe20d43-5048-4c58-a7c0-c778838b8a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:46.638543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe20d43-5048-4c58-a7c0-c778838b8a42 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:46.654644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1222/2459] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:07:46.657714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588056a-218e-41d9-bc9a-fc409cd15ee2 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:46.668963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588056a-218e-41d9-bc9a-fc409cd15ee2 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:46.673876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e27a8-d9a0-4653-a224-3eef9a337e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:46.674513 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e27a8-d9a0-4653-a224-3eef9a337e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:46.675075 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e27a8-d9a0-4653-a224-3eef9a337e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:46.675379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e27a8-d9a0-4653-a224-3eef9a337e4c admin admin] PATH_INFO: `/v3/projects/d8c798a788614e518fe2b2078648a469/users/f952c7c73b964fef80984247a6c3228e/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:46.693938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e27a8-d9a0-4653-a224-3eef9a337e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c798a788614e518fe2b2078648a469, user_id=f952c7c73b964fef80984247a6c3228e, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:46.696954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e27a8-d9a0-4653-a224-3eef9a337e4c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:46.717060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1238/2460] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:07:46 2022] PUT /identity/v3/projects/d8c798a788614e518fe2b2078648a469/users/f952c7c73b964fef80984247a6c3228e/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:07:46.728587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdca8b1-0d02-428d-a264-a39906852b3b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:46.729194 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdca8b1-0d02-428d-a264-a39906852b3b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:46.729547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdca8b1-0d02-428d-a264-a39906852b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:46.760834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:46.766351 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4fdca8b1-0d02-428d-a264-a39906852b3b None None] MFA Rules not processed for user `f952c7c73b964fef80984247a6c3228e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:46.768240 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4fdca8b1-0d02-428d-a264-a39906852b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:46.856177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1223/2461] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:07:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:07:46.864469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e27a8-d9a0-4653-a224-3eef9a337e4c admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:46.866528 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-819e27a8-d9a0-4653-a224-3eef9a337e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:46.935671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e27a8-d9a0-4653-a224-3eef9a337e4c admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:46.939582 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea51d4-5039-45f0-ad52-61586c53af09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7c46f4dc084a948bd09ca9b86c2748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:46.940555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea51d4-5039-45f0-ad52-61586c53af09 service glance] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:46.940838 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea51d4-5039-45f0-ad52-61586c53af09 service glance] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:46.941118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea51d4-5039-45f0-ad52-61586c53af09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:46.954666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea51d4-5039-45f0-ad52-61586c53af09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:46.954666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea51d4-5039-45f0-ad52-61586c53af09 service glance] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:46.966768 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1239/2462] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:07:50.938357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdca8b1-0d02-428d-a264-a39906852b3b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:50.939891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4fdca8b1-0d02-428d-a264-a39906852b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:51.051334 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdca8b1-0d02-428d-a264-a39906852b3b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:51.057370 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdd09a-2766-4c99-b0fb-890cf29833e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:51.058095 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdd09a-2766-4c99-b0fb-890cf29833e8 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:51.058487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdd09a-2766-4c99-b0fb-890cf29833e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:51.058875 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdd09a-2766-4c99-b0fb-890cf29833e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:51.060727 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4dcdd09a-2766-4c99-b0fb-890cf29833e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:51.137749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdd09a-2766-4c99-b0fb-890cf29833e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:51.139622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdd09a-2766-4c99-b0fb-890cf29833e8 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:51.151045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1224/2463] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:07:56.958569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=57,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:07:58.544940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea51d4-5039-45f0-ad52-61586c53af09 service glance] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:58.546982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-41ea51d4-5039-45f0-ad52-61586c53af09 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:58.616718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea51d4-5039-45f0-ad52-61586c53af09 service glance] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:58.620752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad3621-43c2-4b59-a267-1ace66491ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:58.621399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad3621-43c2-4b59-a267-1ace66491ffa service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:58.621673 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad3621-43c2-4b59-a267-1ace66491ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:58.621945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad3621-43c2-4b59-a267-1ace66491ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:58.623904 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7aad3621-43c2-4b59-a267-1ace66491ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:58.633769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad3621-43c2-4b59-a267-1ace66491ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:58.635278 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad3621-43c2-4b59-a267-1ace66491ffa service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:58.643472 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1240/2464] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:07:58.782463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7d181-6ba8-4b9e-8d6a-4fb19c3efe80 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:58.783114 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7d181-6ba8-4b9e-8d6a-4fb19c3efe80 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:58.783114 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7d181-6ba8-4b9e-8d6a-4fb19c3efe80 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:58.784545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1225/2465] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 22 16:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:07:58.791091 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e3ac7-ec36-4db1-bdd5-2c7e646019d7 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:58.791581 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e3ac7-ec36-4db1-bdd5-2c7e646019d7 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:58.791923 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e3ac7-ec36-4db1-bdd5-2c7e646019d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:58.816075 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-f87e3ac7-ec36-4db1-bdd5-2c7e646019d7 None None] MFA Rules not processed for user `20e4a18ab77642baa9adb9a4b49fbcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:58.817308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f87e3ac7-ec36-4db1-bdd5-2c7e646019d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:58.827287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1241/2466] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 22 16:07:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:07:58.839488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7d181-6ba8-4b9e-8d6a-4fb19c3efe80 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:58.841226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-aff7d181-6ba8-4b9e-8d6a-4fb19c3efe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:58.855199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7d181-6ba8-4b9e-8d6a-4fb19c3efe80 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:58.858871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925a0f5-b0e3-4f62-88a3-ba5fa4ce8860 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7c46f4dc084a948bd09ca9b86c2748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:58.859480 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925a0f5-b0e3-4f62-88a3-ba5fa4ce8860 service glance] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:58.859756 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925a0f5-b0e3-4f62-88a3-ba5fa4ce8860 service glance] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:58.860024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925a0f5-b0e3-4f62-88a3-ba5fa4ce8860 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:58.870743 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925a0f5-b0e3-4f62-88a3-ba5fa4ce8860 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:58.872184 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925a0f5-b0e3-4f62-88a3-ba5fa4ce8860 service glance] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:58.883234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1226/2467] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:07:58.962266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb5d99-cbe2-4138-bb0e-949695dcb9a5 None None] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:58.962664 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb5d99-cbe2-4138-bb0e-949695dcb9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:58.963073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb5d99-cbe2-4138-bb0e-949695dcb9a5 None None] PATH_INFO: `/` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:58.964784 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1242/2468] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 22 16:07:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:07:58.970290 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7f77e-8806-430b-887e-421f4ea6393a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:58.970663 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7f77e-8806-430b-887e-421f4ea6393a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:58.971022 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7f77e-8806-430b-887e-421f4ea6393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:58.993040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9bd7f77e-8806-430b-887e-421f4ea6393a None None] MFA Rules not processed for user `104abc0b38524a2f95ffe96c5872362c`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:58.994246 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9bd7f77e-8806-430b-887e-421f4ea6393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:59.001152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1227/2469] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 22 16:07:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:07:59.012828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb5d99-cbe2-4138-bb0e-949695dcb9a5 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:59.024418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb5d99-cbe2-4138-bb0e-949695dcb9a5 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:59.028227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b5bf7-950b-40bf-9519-1b57e15c6822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:59.028819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5bf7-950b-40bf-9519-1b57e15c6822 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:59.029090 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5bf7-950b-40bf-9519-1b57e15c6822 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:59.029354 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5bf7-950b-40bf-9519-1b57e15c6822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:59.037412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b5bf7-950b-40bf-9519-1b57e15c6822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:59.038821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b5bf7-950b-40bf-9519-1b57e15c6822 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:59.047568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1243/2470] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:07:59.135401 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363089d-56af-41c3-9bdd-ff636642fb46 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:59.135608 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363089d-56af-41c3-9bdd-ff636642fb46 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:59.135854 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363089d-56af-41c3-9bdd-ff636642fb46 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:59.137256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1228/2471] 10.222.0.77 () {54 vars in 921 bytes} [Mon Aug 22 16:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 16:07:59.143379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137947df-5324-4e85-a0ff-28a708e7fd11 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:59.143712 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137947df-5324-4e85-a0ff-28a708e7fd11 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:59.144029 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137947df-5324-4e85-a0ff-28a708e7fd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:59.167539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-137947df-5324-4e85-a0ff-28a708e7fd11 None None] MFA Rules not processed for user `20e4a18ab77642baa9adb9a4b49fbcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:07:59.168785 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-137947df-5324-4e85-a0ff-28a708e7fd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:59.179380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1244/2472] 10.222.0.77 () {58 vars in 1018 bytes} [Mon Aug 22 16:07:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:07:59.190792 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363089d-56af-41c3-9bdd-ff636642fb46 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:59.203576 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363089d-56af-41c3-9bdd-ff636642fb46 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:59.207542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc35f9e-5d23-4a10-8016-b44188dd633a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:59.208120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc35f9e-5d23-4a10-8016-b44188dd633a service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:59.208410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc35f9e-5d23-4a10-8016-b44188dd633a service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:59.208701 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc35f9e-5d23-4a10-8016-b44188dd633a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:59.219291 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc35f9e-5d23-4a10-8016-b44188dd633a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:59.220759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc35f9e-5d23-4a10-8016-b44188dd633a service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:59.233156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1229/2473] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:07:59.296250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137947df-5324-4e85-a0ff-28a708e7fd11 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:07:59.297978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-137947df-5324-4e85-a0ff-28a708e7fd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:59.370876 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137947df-5324-4e85-a0ff-28a708e7fd11 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:07:59.376295 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2b885-1769-4e71-b644-e27378309268 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be9a664d10d438382b9e359b26ba86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:07:59.376930 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2b885-1769-4e71-b644-e27378309268 service placement] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:07:59.377192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2b885-1769-4e71-b644-e27378309268 service placement] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:07:59.377457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2b885-1769-4e71-b644-e27378309268 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:07:59.379462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-78b2b885-1769-4e71-b644-e27378309268 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:07:59.391725 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2b885-1769-4e71-b644-e27378309268 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:07:59.393540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2b885-1769-4e71-b644-e27378309268 service placement] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:07:59.404644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1245/2474] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:07:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:00.292455 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc35f9e-5d23-4a10-8016-b44188dd633a service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:00.294044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-edc35f9e-5d23-4a10-8016-b44188dd633a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:00.306846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc35f9e-5d23-4a10-8016-b44188dd633a service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:00.311539 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab1edc-cc0a-4d96-a753-f8fb8324cf2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:00.312140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab1edc-cc0a-4d96-a753-f8fb8324cf2d service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:00.312419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab1edc-cc0a-4d96-a753-f8fb8324cf2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:00.312689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab1edc-cc0a-4d96-a753-f8fb8324cf2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:00.314867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1bab1edc-cc0a-4d96-a753-f8fb8324cf2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:00.322709 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:00.325621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab1edc-cc0a-4d96-a753-f8fb8324cf2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:00.327916 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab1edc-cc0a-4d96-a753-f8fb8324cf2d service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:00.336752 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1230/2475] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:01.137720 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefe18d-dc00-4102-b308-6af66611a9a4 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:01.138219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefe18d-dc00-4102-b308-6af66611a9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:01.138333 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefe18d-dc00-4102-b308-6af66611a9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:01.158906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-9eefe18d-dc00-4102-b308-6af66611a9a4 None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:01.160174 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9eefe18d-dc00-4102-b308-6af66611a9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:01.220967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1246/2476] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 16:08:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:01.233541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab1edc-cc0a-4d96-a753-f8fb8324cf2d service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:01.235073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1bab1edc-cc0a-4d96-a753-f8fb8324cf2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:01.308095 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab1edc-cc0a-4d96-a753-f8fb8324cf2d service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:01.313234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523ef65-314b-4749-aa33-ea2375e53c77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:01.313851 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ef65-314b-4749-aa33-ea2375e53c77 service swift] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:01.314127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ef65-314b-4749-aa33-ea2375e53c77 service swift] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:01.314398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523ef65-314b-4749-aa33-ea2375e53c77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:01.323305 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523ef65-314b-4749-aa33-ea2375e53c77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:01.324976 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523ef65-314b-4749-aa33-ea2375e53c77 service swift] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:01.335720 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1231/2477] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:08:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:08:02.852938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefe18d-dc00-4102-b308-6af66611a9a4 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:02.866101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:02.925282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefe18d-dc00-4102-b308-6af66611a9a4 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:02.929927 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f78ff1-1bb1-4ffc-9bd2-1adfd9a563ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:02.930561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78ff1-1bb1-4ffc-9bd2-1adfd9a563ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:02.930866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78ff1-1bb1-4ffc-9bd2-1adfd9a563ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:02.931222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78ff1-1bb1-4ffc-9bd2-1adfd9a563ef admin admin] PATH_INFO: `/v3/users/f952c7c73b964fef80984247a6c3228e` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:02.932412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f78ff1-1bb1-4ffc-9bd2-1adfd9a563ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f952c7c73b964fef80984247a6c3228e)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:02.934399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f78ff1-1bb1-4ffc-9bd2-1adfd9a563ef admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:02.990379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-18f78ff1-1bb1-4ffc-9bd2-1adfd9a563ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f952c7c73b964fef80984247a6c3228e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:03.007593 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-18f78ff1-1bb1-4ffc-9bd2-1adfd9a563ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f952c7c73b964fef80984247a6c3228e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:03.016263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-18f78ff1-1bb1-4ffc-9bd2-1adfd9a563ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f952c7c73b964fef80984247a6c3228e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:03.024042 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-18f78ff1-1bb1-4ffc-9bd2-1adfd9a563ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f952c7c73b964fef80984247a6c3228e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:03.024719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-18f78ff1-1bb1-4ffc-9bd2-1adfd9a563ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f952c7c73b964fef80984247a6c3228e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:03.030955 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1247/2478] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:08:02 2022] DELETE /identity/v3/users/f952c7c73b964fef80984247a6c3228e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:03.035704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d54e9c-27dc-4cd3-907f-5c69608e0291 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:03.036572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d54e9c-27dc-4cd3-907f-5c69608e0291 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:03.036911 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d54e9c-27dc-4cd3-907f-5c69608e0291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:03.061033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-88d54e9c-27dc-4cd3-907f-5c69608e0291 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:03.062893 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-88d54e9c-27dc-4cd3-907f-5c69608e0291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:03.123882 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1232/2479] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:03.135193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f78ff1-1bb1-4ffc-9bd2-1adfd9a563ef admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:03.136626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-18f78ff1-1bb1-4ffc-9bd2-1adfd9a563ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:03.204175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f78ff1-1bb1-4ffc-9bd2-1adfd9a563ef admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:03.208487 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb53acd-5163-45b8-8700-6abbcfdf8da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:03.209199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb53acd-5163-45b8-8700-6abbcfdf8da7 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:03.209601 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb53acd-5163-45b8-8700-6abbcfdf8da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:03.210110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb53acd-5163-45b8-8700-6abbcfdf8da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:03.220931 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb53acd-5163-45b8-8700-6abbcfdf8da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:03.222382 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb53acd-5163-45b8-8700-6abbcfdf8da7 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:03.233126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1248/2480] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:03.547660 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d54e9c-27dc-4cd3-907f-5c69608e0291 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:03.549661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-88d54e9c-27dc-4cd3-907f-5c69608e0291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:03.566521 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d54e9c-27dc-4cd3-907f-5c69608e0291 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:03.573668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:03.574447 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:03.574829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:03.575197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c admin admin] PATH_INFO: `/v3/projects/d8c798a788614e518fe2b2078648a469` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:03.577029 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c798a788614e518fe2b2078648a469)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:03.579089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:03.638713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c798a788614e518fe2b2078648a469', 'request_id': 'req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:03.645863 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c798a788614e518fe2b2078648a469', 'request_id': 'req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:03.663127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c798a788614e518fe2b2078648a469', 'request_id': 'req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:03.689509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c admin admin] The token cache is being invalidate because project d8c798a788614e518fe2b2078648a469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:08:03.690196 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:03.691798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f2a6a447-b6a1-4bdf-924b-c26138e9f29c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:03.694980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1233/2481] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:08:03 2022] DELETE /identity/v3/projects/d8c798a788614e518fe2b2078648a469 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:03.699068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579bc90-a73b-4458-b49b-f55f82b64482 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:03.699741 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579bc90-a73b-4458-b49b-f55f82b64482 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:03.700200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579bc90-a73b-4458-b49b-f55f82b64482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:03.728589 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c579bc90-a73b-4458-b49b-f55f82b64482 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:03.730086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c579bc90-a73b-4458-b49b-f55f82b64482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:03.796819 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:03.831068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1249/2482] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:03.840296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79db21e-9840-4961-b37b-4a06efa78889 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:03.840695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79db21e-9840-4961-b37b-4a06efa78889 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:03.840992 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79db21e-9840-4961-b37b-4a06efa78889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:03.863505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:03.874215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d79db21e-9840-4961-b37b-4a06efa78889 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:03.876516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d79db21e-9840-4961-b37b-4a06efa78889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:03.885212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1234/2483] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:03.889789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579bc90-a73b-4458-b49b-f55f82b64482 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:03.899880 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579bc90-a73b-4458-b49b-f55f82b64482 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:03.904764 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005eb14a-f0f9-446e-b490-acd33a590f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:03.905384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005eb14a-f0f9-446e-b490-acd33a590f18 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:03.905714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005eb14a-f0f9-446e-b490-acd33a590f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:03.905937 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005eb14a-f0f9-446e-b490-acd33a590f18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:03.906631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005eb14a-f0f9-446e-b490-acd33a590f18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:08:03.906931 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005eb14a-f0f9-446e-b490-acd33a590f18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:03.908556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005eb14a-f0f9-446e-b490-acd33a590f18 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:03.923245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1250/2484] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:08:03.928575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79db21e-9840-4961-b37b-4a06efa78889 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:03.939581 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79db21e-9840-4961-b37b-4a06efa78889 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:03.945194 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af28681-954c-45cc-8f76-d9b9dcdb96b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:03.945828 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28681-954c-45cc-8f76-d9b9dcdb96b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:03.946108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28681-954c-45cc-8f76-d9b9dcdb96b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:03.946382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28681-954c-45cc-8f76-d9b9dcdb96b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:03.947071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af28681-954c-45cc-8f76-d9b9dcdb96b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:03.949173 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af28681-954c-45cc-8f76-d9b9dcdb96b6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:03.985819 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1235/2485] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:08:03 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:03.986168 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005eb14a-f0f9-446e-b490-acd33a590f18 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:03.996588 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005eb14a-f0f9-446e-b490-acd33a590f18 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:04.061320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f6cf1-3ade-4109-af94-8be7ff8a928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:04.062030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f6cf1-3ade-4109-af94-8be7ff8a928b admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:04.062366 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f6cf1-3ade-4109-af94-8be7ff8a928b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:04.062809 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f6cf1-3ade-4109-af94-8be7ff8a928b admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:04.063511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f6cf1-3ade-4109-af94-8be7ff8a928b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:04.065571 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f6cf1-3ade-4109-af94-8be7ff8a928b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:04.094455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1251/2486] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:08:03 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:04.096008 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af28681-954c-45cc-8f76-d9b9dcdb96b6 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:04.108505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af28681-954c-45cc-8f76-d9b9dcdb96b6 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:04.113132 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14381f5d-c3d4-42ee-bfc3-73f06badde85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:04.113772 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14381f5d-c3d4-42ee-bfc3-73f06badde85 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:04.114014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14381f5d-c3d4-42ee-bfc3-73f06badde85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:04.114282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14381f5d-c3d4-42ee-bfc3-73f06badde85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:04.114981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14381f5d-c3d4-42ee-bfc3-73f06badde85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:04.116574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14381f5d-c3d4-42ee-bfc3-73f06badde85 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:04.126890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1236/2487] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:04.130891 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f6cf1-3ade-4109-af94-8be7ff8a928b admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:04.141572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f6cf1-3ade-4109-af94-8be7ff8a928b admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:04.146315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4d8e1-d20f-4149-ad74-e63335d7d992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:04.146967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4d8e1-d20f-4149-ad74-e63335d7d992 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:04.147244 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4d8e1-d20f-4149-ad74-e63335d7d992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:04.147518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4d8e1-d20f-4149-ad74-e63335d7d992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:04.148174 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4d8e1-d20f-4149-ad74-e63335d7d992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:04.149798 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4d8e1-d20f-4149-ad74-e63335d7d992 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:04.166010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1252/2488] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:04.168081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14381f5d-c3d4-42ee-bfc3-73f06badde85 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:04.179137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14381f5d-c3d4-42ee-bfc3-73f06badde85 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:04.183994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489d85d-1906-479b-ab14-17039a2ba6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:04.184656 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489d85d-1906-479b-ab14-17039a2ba6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:04.184933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489d85d-1906-479b-ab14-17039a2ba6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:04.185204 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489d85d-1906-479b-ab14-17039a2ba6b5 admin admin] PATH_INFO: `/v3/projects/fff8740f9a504dc98c38329e331fa7bb/users/e858cd16395f42afa1e10d8da4ff449b/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:04.200668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489d85d-1906-479b-ab14-17039a2ba6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff8740f9a504dc98c38329e331fa7bb, user_id=e858cd16395f42afa1e10d8da4ff449b, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:04.203870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489d85d-1906-479b-ab14-17039a2ba6b5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:04.222266 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1237/2489] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:04 2022] PUT /identity/v3/projects/fff8740f9a504dc98c38329e331fa7bb/users/e858cd16395f42afa1e10d8da4ff449b/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:04.232351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced200f-88c9-47d8-9ef3-542c5c12ff88 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:04.232620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced200f-88c9-47d8-9ef3-542c5c12ff88 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:04.232905 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced200f-88c9-47d8-9ef3-542c5c12ff88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:04.262323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-aced200f-88c9-47d8-9ef3-542c5c12ff88 None None] MFA Rules not processed for user `e858cd16395f42afa1e10d8da4ff449b`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:04.263596 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-aced200f-88c9-47d8-9ef3-542c5c12ff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:04.343804 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1253/2490] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:04.348422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489d85d-1906-479b-ab14-17039a2ba6b5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:04.429444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489d85d-1906-479b-ab14-17039a2ba6b5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:04.436359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f6fbf-3e6c-40f9-907e-922ac4b9440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:04.437545 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6fbf-3e6c-40f9-907e-922ac4b9440f admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:04.438092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6fbf-3e6c-40f9-907e-922ac4b9440f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:04.438574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6fbf-3e6c-40f9-907e-922ac4b9440f admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:04.439474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f6fbf-3e6c-40f9-907e-922ac4b9440f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:04.441445 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f6fbf-3e6c-40f9-907e-922ac4b9440f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:04.479487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1238/2491] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:08:04 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:04.481220 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced200f-88c9-47d8-9ef3-542c5c12ff88 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:04.492753 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced200f-88c9-47d8-9ef3-542c5c12ff88 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:04.532775 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:04.567099 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81057b65-8ad0-472e-b50e-32fa4b8c71c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:04.567716 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057b65-8ad0-472e-b50e-32fa4b8c71c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:04.568030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057b65-8ad0-472e-b50e-32fa4b8c71c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:04.568270 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057b65-8ad0-472e-b50e-32fa4b8c71c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:04.568918 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81057b65-8ad0-472e-b50e-32fa4b8c71c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:04.570890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81057b65-8ad0-472e-b50e-32fa4b8c71c2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:04.595758 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1254/2492] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:08:04 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:08:04.599952 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f6fbf-3e6c-40f9-907e-922ac4b9440f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:04.612035 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f6fbf-3e6c-40f9-907e-922ac4b9440f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:04.618105 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a30cea-a417-49e9-905b-be38f3615243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:04.619317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a30cea-a417-49e9-905b-be38f3615243 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:04.620065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a30cea-a417-49e9-905b-be38f3615243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:04.620391 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a30cea-a417-49e9-905b-be38f3615243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:04.621130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a30cea-a417-49e9-905b-be38f3615243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:04.622863 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a30cea-a417-49e9-905b-be38f3615243 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:04.635050 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1239/2493] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:08:04.639541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81057b65-8ad0-472e-b50e-32fa4b8c71c2 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:04.650239 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81057b65-8ad0-472e-b50e-32fa4b8c71c2 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:04.655462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1c8ea-87ed-4912-bd8b-20909d129027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:04.656124 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1c8ea-87ed-4912-bd8b-20909d129027 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:04.656400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1c8ea-87ed-4912-bd8b-20909d129027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:04.656672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1c8ea-87ed-4912-bd8b-20909d129027 admin admin] PATH_INFO: `/v3/projects/aa8d8c0312e54c628b58d079b4a56415/users/be654b6d6ddd4c47bcbfa690be0dc53a/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:04.675045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1c8ea-87ed-4912-bd8b-20909d129027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8d8c0312e54c628b58d079b4a56415, user_id=be654b6d6ddd4c47bcbfa690be0dc53a, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:04.677872 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1c8ea-87ed-4912-bd8b-20909d129027 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:04.694701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1255/2494] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:04 2022] PUT /identity/v3/projects/aa8d8c0312e54c628b58d079b4a56415/users/be654b6d6ddd4c47bcbfa690be0dc53a/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:04.698845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a30cea-a417-49e9-905b-be38f3615243 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:04.711496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a30cea-a417-49e9-905b-be38f3615243 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:04.787549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787d66e-313d-4403-9d1f-c3b24d3e1c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:04.788183 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787d66e-313d-4403-9d1f-c3b24d3e1c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:04.788460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787d66e-313d-4403-9d1f-c3b24d3e1c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:04.788732 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787d66e-313d-4403-9d1f-c3b24d3e1c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:04.789387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787d66e-313d-4403-9d1f-c3b24d3e1c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:04.791276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787d66e-313d-4403-9d1f-c3b24d3e1c61 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:04.802329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1240/2495] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:08:04.806730 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1c8ea-87ed-4912-bd8b-20909d129027 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:04.817657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1c8ea-87ed-4912-bd8b-20909d129027 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:04.822492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad57022-b03e-4b00-b316-af9ba0fefcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:04.823180 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad57022-b03e-4b00-b316-af9ba0fefcd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:04.823485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad57022-b03e-4b00-b316-af9ba0fefcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:04.823777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad57022-b03e-4b00-b316-af9ba0fefcd9 admin admin] PATH_INFO: `/v3/projects/aa8d8c0312e54c628b58d079b4a56415/users/be654b6d6ddd4c47bcbfa690be0dc53a/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:04.825721 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad57022-b03e-4b00-b316-af9ba0fefcd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8d8c0312e54c628b58d079b4a56415, user_id=be654b6d6ddd4c47bcbfa690be0dc53a, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:04.828748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad57022-b03e-4b00-b316-af9ba0fefcd9 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:04.843860 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1256/2496] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:04 2022] PUT /identity/v3/projects/aa8d8c0312e54c628b58d079b4a56415/users/be654b6d6ddd4c47bcbfa690be0dc53a/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:08:04.856305 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866edd2a-0e95-4bb3-85ba-6d6e896f72af None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:04.856631 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866edd2a-0e95-4bb3-85ba-6d6e896f72af None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:04.856866 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866edd2a-0e95-4bb3-85ba-6d6e896f72af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:04.890408 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:04.896740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-866edd2a-0e95-4bb3-85ba-6d6e896f72af None None] MFA Rules not processed for user `be654b6d6ddd4c47bcbfa690be0dc53a`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:04.898646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-866edd2a-0e95-4bb3-85ba-6d6e896f72af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:05.013908 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1241/2497] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:05.026206 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad57022-b03e-4b00-b316-af9ba0fefcd9 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:05.028184 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-fad57022-b03e-4b00-b316-af9ba0fefcd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:05.094521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad57022-b03e-4b00-b316-af9ba0fefcd9 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:05.098189 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6151be1-dbb2-46f4-b90c-6a27613d9ede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:05.098840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151be1-dbb2-46f4-b90c-6a27613d9ede service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:05.099104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151be1-dbb2-46f4-b90c-6a27613d9ede service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:05.099372 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151be1-dbb2-46f4-b90c-6a27613d9ede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:05.158423 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6151be1-dbb2-46f4-b90c-6a27613d9ede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:05.159921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6151be1-dbb2-46f4-b90c-6a27613d9ede service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:05.170936 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1257/2498] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:07.773517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866edd2a-0e95-4bb3-85ba-6d6e896f72af None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:07.847971 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866edd2a-0e95-4bb3-85ba-6d6e896f72af None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:07.852738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df6884-6710-4e04-87e0-912a86083a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:07.853380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df6884-6710-4e04-87e0-912a86083a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:07.853657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df6884-6710-4e04-87e0-912a86083a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:07.853935 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df6884-6710-4e04-87e0-912a86083a4e admin admin] PATH_INFO: `/v3/users/e858cd16395f42afa1e10d8da4ff449b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:07.855262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df6884-6710-4e04-87e0-912a86083a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e858cd16395f42afa1e10d8da4ff449b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:07.857238 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df6884-6710-4e04-87e0-912a86083a4e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:07.913118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-14df6884-6710-4e04-87e0-912a86083a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e858cd16395f42afa1e10d8da4ff449b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:07.913934 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-14df6884-6710-4e04-87e0-912a86083a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e858cd16395f42afa1e10d8da4ff449b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:07.914622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-14df6884-6710-4e04-87e0-912a86083a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e858cd16395f42afa1e10d8da4ff449b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:07.923930 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-14df6884-6710-4e04-87e0-912a86083a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e858cd16395f42afa1e10d8da4ff449b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:07.942483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-14df6884-6710-4e04-87e0-912a86083a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e858cd16395f42afa1e10d8da4ff449b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:07.966212 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1242/2499] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:08:07 2022] DELETE /identity/v3/users/e858cd16395f42afa1e10d8da4ff449b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:07.970879 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e274f12-d8c7-40bb-97ed-ee6111486f15 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:07.971654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e274f12-d8c7-40bb-97ed-ee6111486f15 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:07.971654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e274f12-d8c7-40bb-97ed-ee6111486f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:07.993200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-3e274f12-d8c7-40bb-97ed-ee6111486f15 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:07.994769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3e274f12-d8c7-40bb-97ed-ee6111486f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:08.027078 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:08.060416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1258/2500] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:08:08.085413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df6884-6710-4e04-87e0-912a86083a4e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:08.087424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-14df6884-6710-4e04-87e0-912a86083a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:08.112298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:08.161000 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df6884-6710-4e04-87e0-912a86083a4e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:08.166649 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8208a5-8fcf-46f5-8924-dd32ad33745e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:08.167909 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8208a5-8fcf-46f5-8924-dd32ad33745e service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:08.168364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8208a5-8fcf-46f5-8924-dd32ad33745e service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:08.168781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8208a5-8fcf-46f5-8924-dd32ad33745e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:08.181561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8208a5-8fcf-46f5-8924-dd32ad33745e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:08.183298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8208a5-8fcf-46f5-8924-dd32ad33745e service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:08.193627 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1243/2501] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:08.560701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e274f12-d8c7-40bb-97ed-ee6111486f15 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:08.562481 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3e274f12-d8c7-40bb-97ed-ee6111486f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:08.590611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e274f12-d8c7-40bb-97ed-ee6111486f15 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:08.608912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:08.609670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:08.610018 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:08.610355 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] PATH_INFO: `/v3/projects/fff8740f9a504dc98c38329e331fa7bb` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:08.611692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff8740f9a504dc98c38329e331fa7bb)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:08.613792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:08.680230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff8740f9a504dc98c38329e331fa7bb', 'request_id': 'req-fe25b2e5-8d04-4410-bffa-10be4301727e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:08.688875 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff8740f9a504dc98c38329e331fa7bb', 'request_id': 'req-fe25b2e5-8d04-4410-bffa-10be4301727e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:08.695495 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff8740f9a504dc98c38329e331fa7bb', 'request_id': 'req-fe25b2e5-8d04-4410-bffa-10be4301727e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:08.706008 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] The token cache is being invalidate because project fff8740f9a504dc98c38329e331fa7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:08:08.706295 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:08.706956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:08.708485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1259/2502] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:08:08 2022] DELETE /identity/v3/projects/fff8740f9a504dc98c38329e331fa7bb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:08:08.712773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8208a5-8fcf-46f5-8924-dd32ad33745e service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:08.723255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8208a5-8fcf-46f5-8924-dd32ad33745e service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:08.786919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d08c7-3aee-4708-97b7-dcf0529696f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:08.788065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d08c7-3aee-4708-97b7-dcf0529696f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:08.788065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d08c7-3aee-4708-97b7-dcf0529696f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:08.788470 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d08c7-3aee-4708-97b7-dcf0529696f9 admin admin] PATH_INFO: `/v3/users/be654b6d6ddd4c47bcbfa690be0dc53a` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:08.789449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d08c7-3aee-4708-97b7-dcf0529696f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be654b6d6ddd4c47bcbfa690be0dc53a)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:08.791565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d08c7-3aee-4708-97b7-dcf0529696f9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:08.850396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-366d08c7-3aee-4708-97b7-dcf0529696f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be654b6d6ddd4c47bcbfa690be0dc53a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:08.850989 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-366d08c7-3aee-4708-97b7-dcf0529696f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be654b6d6ddd4c47bcbfa690be0dc53a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:08.851667 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-366d08c7-3aee-4708-97b7-dcf0529696f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be654b6d6ddd4c47bcbfa690be0dc53a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:08.858685 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-366d08c7-3aee-4708-97b7-dcf0529696f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be654b6d6ddd4c47bcbfa690be0dc53a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:08.877759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-366d08c7-3aee-4708-97b7-dcf0529696f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be654b6d6ddd4c47bcbfa690be0dc53a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:08.897960 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1244/2503] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:08:08 2022] DELETE /identity/v3/users/be654b6d6ddd4c47bcbfa690be0dc53a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:08:09.203670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:09.205136 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:09.230462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25b2e5-8d04-4410-bffa-10be4301727e admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:09.299921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c202f7d-941a-4e25-8b86-6c51c0fb2354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:09.300569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c202f7d-941a-4e25-8b86-6c51c0fb2354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:09.300847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c202f7d-941a-4e25-8b86-6c51c0fb2354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:09.301120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c202f7d-941a-4e25-8b86-6c51c0fb2354 admin admin] PATH_INFO: `/v3/projects/aa8d8c0312e54c628b58d079b4a56415` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:09.302261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c202f7d-941a-4e25-8b86-6c51c0fb2354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8d8c0312e54c628b58d079b4a56415)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:09.304238 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c202f7d-941a-4e25-8b86-6c51c0fb2354 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:09.359960 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-9c202f7d-941a-4e25-8b86-6c51c0fb2354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8d8c0312e54c628b58d079b4a56415', 'request_id': 'req-9c202f7d-941a-4e25-8b86-6c51c0fb2354'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:09.369666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-9c202f7d-941a-4e25-8b86-6c51c0fb2354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8d8c0312e54c628b58d079b4a56415', 'request_id': 'req-9c202f7d-941a-4e25-8b86-6c51c0fb2354'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:09.378868 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-9c202f7d-941a-4e25-8b86-6c51c0fb2354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8d8c0312e54c628b58d079b4a56415', 'request_id': 'req-9c202f7d-941a-4e25-8b86-6c51c0fb2354'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:09.380586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:09.402504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-9c202f7d-941a-4e25-8b86-6c51c0fb2354 admin admin] The token cache is being invalidate because project aa8d8c0312e54c628b58d079b4a56415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:08:09.402854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-9c202f7d-941a-4e25-8b86-6c51c0fb2354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:09.403539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-9c202f7d-941a-4e25-8b86-6c51c0fb2354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:09.405204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1260/2504] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:08:09 2022] DELETE /identity/v3/projects/aa8d8c0312e54c628b58d079b4a56415 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:09.410377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77862707-201b-48d1-ba2a-1a3d6316adad None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:09.410702 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77862707-201b-48d1-ba2a-1a3d6316adad None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:09.410985 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77862707-201b-48d1-ba2a-1a3d6316adad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:09.434715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-77862707-201b-48d1-ba2a-1a3d6316adad None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:09.436138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-77862707-201b-48d1-ba2a-1a3d6316adad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:09.475657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:09.510361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1245/2505] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:09.519008 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6906af-0dd9-41e3-88a4-e0a4491b543c None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:09.519333 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6906af-0dd9-41e3-88a4-e0a4491b543c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:09.519566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6906af-0dd9-41e3-88a4-e0a4491b543c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:09.540568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-9c6906af-0dd9-41e3-88a4-e0a4491b543c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:09.541810 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9c6906af-0dd9-41e3-88a4-e0a4491b543c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:09.550206 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1261/2506] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:09.554607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77862707-201b-48d1-ba2a-1a3d6316adad None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:09.564704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77862707-201b-48d1-ba2a-1a3d6316adad None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:09.569424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d4a12-5b0a-42e8-9cfc-bf2ce0bdd7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:09.570025 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d4a12-5b0a-42e8-9cfc-bf2ce0bdd7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:09.570307 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d4a12-5b0a-42e8-9cfc-bf2ce0bdd7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:09.570580 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d4a12-5b0a-42e8-9cfc-bf2ce0bdd7c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:09.571278 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d4a12-5b0a-42e8-9cfc-bf2ce0bdd7c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:08:09.571582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d4a12-5b0a-42e8-9cfc-bf2ce0bdd7c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:09.573210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d4a12-5b0a-42e8-9cfc-bf2ce0bdd7c5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:09.585220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1246/2507] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:08:09.589547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6906af-0dd9-41e3-88a4-e0a4491b543c None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:09.599072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6906af-0dd9-41e3-88a4-e0a4491b543c None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:09.607772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb745a09-9cc7-4d2b-a5d9-cb57a130b72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:09.608411 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb745a09-9cc7-4d2b-a5d9-cb57a130b72c admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:09.608698 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb745a09-9cc7-4d2b-a5d9-cb57a130b72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:09.608974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb745a09-9cc7-4d2b-a5d9-cb57a130b72c admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:09.609636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb745a09-9cc7-4d2b-a5d9-cb57a130b72c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:09.611638 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb745a09-9cc7-4d2b-a5d9-cb57a130b72c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:09.649547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1262/2508] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:08:09 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:08:09.655353 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d4a12-5b0a-42e8-9cfc-bf2ce0bdd7c5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:09.672691 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d4a12-5b0a-42e8-9cfc-bf2ce0bdd7c5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:09.792365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d911fa-d3a9-4dc1-a47c-df49e01cca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:09.793408 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d911fa-d3a9-4dc1-a47c-df49e01cca65 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:09.793829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d911fa-d3a9-4dc1-a47c-df49e01cca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:09.794294 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d911fa-d3a9-4dc1-a47c-df49e01cca65 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:09.795405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d911fa-d3a9-4dc1-a47c-df49e01cca65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:09.799075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d911fa-d3a9-4dc1-a47c-df49e01cca65 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:09.842418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1247/2509] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:08:09 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:09.843883 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb745a09-9cc7-4d2b-a5d9-cb57a130b72c admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:09.863062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb745a09-9cc7-4d2b-a5d9-cb57a130b72c admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:09.868880 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0388e1-d5b3-4bdd-b3f0-4f7e2fa566cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:09.869613 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0388e1-d5b3-4bdd-b3f0-4f7e2fa566cc admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:09.869954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0388e1-d5b3-4bdd-b3f0-4f7e2fa566cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:09.870219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0388e1-d5b3-4bdd-b3f0-4f7e2fa566cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:09.870987 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0388e1-d5b3-4bdd-b3f0-4f7e2fa566cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:09.872743 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0388e1-d5b3-4bdd-b3f0-4f7e2fa566cc admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:09.888675 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1263/2510] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:09.890254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d911fa-d3a9-4dc1-a47c-df49e01cca65 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:09.901588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d911fa-d3a9-4dc1-a47c-df49e01cca65 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:09.907746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2f828-8891-4a35-bebd-20c7070b7c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:09.908371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2f828-8891-4a35-bebd-20c7070b7c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:09.908652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2f828-8891-4a35-bebd-20c7070b7c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:09.909037 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2f828-8891-4a35-bebd-20c7070b7c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:09.909699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2f828-8891-4a35-bebd-20c7070b7c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:09.911562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2f828-8891-4a35-bebd-20c7070b7c94 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:09.924069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1248/2511] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:09.928575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0388e1-d5b3-4bdd-b3f0-4f7e2fa566cc admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:09.939313 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0388e1-d5b3-4bdd-b3f0-4f7e2fa566cc admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:09.944835 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775cac3-c840-40f0-90ba-e3910daa4243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:09.945568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775cac3-c840-40f0-90ba-e3910daa4243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:09.945777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775cac3-c840-40f0-90ba-e3910daa4243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:09.946098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775cac3-c840-40f0-90ba-e3910daa4243 admin admin] PATH_INFO: `/v3/projects/8bc710544c0e42a98ae457ecb5cf6fc5/users/7839b0ecd8684325b229eee51de011b2/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:09.964885 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775cac3-c840-40f0-90ba-e3910daa4243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc710544c0e42a98ae457ecb5cf6fc5, user_id=7839b0ecd8684325b229eee51de011b2, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:09.967183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775cac3-c840-40f0-90ba-e3910daa4243 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:09.983201 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1264/2512] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:09 2022] PUT /identity/v3/projects/8bc710544c0e42a98ae457ecb5cf6fc5/users/7839b0ecd8684325b229eee51de011b2/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:09.993856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449145c-4a49-44ac-a016-c878b6684316 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:09.994151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449145c-4a49-44ac-a016-c878b6684316 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:09.994427 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449145c-4a49-44ac-a016-c878b6684316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:10.021898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5449145c-4a49-44ac-a016-c878b6684316 None None] MFA Rules not processed for user `7839b0ecd8684325b229eee51de011b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:10.023170 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5449145c-4a49-44ac-a016-c878b6684316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:10.103185 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1249/2513] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:10.116377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775cac3-c840-40f0-90ba-e3910daa4243 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:10.118276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-b775cac3-c840-40f0-90ba-e3910daa4243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:10.183267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775cac3-c840-40f0-90ba-e3910daa4243 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:10.187203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a00d8-d852-420b-80a2-294d5339145a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:10.187812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a00d8-d852-420b-80a2-294d5339145a service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:10.188086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a00d8-d852-420b-80a2-294d5339145a service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:10.188349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a00d8-d852-420b-80a2-294d5339145a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:10.197023 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a00d8-d852-420b-80a2-294d5339145a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:10.198460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a00d8-d852-420b-80a2-294d5339145a service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:10.208316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1265/2514] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:13.302931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449145c-4a49-44ac-a016-c878b6684316 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:13.348010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:13.373552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449145c-4a49-44ac-a016-c878b6684316 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:13.378471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5bf18-0e04-4418-b460-ef030ccc1a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:13.379081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5bf18-0e04-4418-b460-ef030ccc1a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:13.379360 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5bf18-0e04-4418-b460-ef030ccc1a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:13.379632 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5bf18-0e04-4418-b460-ef030ccc1a35 admin admin] PATH_INFO: `/v3/users/7839b0ecd8684325b229eee51de011b2` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:13.380774 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5bf18-0e04-4418-b460-ef030ccc1a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7839b0ecd8684325b229eee51de011b2)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:13.382854 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5bf18-0e04-4418-b460-ef030ccc1a35 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:13.431858 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-eae5bf18-0e04-4418-b460-ef030ccc1a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7839b0ecd8684325b229eee51de011b2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:13.432602 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-eae5bf18-0e04-4418-b460-ef030ccc1a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7839b0ecd8684325b229eee51de011b2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:13.433336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-eae5bf18-0e04-4418-b460-ef030ccc1a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7839b0ecd8684325b229eee51de011b2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:13.440860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-eae5bf18-0e04-4418-b460-ef030ccc1a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7839b0ecd8684325b229eee51de011b2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:13.450943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-eae5bf18-0e04-4418-b460-ef030ccc1a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7839b0ecd8684325b229eee51de011b2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:13.477708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1250/2515] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:08:13 2022] DELETE /identity/v3/users/7839b0ecd8684325b229eee51de011b2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:13.482287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa57d17-8299-4c27-9485-e39623fe2433 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:13.483090 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa57d17-8299-4c27-9485-e39623fe2433 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:13.483090 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa57d17-8299-4c27-9485-e39623fe2433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:13.502651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-cfa57d17-8299-4c27-9485-e39623fe2433 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:13.503928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-cfa57d17-8299-4c27-9485-e39623fe2433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:13.569344 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1266/2516] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:13.581040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5bf18-0e04-4418-b460-ef030ccc1a35 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:13.582998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-eae5bf18-0e04-4418-b460-ef030ccc1a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:13.643215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5bf18-0e04-4418-b460-ef030ccc1a35 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:13.647219 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999eee6-1eae-4be1-bbc4-3d81d89d2a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:13.647823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999eee6-1eae-4be1-bbc4-3d81d89d2a53 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:13.648102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999eee6-1eae-4be1-bbc4-3d81d89d2a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:13.648382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999eee6-1eae-4be1-bbc4-3d81d89d2a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:13.658231 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999eee6-1eae-4be1-bbc4-3d81d89d2a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:13.659705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999eee6-1eae-4be1-bbc4-3d81d89d2a53 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:13.669343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1251/2517] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:13.956203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa57d17-8299-4c27-9485-e39623fe2433 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:13.957690 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-cfa57d17-8299-4c27-9485-e39623fe2433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:13.969980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa57d17-8299-4c27-9485-e39623fe2433 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:13.977146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:13.978245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:13.978813 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:13.979675 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7 admin admin] PATH_INFO: `/v3/projects/8bc710544c0e42a98ae457ecb5cf6fc5` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:13.981331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc710544c0e42a98ae457ecb5cf6fc5)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:13.985233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:14.015503 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:14.041131 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc710544c0e42a98ae457ecb5cf6fc5', 'request_id': 'req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:14.050055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc710544c0e42a98ae457ecb5cf6fc5', 'request_id': 'req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:14.057194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc710544c0e42a98ae457ecb5cf6fc5', 'request_id': 'req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:14.067867 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7 admin admin] The token cache is being invalidate because project 8bc710544c0e42a98ae457ecb5cf6fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:08:14.068156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:14.068796 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c669b7c5-d8a2-49cf-8660-5c73bf2b28a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:14.070293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1267/2518] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:08:13 2022] DELETE /identity/v3/projects/8bc710544c0e42a98ae457ecb5cf6fc5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:14.075425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992bca-8267-4947-a7e6-ce74c0dc9ba5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:14.075710 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992bca-8267-4947-a7e6-ce74c0dc9ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:14.075986 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992bca-8267-4947-a7e6-ce74c0dc9ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:14.097416 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b9992bca-8267-4947-a7e6-ce74c0dc9ba5 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:14.099174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b9992bca-8267-4947-a7e6-ce74c0dc9ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:14.162927 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:14.174174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1252/2519] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:14.183185 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8ede7-00a7-4c2f-9fb5-051eb38f03cd None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:14.183452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8ede7-00a7-4c2f-9fb5-051eb38f03cd None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:14.183727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8ede7-00a7-4c2f-9fb5-051eb38f03cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:14.204635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-8ea8ede7-00a7-4c2f-9fb5-051eb38f03cd None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:14.205786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8ea8ede7-00a7-4c2f-9fb5-051eb38f03cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:14.214330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1268/2520] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:14.218786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9992bca-8267-4947-a7e6-ce74c0dc9ba5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:14.228752 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9992bca-8267-4947-a7e6-ce74c0dc9ba5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:14.233948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe53ad-9ac8-47b9-a251-3f6101c34584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:14.234551 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe53ad-9ac8-47b9-a251-3f6101c34584 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:14.234859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe53ad-9ac8-47b9-a251-3f6101c34584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:14.235199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe53ad-9ac8-47b9-a251-3f6101c34584 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:14.235851 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe53ad-9ac8-47b9-a251-3f6101c34584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:08:14.236148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe53ad-9ac8-47b9-a251-3f6101c34584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:14.237758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe53ad-9ac8-47b9-a251-3f6101c34584 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:14.249755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1253/2521] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:08:14.254227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8ede7-00a7-4c2f-9fb5-051eb38f03cd None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:14.264199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8ede7-00a7-4c2f-9fb5-051eb38f03cd None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:14.269820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cab2d0-c226-4708-9333-9205f3ab2683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:14.270419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cab2d0-c226-4708-9333-9205f3ab2683 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:14.270740 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cab2d0-c226-4708-9333-9205f3ab2683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:14.271015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cab2d0-c226-4708-9333-9205f3ab2683 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:14.271644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cab2d0-c226-4708-9333-9205f3ab2683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:14.273583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cab2d0-c226-4708-9333-9205f3ab2683 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:14.304916 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1269/2522] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:08:14 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:14.309123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe53ad-9ac8-47b9-a251-3f6101c34584 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:14.319597 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe53ad-9ac8-47b9-a251-3f6101c34584 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:14.382977 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d0143-e136-433d-a550-5b99276a7d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:14.384670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d0143-e136-433d-a550-5b99276a7d63 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:14.384670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d0143-e136-433d-a550-5b99276a7d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:14.385292 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d0143-e136-433d-a550-5b99276a7d63 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:14.386250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d0143-e136-433d-a550-5b99276a7d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:14.389037 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d0143-e136-433d-a550-5b99276a7d63 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:14.398975 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cab2d0-c226-4708-9333-9205f3ab2683 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:14.401241 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a9cab2d0-c226-4708-9333-9205f3ab2683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:14.415959 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1254/2523] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:08:14 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:08:14.419365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d0143-e136-433d-a550-5b99276a7d63 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:14.430157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d0143-e136-433d-a550-5b99276a7d63 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:14.435817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11b675-cb3a-4ab0-93d6-d64dabb9c69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:14.436543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11b675-cb3a-4ab0-93d6-d64dabb9c69e admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:14.436896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11b675-cb3a-4ab0-93d6-d64dabb9c69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:14.437389 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11b675-cb3a-4ab0-93d6-d64dabb9c69e admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:14.438186 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11b675-cb3a-4ab0-93d6-d64dabb9c69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:14.440029 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11b675-cb3a-4ab0-93d6-d64dabb9c69e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:14.453138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1255/2524] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:14.457878 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11b675-cb3a-4ab0-93d6-d64dabb9c69e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:14.469536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11b675-cb3a-4ab0-93d6-d64dabb9c69e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:14.484830 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae7506-ac1a-45cd-b7df-4b785378c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:14.487170 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae7506-ac1a-45cd-b7df-4b785378c83f admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:14.487568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae7506-ac1a-45cd-b7df-4b785378c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:14.487909 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae7506-ac1a-45cd-b7df-4b785378c83f admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:14.488631 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae7506-ac1a-45cd-b7df-4b785378c83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:14.490506 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae7506-ac1a-45cd-b7df-4b785378c83f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:14.499769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cab2d0-c226-4708-9333-9205f3ab2683 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:14.504465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1256/2525] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:08:14.508481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae7506-ac1a-45cd-b7df-4b785378c83f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:14.538823 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37b4d9-25be-4e1a-9b51-8688228f23dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:14.539230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37b4d9-25be-4e1a-9b51-8688228f23dc service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:14.541461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37b4d9-25be-4e1a-9b51-8688228f23dc service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:14.541461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37b4d9-25be-4e1a-9b51-8688228f23dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:14.547200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5e37b4d9-25be-4e1a-9b51-8688228f23dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:14.553815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae7506-ac1a-45cd-b7df-4b785378c83f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:14.571576 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6968228-ebf6-4c6c-8f02-e8035d43bde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:14.574048 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6968228-ebf6-4c6c-8f02-e8035d43bde3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:14.574048 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6968228-ebf6-4c6c-8f02-e8035d43bde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:14.574048 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6968228-ebf6-4c6c-8f02-e8035d43bde3 admin admin] PATH_INFO: `/v3/projects/421701ac32264d43bd6c4991901999f0/users/0b87cad7aa624af49d4e8f1a1ab9fe15/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:14.601396 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6968228-ebf6-4c6c-8f02-e8035d43bde3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=421701ac32264d43bd6c4991901999f0, user_id=0b87cad7aa624af49d4e8f1a1ab9fe15, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:14.605793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6968228-ebf6-4c6c-8f02-e8035d43bde3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:14.652005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37b4d9-25be-4e1a-9b51-8688228f23dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:14.652493 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1257/2526] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:14 2022] PUT /identity/v3/projects/421701ac32264d43bd6c4991901999f0/users/0b87cad7aa624af49d4e8f1a1ab9fe15/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:08:14.654213 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37b4d9-25be-4e1a-9b51-8688228f23dc service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:14.663882 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d5d5-291b-4dd1-aa68-60d4df80e73e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:14.664503 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d5d5-291b-4dd1-aa68-60d4df80e73e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:14.665008 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d5d5-291b-4dd1-aa68-60d4df80e73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:14.666218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1270/2527] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:14.713508 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8bd4d5d5-291b-4dd1-aa68-60d4df80e73e None None] MFA Rules not processed for user `0b87cad7aa624af49d4e8f1a1ab9fe15`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:14.715062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8bd4d5d5-291b-4dd1-aa68-60d4df80e73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:14.795863 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1258/2528] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:14.806689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37b4d9-25be-4e1a-9b51-8688228f23dc service nova] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:14.808473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5e37b4d9-25be-4e1a-9b51-8688228f23dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:14.837831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:14.882494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37b4d9-25be-4e1a-9b51-8688228f23dc service nova] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:14.942695 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84946640-a138-4c7f-9b78-c9ce6137fd3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7c46f4dc084a948bd09ca9b86c2748', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:14.943546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84946640-a138-4c7f-9b78-c9ce6137fd3d service glance] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:14.946006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84946640-a138-4c7f-9b78-c9ce6137fd3d service glance] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:14.946006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84946640-a138-4c7f-9b78-c9ce6137fd3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:14.956971 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84946640-a138-4c7f-9b78-c9ce6137fd3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:14.958502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84946640-a138-4c7f-9b78-c9ce6137fd3d service glance] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:14.986788 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1271/2529] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:16.315917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ce8ce-a788-4917-b286-11509c238999 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:16.316421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ce8ce-a788-4917-b286-11509c238999 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:16.316421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ce8ce-a788-4917-b286-11509c238999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:16.337633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-646ce8ce-a788-4917-b286-11509c238999 None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:16.338885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-646ce8ce-a788-4917-b286-11509c238999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:16.353432 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:16.411152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1259/2530] 10.222.0.77 () {58 vars in 967 bytes} [Mon Aug 22 16:08:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:16.427317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84946640-a138-4c7f-9b78-c9ce6137fd3d service glance] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:16.429056 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-84946640-a138-4c7f-9b78-c9ce6137fd3d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:16.504454 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84946640-a138-4c7f-9b78-c9ce6137fd3d service glance] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:16.509553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1131e6-848b-4723-bc42-bd5eeb3683b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:16.510148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1131e6-848b-4723-bc42-bd5eeb3683b1 service swift] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:16.510426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1131e6-848b-4723-bc42-bd5eeb3683b1 service swift] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:16.510728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1131e6-848b-4723-bc42-bd5eeb3683b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:16.519256 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1131e6-848b-4723-bc42-bd5eeb3683b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:16.520920 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1131e6-848b-4723-bc42-bd5eeb3683b1 service swift] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:16.529592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1272/2531] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:08:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:08:23.904303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ce8ce-a788-4917-b286-11509c238999 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:23.905655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-646ce8ce-a788-4917-b286-11509c238999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:24.022284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ce8ce-a788-4917-b286-11509c238999 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:24.031693 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d2a1f-5136-4fa0-87d5-174b5f77bb6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:24.032339 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d2a1f-5136-4fa0-87d5-174b5f77bb6e service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:24.032610 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d2a1f-5136-4fa0-87d5-174b5f77bb6e service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:24.032877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d2a1f-5136-4fa0-87d5-174b5f77bb6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:24.034850 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c39d2a1f-5136-4fa0-87d5-174b5f77bb6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:24.055956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d2a1f-5136-4fa0-87d5-174b5f77bb6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:24.057439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d2a1f-5136-4fa0-87d5-174b5f77bb6e service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:24.069060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1260/2532] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:26.526133 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=69 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:29.990781 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1131e6-848b-4723-bc42-bd5eeb3683b1 service swift] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:29.992573 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ac1131e6-848b-4723-bc42-bd5eeb3683b1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:30.053263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1131e6-848b-4723-bc42-bd5eeb3683b1 service swift] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:30.057480 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58683480-faa9-4f02-9fc2-72a870644d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:30.058105 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58683480-faa9-4f02-9fc2-72a870644d79 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:30.058375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58683480-faa9-4f02-9fc2-72a870644d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:30.058660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58683480-faa9-4f02-9fc2-72a870644d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:30.060441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-58683480-faa9-4f02-9fc2-72a870644d79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:30.131173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58683480-faa9-4f02-9fc2-72a870644d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:30.132816 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58683480-faa9-4f02-9fc2-72a870644d79 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:30.144274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1273/2533] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:33.314219 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d2a1f-5136-4fa0-87d5-174b5f77bb6e service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:33.316005 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c39d2a1f-5136-4fa0-87d5-174b5f77bb6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:33.344615 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d2a1f-5136-4fa0-87d5-174b5f77bb6e service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:33.350094 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6ba85-392c-4b48-bd65-865389a70159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:33.351105 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6ba85-392c-4b48-bd65-865389a70159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:33.351477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6ba85-392c-4b48-bd65-865389a70159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:33.352139 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6ba85-392c-4b48-bd65-865389a70159 admin admin] PATH_INFO: `/v3/users/4d3445e9462b42cd82ea10ed54193c89` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:33.353496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6ba85-392c-4b48-bd65-865389a70159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d3445e9462b42cd82ea10ed54193c89)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:33.355871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6ba85-392c-4b48-bd65-865389a70159 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:33.413181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6ef6ba85-392c-4b48-bd65-865389a70159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d3445e9462b42cd82ea10ed54193c89'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:33.413969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6ef6ba85-392c-4b48-bd65-865389a70159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d3445e9462b42cd82ea10ed54193c89'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:33.414632 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6ef6ba85-392c-4b48-bd65-865389a70159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d3445e9462b42cd82ea10ed54193c89'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:33.421558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6ef6ba85-392c-4b48-bd65-865389a70159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d3445e9462b42cd82ea10ed54193c89'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:33.437388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6ef6ba85-392c-4b48-bd65-865389a70159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d3445e9462b42cd82ea10ed54193c89'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:33.455433 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1261/2534] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:08:33 2022] DELETE /identity/v3/users/4d3445e9462b42cd82ea10ed54193c89 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:33.966425 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58683480-faa9-4f02-9fc2-72a870644d79 service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:33.976882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58683480-faa9-4f02-9fc2-72a870644d79 service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:34.039254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3821d-d76a-4c6a-af1e-5c6490d4778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:34.039923 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3821d-d76a-4c6a-af1e-5c6490d4778c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:34.040202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3821d-d76a-4c6a-af1e-5c6490d4778c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:34.040474 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3821d-d76a-4c6a-af1e-5c6490d4778c admin admin] PATH_INFO: `/v3/projects/b8985aa9c72943dfa234318c7c3c86a2` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:34.041618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3821d-d76a-4c6a-af1e-5c6490d4778c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8985aa9c72943dfa234318c7c3c86a2)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:34.043616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3821d-d76a-4c6a-af1e-5c6490d4778c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:34.094022 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6da3821d-d76a-4c6a-af1e-5c6490d4778c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8985aa9c72943dfa234318c7c3c86a2', 'request_id': 'req-6da3821d-d76a-4c6a-af1e-5c6490d4778c'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:34.096724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:34.103178 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6da3821d-d76a-4c6a-af1e-5c6490d4778c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8985aa9c72943dfa234318c7c3c86a2', 'request_id': 'req-6da3821d-d76a-4c6a-af1e-5c6490d4778c'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:34.115003 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6da3821d-d76a-4c6a-af1e-5c6490d4778c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8985aa9c72943dfa234318c7c3c86a2', 'request_id': 'req-6da3821d-d76a-4c6a-af1e-5c6490d4778c'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:34.126551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6da3821d-d76a-4c6a-af1e-5c6490d4778c admin admin] The token cache is being invalidate because project b8985aa9c72943dfa234318c7c3c86a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:08:34.126914 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6da3821d-d76a-4c6a-af1e-5c6490d4778c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:34.127910 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6da3821d-d76a-4c6a-af1e-5c6490d4778c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:34.129864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1274/2535] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:08:33 2022] DELETE /identity/v3/projects/b8985aa9c72943dfa234318c7c3c86a2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:34.135255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b18f82-b249-481e-b2b4-e6fc6f75564b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:34.135520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b18f82-b249-481e-b2b4-e6fc6f75564b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:34.135809 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b18f82-b249-481e-b2b4-e6fc6f75564b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:34.158785 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f2b18f82-b249-481e-b2b4-e6fc6f75564b None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:34.159942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f2b18f82-b249-481e-b2b4-e6fc6f75564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:34.177426 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:34.233523 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1262/2536] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:34.242701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eaa1b-e853-4823-a7df-37e07e6178db None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:34.242994 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eaa1b-e853-4823-a7df-37e07e6178db None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:34.243277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eaa1b-e853-4823-a7df-37e07e6178db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:34.263245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-bc2eaa1b-e853-4823-a7df-37e07e6178db None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:34.264470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bc2eaa1b-e853-4823-a7df-37e07e6178db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:34.273198 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1275/2537] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:34.277636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b18f82-b249-481e-b2b4-e6fc6f75564b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:34.287928 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b18f82-b249-481e-b2b4-e6fc6f75564b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:34.293174 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82e8d6-e071-47fe-bc21-4ec5341c47d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:34.293771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82e8d6-e071-47fe-bc21-4ec5341c47d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:34.294046 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82e8d6-e071-47fe-bc21-4ec5341c47d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:34.294317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82e8d6-e071-47fe-bc21-4ec5341c47d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:34.295006 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82e8d6-e071-47fe-bc21-4ec5341c47d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:08:34.295297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82e8d6-e071-47fe-bc21-4ec5341c47d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:34.296890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82e8d6-e071-47fe-bc21-4ec5341c47d0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:34.309629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1263/2538] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:08:34.314228 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eaa1b-e853-4823-a7df-37e07e6178db None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:34.324251 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eaa1b-e853-4823-a7df-37e07e6178db None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:34.329750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153ce32-0814-4e15-b7a5-c0a575563125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:34.330424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ce32-0814-4e15-b7a5-c0a575563125 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:34.330728 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ce32-0814-4e15-b7a5-c0a575563125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:34.330999 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ce32-0814-4e15-b7a5-c0a575563125 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:34.331622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153ce32-0814-4e15-b7a5-c0a575563125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:34.333542 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153ce32-0814-4e15-b7a5-c0a575563125 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:34.363042 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1276/2539] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:08:34 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:34.367555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82e8d6-e071-47fe-bc21-4ec5341c47d0 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:34.381826 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82e8d6-e071-47fe-bc21-4ec5341c47d0 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:34.445425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e00e81-f187-45d4-9e25-8bfb11c0e6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:34.446038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e00e81-f187-45d4-9e25-8bfb11c0e6ef admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:34.446310 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e00e81-f187-45d4-9e25-8bfb11c0e6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:34.446575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e00e81-f187-45d4-9e25-8bfb11c0e6ef admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:34.447213 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e00e81-f187-45d4-9e25-8bfb11c0e6ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:34.449216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e00e81-f187-45d4-9e25-8bfb11c0e6ef admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:34.475956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1264/2540] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:08:34 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:34.477304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153ce32-0814-4e15-b7a5-c0a575563125 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:34.490665 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153ce32-0814-4e15-b7a5-c0a575563125 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:34.497967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083bd14-6b87-459c-8738-5642b7501378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:34.498591 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083bd14-6b87-459c-8738-5642b7501378 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:34.499594 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083bd14-6b87-459c-8738-5642b7501378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:34.499594 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083bd14-6b87-459c-8738-5642b7501378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:34.499840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083bd14-6b87-459c-8738-5642b7501378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:34.501404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083bd14-6b87-459c-8738-5642b7501378 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:34.512532 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1277/2541] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:34.517285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e00e81-f187-45d4-9e25-8bfb11c0e6ef admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:34.530248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e00e81-f187-45d4-9e25-8bfb11c0e6ef admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:34.537065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f873fe-55c7-4356-b09d-ed79248b2917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:34.537684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f873fe-55c7-4356-b09d-ed79248b2917 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:34.537960 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f873fe-55c7-4356-b09d-ed79248b2917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:34.538226 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f873fe-55c7-4356-b09d-ed79248b2917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:34.538978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f873fe-55c7-4356-b09d-ed79248b2917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:34.540604 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f873fe-55c7-4356-b09d-ed79248b2917 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:34.555580 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1265/2542] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:34.556945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083bd14-6b87-459c-8738-5642b7501378 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:34.567832 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083bd14-6b87-459c-8738-5642b7501378 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:34.573320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805dcee1-b2b7-4858-98ea-73eddeb07b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:34.573993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dcee1-b2b7-4858-98ea-73eddeb07b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:34.574273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dcee1-b2b7-4858-98ea-73eddeb07b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:34.574547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805dcee1-b2b7-4858-98ea-73eddeb07b45 admin admin] PATH_INFO: `/v3/projects/be84fcadcf9d4d0c805fec5a91be3cfd/users/9bc20c5239164b809a5514400a707c2b/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:34.593625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805dcee1-b2b7-4858-98ea-73eddeb07b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be84fcadcf9d4d0c805fec5a91be3cfd, user_id=9bc20c5239164b809a5514400a707c2b, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:34.597365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805dcee1-b2b7-4858-98ea-73eddeb07b45 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:34.611975 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1278/2543] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:34 2022] PUT /identity/v3/projects/be84fcadcf9d4d0c805fec5a91be3cfd/users/9bc20c5239164b809a5514400a707c2b/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:34.623830 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b079b6d-12e2-4d66-b7ab-49278352c605 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:34.624140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b079b6d-12e2-4d66-b7ab-49278352c605 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:34.624573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b079b6d-12e2-4d66-b7ab-49278352c605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:34.663484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0b079b6d-12e2-4d66-b7ab-49278352c605 None None] MFA Rules not processed for user `9bc20c5239164b809a5514400a707c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:34.664697 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0b079b6d-12e2-4d66-b7ab-49278352c605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:34.740305 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1266/2544] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:34.744804 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805dcee1-b2b7-4858-98ea-73eddeb07b45 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:34.817431 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805dcee1-b2b7-4858-98ea-73eddeb07b45 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:34.823040 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86f079-031c-4440-9a67-34fed8a3891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:34.823654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86f079-031c-4440-9a67-34fed8a3891a admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:34.823938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86f079-031c-4440-9a67-34fed8a3891a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:34.824213 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86f079-031c-4440-9a67-34fed8a3891a admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:34.824848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86f079-031c-4440-9a67-34fed8a3891a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:34.827926 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86f079-031c-4440-9a67-34fed8a3891a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:34.860202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1279/2545] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:08:34 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:34.864339 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b079b6d-12e2-4d66-b7ab-49278352c605 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:34.886011 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b079b6d-12e2-4d66-b7ab-49278352c605 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:34.898086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:34.946374 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaee3b-ca17-42f2-855e-5e5b62e0d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:34.947017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaee3b-ca17-42f2-855e-5e5b62e0d8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:34.947298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaee3b-ca17-42f2-855e-5e5b62e0d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:34.947569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaee3b-ca17-42f2-855e-5e5b62e0d8e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:34.948165 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaee3b-ca17-42f2-855e-5e5b62e0d8e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:34.950140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaee3b-ca17-42f2-855e-5e5b62e0d8e7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:34.972593 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1267/2546] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:08:34 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:08:34.976840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86f079-031c-4440-9a67-34fed8a3891a admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:34.987492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86f079-031c-4440-9a67-34fed8a3891a admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:34.992365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f02b52-c6a3-49af-9723-3705b8bf7bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:34.992958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02b52-c6a3-49af-9723-3705b8bf7bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:34.993252 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02b52-c6a3-49af-9723-3705b8bf7bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:34.993534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02b52-c6a3-49af-9723-3705b8bf7bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:34.994164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f02b52-c6a3-49af-9723-3705b8bf7bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:34.995802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f02b52-c6a3-49af-9723-3705b8bf7bd6 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:35.007061 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1280/2547] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:35.011609 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaee3b-ca17-42f2-855e-5e5b62e0d8e7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:35.022471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaee3b-ca17-42f2-855e-5e5b62e0d8e7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:35.027636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e0ff7-53e3-4035-8333-e69943115524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:35.028282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e0ff7-53e3-4035-8333-e69943115524 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:35.028556 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e0ff7-53e3-4035-8333-e69943115524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:35.028824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e0ff7-53e3-4035-8333-e69943115524 admin admin] PATH_INFO: `/v3/projects/777e9412fc5343f9a6da070231fbaf08/users/0e18c21513574ee88ee3fa41e29df01b/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:35.045573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e0ff7-53e3-4035-8333-e69943115524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=777e9412fc5343f9a6da070231fbaf08, user_id=0e18c21513574ee88ee3fa41e29df01b, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:35.048159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e0ff7-53e3-4035-8333-e69943115524 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:35.062834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1268/2548] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:35 2022] PUT /identity/v3/projects/777e9412fc5343f9a6da070231fbaf08/users/0e18c21513574ee88ee3fa41e29df01b/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:35.067037 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f02b52-c6a3-49af-9723-3705b8bf7bd6 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:35.078735 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f02b52-c6a3-49af-9723-3705b8bf7bd6 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:35.130311 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:35.143402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a121114-6c74-4ce4-8a45-34de03914f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:35.144280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a121114-6c74-4ce4-8a45-34de03914f57 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:35.144969 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a121114-6c74-4ce4-8a45-34de03914f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:35.145572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a121114-6c74-4ce4-8a45-34de03914f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:35.146301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a121114-6c74-4ce4-8a45-34de03914f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:35.148107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a121114-6c74-4ce4-8a45-34de03914f57 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:35.158825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1281/2549] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:08:35.163102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e0ff7-53e3-4035-8333-e69943115524 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:35.173847 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e0ff7-53e3-4035-8333-e69943115524 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:35.178771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe063d1-46a1-414c-818a-237345e57652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:35.179508 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe063d1-46a1-414c-818a-237345e57652 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:35.179848 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe063d1-46a1-414c-818a-237345e57652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:35.180338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe063d1-46a1-414c-818a-237345e57652 admin admin] PATH_INFO: `/v3/projects/777e9412fc5343f9a6da070231fbaf08/users/0e18c21513574ee88ee3fa41e29df01b/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:35.182383 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe063d1-46a1-414c-818a-237345e57652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=777e9412fc5343f9a6da070231fbaf08, user_id=0e18c21513574ee88ee3fa41e29df01b, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:35.185228 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe063d1-46a1-414c-818a-237345e57652 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:35.198441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1269/2550] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:35 2022] PUT /identity/v3/projects/777e9412fc5343f9a6da070231fbaf08/users/0e18c21513574ee88ee3fa41e29df01b/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:35.209413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281faf8-da16-4978-a81f-301ffb55ef6d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:35.209750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281faf8-da16-4978-a81f-301ffb55ef6d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:35.210142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281faf8-da16-4978-a81f-301ffb55ef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:35.239642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-4281faf8-da16-4978-a81f-301ffb55ef6d None None] MFA Rules not processed for user `0e18c21513574ee88ee3fa41e29df01b`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:35.240912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4281faf8-da16-4978-a81f-301ffb55ef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:35.319129 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1282/2551] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:35.331447 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe063d1-46a1-414c-818a-237345e57652 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:35.333222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0fe063d1-46a1-414c-818a-237345e57652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:35.398644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe063d1-46a1-414c-818a-237345e57652 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:35.405797 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71033ff9-cbee-451e-8388-d8cfdbe3f37a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:35.406854 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71033ff9-cbee-451e-8388-d8cfdbe3f37a service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:35.407274 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71033ff9-cbee-451e-8388-d8cfdbe3f37a service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:35.407616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71033ff9-cbee-451e-8388-d8cfdbe3f37a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:35.418117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71033ff9-cbee-451e-8388-d8cfdbe3f37a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:35.419607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71033ff9-cbee-451e-8388-d8cfdbe3f37a service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:35.429330 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1270/2552] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:35.506839 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281faf8-da16-4978-a81f-301ffb55ef6d None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:35.517007 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281faf8-da16-4978-a81f-301ffb55ef6d None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:35.522629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ba25d-a6e8-467a-8cbb-cbe7c5168385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:35.523268 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ba25d-a6e8-467a-8cbb-cbe7c5168385 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:35.523557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ba25d-a6e8-467a-8cbb-cbe7c5168385 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:35.523817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ba25d-a6e8-467a-8cbb-cbe7c5168385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:35.595509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ba25d-a6e8-467a-8cbb-cbe7c5168385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:35.597018 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ba25d-a6e8-467a-8cbb-cbe7c5168385 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:35.605937 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1283/2553] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:37.058504 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71033ff9-cbee-451e-8388-d8cfdbe3f37a service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:37.061380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-71033ff9-cbee-451e-8388-d8cfdbe3f37a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:37.161335 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71033ff9-cbee-451e-8388-d8cfdbe3f37a service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:37.168703 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36811047-957d-4366-b82b-debb16e1a195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:37.170022 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36811047-957d-4366-b82b-debb16e1a195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:37.170352 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36811047-957d-4366-b82b-debb16e1a195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:37.170886 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36811047-957d-4366-b82b-debb16e1a195 admin admin] PATH_INFO: `/v3/users/0b87cad7aa624af49d4e8f1a1ab9fe15` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:37.172821 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36811047-957d-4366-b82b-debb16e1a195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b87cad7aa624af49d4e8f1a1ab9fe15)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:37.176157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36811047-957d-4366-b82b-debb16e1a195 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:37.191442 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:37.230195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-36811047-957d-4366-b82b-debb16e1a195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b87cad7aa624af49d4e8f1a1ab9fe15'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:37.230877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-36811047-957d-4366-b82b-debb16e1a195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b87cad7aa624af49d4e8f1a1ab9fe15'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:37.231484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-36811047-957d-4366-b82b-debb16e1a195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b87cad7aa624af49d4e8f1a1ab9fe15'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:37.239468 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-36811047-957d-4366-b82b-debb16e1a195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b87cad7aa624af49d4e8f1a1ab9fe15'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:37.249960 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-36811047-957d-4366-b82b-debb16e1a195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b87cad7aa624af49d4e8f1a1ab9fe15'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:37.268098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1271/2554] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:08:37 2022] DELETE /identity/v3/users/0b87cad7aa624af49d4e8f1a1ab9fe15 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:37.272682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583494-2ce5-4e92-8d50-99a2ab3b270d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:37.273161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583494-2ce5-4e92-8d50-99a2ab3b270d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:37.273268 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99583494-2ce5-4e92-8d50-99a2ab3b270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:37.292875 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-99583494-2ce5-4e92-8d50-99a2ab3b270d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:37.294101 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-99583494-2ce5-4e92-8d50-99a2ab3b270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:37.364246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1284/2555] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:08:37.374513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36811047-957d-4366-b82b-debb16e1a195 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:37.376380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-36811047-957d-4366-b82b-debb16e1a195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:37.457708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36811047-957d-4366-b82b-debb16e1a195 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:37.462411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276a269-3fad-4dfe-992a-ca2a93b86b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:37.463132 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276a269-3fad-4dfe-992a-ca2a93b86b0c service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:37.463413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276a269-3fad-4dfe-992a-ca2a93b86b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:37.463688 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276a269-3fad-4dfe-992a-ca2a93b86b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:37.474215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276a269-3fad-4dfe-992a-ca2a93b86b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:37.475712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276a269-3fad-4dfe-992a-ca2a93b86b0c service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:37.486134 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1272/2556] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:37.885479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99583494-2ce5-4e92-8d50-99a2ab3b270d None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:37.887748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-99583494-2ce5-4e92-8d50-99a2ab3b270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:37.904497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99583494-2ce5-4e92-8d50-99a2ab3b270d None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:37.942865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d6970-bdab-4f87-b952-acbce0f666fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:37.943625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d6970-bdab-4f87-b952-acbce0f666fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:37.943902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d6970-bdab-4f87-b952-acbce0f666fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:37.944173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d6970-bdab-4f87-b952-acbce0f666fa admin admin] PATH_INFO: `/v3/projects/421701ac32264d43bd6c4991901999f0` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:37.945387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d6970-bdab-4f87-b952-acbce0f666fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=421701ac32264d43bd6c4991901999f0)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:37.947392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d6970-bdab-4f87-b952-acbce0f666fa admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:37.956510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:38.011047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-aa9d6970-bdab-4f87-b952-acbce0f666fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421701ac32264d43bd6c4991901999f0', 'request_id': 'req-aa9d6970-bdab-4f87-b952-acbce0f666fa'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:38.019402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-aa9d6970-bdab-4f87-b952-acbce0f666fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421701ac32264d43bd6c4991901999f0', 'request_id': 'req-aa9d6970-bdab-4f87-b952-acbce0f666fa'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:38.027596 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-aa9d6970-bdab-4f87-b952-acbce0f666fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421701ac32264d43bd6c4991901999f0', 'request_id': 'req-aa9d6970-bdab-4f87-b952-acbce0f666fa'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:38.039554 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-aa9d6970-bdab-4f87-b952-acbce0f666fa admin admin] The token cache is being invalidate because project 421701ac32264d43bd6c4991901999f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:08:38.039847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-aa9d6970-bdab-4f87-b952-acbce0f666fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:38.040547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-aa9d6970-bdab-4f87-b952-acbce0f666fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:38.042332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1285/2557] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:08:37 2022] DELETE /identity/v3/projects/421701ac32264d43bd6c4991901999f0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:38.048021 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bf5cb-397c-431f-bc30-0f79b1936ecb None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:38.048318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bf5cb-397c-431f-bc30-0f79b1936ecb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:38.048599 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bf5cb-397c-431f-bc30-0f79b1936ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:38.071968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7e8bf5cb-397c-431f-bc30-0f79b1936ecb None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:38.073309 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7e8bf5cb-397c-431f-bc30-0f79b1936ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:38.137420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1273/2558] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:38.145808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4de5ba-36d6-4f75-8dc9-c392ee41c313 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:38.146093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4de5ba-36d6-4f75-8dc9-c392ee41c313 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:38.146371 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4de5ba-36d6-4f75-8dc9-c392ee41c313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:38.167502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-fa4de5ba-36d6-4f75-8dc9-c392ee41c313 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:38.168727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-fa4de5ba-36d6-4f75-8dc9-c392ee41c313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:38.178875 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1286/2559] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:38.183371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bf5cb-397c-431f-bc30-0f79b1936ecb None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:38.196126 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bf5cb-397c-431f-bc30-0f79b1936ecb None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:38.201009 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24f365-c46c-455d-a8f9-dac4e438f38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:38.201635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24f365-c46c-455d-a8f9-dac4e438f38e admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:38.201950 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24f365-c46c-455d-a8f9-dac4e438f38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:38.202181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24f365-c46c-455d-a8f9-dac4e438f38e admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:38.203311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24f365-c46c-455d-a8f9-dac4e438f38e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:08:38.204103 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24f365-c46c-455d-a8f9-dac4e438f38e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:38.205420 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24f365-c46c-455d-a8f9-dac4e438f38e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:38.220133 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1274/2560] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:08:38.224417 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4de5ba-36d6-4f75-8dc9-c392ee41c313 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:38.235137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4de5ba-36d6-4f75-8dc9-c392ee41c313 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:38.241199 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bedb1-fa1d-4cad-bbc8-8a5b77a16bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:38.241821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bedb1-fa1d-4cad-bbc8-8a5b77a16bdc admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:38.242182 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bedb1-fa1d-4cad-bbc8-8a5b77a16bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:38.242458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bedb1-fa1d-4cad-bbc8-8a5b77a16bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:38.243283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bedb1-fa1d-4cad-bbc8-8a5b77a16bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:38.245329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bedb1-fa1d-4cad-bbc8-8a5b77a16bdc admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:38.280283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1287/2561] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:08:38 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:38.286251 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24f365-c46c-455d-a8f9-dac4e438f38e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:38.303528 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24f365-c46c-455d-a8f9-dac4e438f38e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:38.329459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:38.381236 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d9af6-406e-4b92-bdf4-0600b6b2a02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:38.381912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d9af6-406e-4b92-bdf4-0600b6b2a02c admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:38.382078 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d9af6-406e-4b92-bdf4-0600b6b2a02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:38.382299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d9af6-406e-4b92-bdf4-0600b6b2a02c admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:38.383708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d9af6-406e-4b92-bdf4-0600b6b2a02c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:38.385854 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d9af6-406e-4b92-bdf4-0600b6b2a02c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:38.410285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1275/2562] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:08:38 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:38.415131 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bedb1-fa1d-4cad-bbc8-8a5b77a16bdc admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:38.426419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bedb1-fa1d-4cad-bbc8-8a5b77a16bdc admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:38.431814 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d067a-c267-4440-a8fb-474b7ba435ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:38.432409 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d067a-c267-4440-a8fb-474b7ba435ce admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:38.432688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d067a-c267-4440-a8fb-474b7ba435ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:38.432989 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d067a-c267-4440-a8fb-474b7ba435ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:38.433658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d067a-c267-4440-a8fb-474b7ba435ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:38.435278 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d067a-c267-4440-a8fb-474b7ba435ce admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:38.447061 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1288/2563] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:38.451297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d9af6-406e-4b92-bdf4-0600b6b2a02c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:38.462591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d9af6-406e-4b92-bdf4-0600b6b2a02c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:38.467394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af39be-16c3-4dfb-ba81-0e7ec5557b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:38.468082 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af39be-16c3-4dfb-ba81-0e7ec5557b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:38.468364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af39be-16c3-4dfb-ba81-0e7ec5557b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:38.468662 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af39be-16c3-4dfb-ba81-0e7ec5557b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:38.469326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af39be-16c3-4dfb-ba81-0e7ec5557b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:38.471022 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af39be-16c3-4dfb-ba81-0e7ec5557b14 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:38.486188 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1276/2564] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:38.487471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d067a-c267-4440-a8fb-474b7ba435ce admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:38.497724 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d067a-c267-4440-a8fb-474b7ba435ce admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:38.503247 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45281ae4-1d13-4195-b98a-ed64fdcb4981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:38.503967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45281ae4-1d13-4195-b98a-ed64fdcb4981 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:38.504248 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45281ae4-1d13-4195-b98a-ed64fdcb4981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:38.504521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45281ae4-1d13-4195-b98a-ed64fdcb4981 admin admin] PATH_INFO: `/v3/projects/755c8ec562364bc389b8d6be75438789/users/344c0b0d05284ef8a5c9e333d6bad3f7/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:38.519746 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45281ae4-1d13-4195-b98a-ed64fdcb4981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755c8ec562364bc389b8d6be75438789, user_id=344c0b0d05284ef8a5c9e333d6bad3f7, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:38.522618 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45281ae4-1d13-4195-b98a-ed64fdcb4981 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:38.536408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1289/2565] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:38 2022] PUT /identity/v3/projects/755c8ec562364bc389b8d6be75438789/users/344c0b0d05284ef8a5c9e333d6bad3f7/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:38.542152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2d0ba-3185-4481-af7d-856120ba2f44 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:38.542442 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2d0ba-3185-4481-af7d-856120ba2f44 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:38.542832 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2d0ba-3185-4481-af7d-856120ba2f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:38.563543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-44c2d0ba-3185-4481-af7d-856120ba2f44 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:38.564798 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-44c2d0ba-3185-4481-af7d-856120ba2f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:38.634065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1277/2566] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:38.644727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45281ae4-1d13-4195-b98a-ed64fdcb4981 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:38.646432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-45281ae4-1d13-4195-b98a-ed64fdcb4981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:38.709294 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45281ae4-1d13-4195-b98a-ed64fdcb4981 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:38.713634 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49acd9e-5a6b-421f-8496-b3b5e39d2d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:38.714325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49acd9e-5a6b-421f-8496-b3b5e39d2d45 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:38.714622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49acd9e-5a6b-421f-8496-b3b5e39d2d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:38.714894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49acd9e-5a6b-421f-8496-b3b5e39d2d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:38.724923 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49acd9e-5a6b-421f-8496-b3b5e39d2d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:38.726471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49acd9e-5a6b-421f-8496-b3b5e39d2d45 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:38.737502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1290/2567] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:39.709458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07732198-de8d-4e51-a272-4a5db4de7613 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:39.709960 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07732198-de8d-4e51-a272-4a5db4de7613 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:39.710354 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07732198-de8d-4e51-a272-4a5db4de7613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:39.757597 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-07732198-de8d-4e51-a272-4a5db4de7613 None None] MFA Rules not processed for user `344c0b0d05284ef8a5c9e333d6bad3f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:39.758779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-07732198-de8d-4e51-a272-4a5db4de7613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:39.855313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1278/2568] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:39.869414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49acd9e-5a6b-421f-8496-b3b5e39d2d45 service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:39.875157 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-a49acd9e-5a6b-421f-8496-b3b5e39d2d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:39.921228 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:39.948794 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49acd9e-5a6b-421f-8496-b3b5e39d2d45 service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:39.953273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58820b33-9be5-469c-b66c-cc91f35a2833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:39.953889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58820b33-9be5-469c-b66c-cc91f35a2833 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:39.954164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58820b33-9be5-469c-b66c-cc91f35a2833 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:39.954491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58820b33-9be5-469c-b66c-cc91f35a2833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:39.964211 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58820b33-9be5-469c-b66c-cc91f35a2833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:39.966039 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58820b33-9be5-469c-b66c-cc91f35a2833 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:39.976682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1291/2569] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:40.613363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07732198-de8d-4e51-a272-4a5db4de7613 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:40.614855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-07732198-de8d-4e51-a272-4a5db4de7613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:40.650990 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:40.700241 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07732198-de8d-4e51-a272-4a5db4de7613 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:40.708608 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a32f1-5373-46d1-8b3b-8b9657b33517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:40.709623 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a32f1-5373-46d1-8b3b-8b9657b33517 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:40.710378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a32f1-5373-46d1-8b3b-8b9657b33517 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:40.710514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a32f1-5373-46d1-8b3b-8b9657b33517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:40.713357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-635a32f1-5373-46d1-8b3b-8b9657b33517 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:40.729898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a32f1-5373-46d1-8b3b-8b9657b33517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:40.731555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a32f1-5373-46d1-8b3b-8b9657b33517 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:40.742466 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1279/2570] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:41.370738 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278b36b-c86d-4a8e-9f4c-abd65205e76f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:41.371225 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278b36b-c86d-4a8e-9f4c-abd65205e76f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:41.371342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278b36b-c86d-4a8e-9f4c-abd65205e76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:41.390429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-f278b36b-c86d-4a8e-9f4c-abd65205e76f None None] MFA Rules not processed for user `344c0b0d05284ef8a5c9e333d6bad3f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:41.391613 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f278b36b-c86d-4a8e-9f4c-abd65205e76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:41.398793 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1292/2571] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:42.640805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a32f1-5373-46d1-8b3b-8b9657b33517 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:42.642425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-635a32f1-5373-46d1-8b3b-8b9657b33517 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:42.665621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a32f1-5373-46d1-8b3b-8b9657b33517 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:42.679080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdca615-b663-4972-a5d1-f4ecaddfa7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:42.680130 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdca615-b663-4972-a5d1-f4ecaddfa7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:42.680472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdca615-b663-4972-a5d1-f4ecaddfa7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:42.680815 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdca615-b663-4972-a5d1-f4ecaddfa7fc admin admin] PATH_INFO: `/v3/users/9bc20c5239164b809a5514400a707c2b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:42.683404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdca615-b663-4972-a5d1-f4ecaddfa7fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc20c5239164b809a5514400a707c2b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:42.685462 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdca615-b663-4972-a5d1-f4ecaddfa7fc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:42.775637 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0bdca615-b663-4972-a5d1-f4ecaddfa7fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc20c5239164b809a5514400a707c2b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:42.777034 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0bdca615-b663-4972-a5d1-f4ecaddfa7fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc20c5239164b809a5514400a707c2b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:42.777985 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0bdca615-b663-4972-a5d1-f4ecaddfa7fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc20c5239164b809a5514400a707c2b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:42.795034 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0bdca615-b663-4972-a5d1-f4ecaddfa7fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc20c5239164b809a5514400a707c2b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:42.807027 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0bdca615-b663-4972-a5d1-f4ecaddfa7fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc20c5239164b809a5514400a707c2b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:42.840361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1280/2572] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:08:42 2022] DELETE /identity/v3/users/9bc20c5239164b809a5514400a707c2b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:42.848384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b0499-cbb0-4485-9e85-5d299d01f4b6 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:42.848857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b0499-cbb0-4485-9e85-5d299d01f4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:42.848951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b0499-cbb0-4485-9e85-5d299d01f4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:42.869500 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-9f0b0499-cbb0-4485-9e85-5d299d01f4b6 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:42.871054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9f0b0499-cbb0-4485-9e85-5d299d01f4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:42.942976 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1293/2573] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:42.953395 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdca615-b663-4972-a5d1-f4ecaddfa7fc admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:42.954909 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0bdca615-b663-4972-a5d1-f4ecaddfa7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:43.016496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdca615-b663-4972-a5d1-f4ecaddfa7fc admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:43.020258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2dd6f-fae7-4c70-8af4-1a19c2a87b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:43.020872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2dd6f-fae7-4c70-8af4-1a19c2a87b42 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:43.021149 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2dd6f-fae7-4c70-8af4-1a19c2a87b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:43.021424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2dd6f-fae7-4c70-8af4-1a19c2a87b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:43.032057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2dd6f-fae7-4c70-8af4-1a19c2a87b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:43.033700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2dd6f-fae7-4c70-8af4-1a19c2a87b42 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:43.044356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1281/2574] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:43.349343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b0499-cbb0-4485-9e85-5d299d01f4b6 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:43.351392 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9f0b0499-cbb0-4485-9e85-5d299d01f4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:43.367586 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b0499-cbb0-4485-9e85-5d299d01f4b6 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:43.372505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:43.373158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:43.373440 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:43.373716 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] PATH_INFO: `/v3/projects/be84fcadcf9d4d0c805fec5a91be3cfd` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:43.375191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be84fcadcf9d4d0c805fec5a91be3cfd)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:43.377300 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:43.434497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be84fcadcf9d4d0c805fec5a91be3cfd', 'request_id': 'req-66a5ea56-5a36-421b-80b7-43c9434cb6c8'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:43.443658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be84fcadcf9d4d0c805fec5a91be3cfd', 'request_id': 'req-66a5ea56-5a36-421b-80b7-43c9434cb6c8'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:43.450499 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be84fcadcf9d4d0c805fec5a91be3cfd', 'request_id': 'req-66a5ea56-5a36-421b-80b7-43c9434cb6c8'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:43.463426 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] The token cache is being invalidate because project be84fcadcf9d4d0c805fec5a91be3cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:08:43.464062 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:43.464974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:43.469668 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1294/2575] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:08:43 2022] DELETE /identity/v3/projects/be84fcadcf9d4d0c805fec5a91be3cfd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:43.471007 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2dd6f-fae7-4c70-8af4-1a19c2a87b42 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:43.483409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2dd6f-fae7-4c70-8af4-1a19c2a87b42 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:43.520123 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:43.560514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488a2dd-2d5b-48e4-95d1-aca3292418f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:43.561481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a2dd-2d5b-48e4-95d1-aca3292418f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:43.561817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a2dd-2d5b-48e4-95d1-aca3292418f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:43.562165 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a2dd-2d5b-48e4-95d1-aca3292418f3 admin admin] PATH_INFO: `/v3/users/0e18c21513574ee88ee3fa41e29df01b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:43.563474 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488a2dd-2d5b-48e4-95d1-aca3292418f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e18c21513574ee88ee3fa41e29df01b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:43.565491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488a2dd-2d5b-48e4-95d1-aca3292418f3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:43.620961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8488a2dd-2d5b-48e4-95d1-aca3292418f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e18c21513574ee88ee3fa41e29df01b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:43.621629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8488a2dd-2d5b-48e4-95d1-aca3292418f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e18c21513574ee88ee3fa41e29df01b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:43.622266 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8488a2dd-2d5b-48e4-95d1-aca3292418f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e18c21513574ee88ee3fa41e29df01b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:43.629692 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8488a2dd-2d5b-48e4-95d1-aca3292418f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e18c21513574ee88ee3fa41e29df01b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:43.638727 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8488a2dd-2d5b-48e4-95d1-aca3292418f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e18c21513574ee88ee3fa41e29df01b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:43.657243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1282/2576] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:08:43 2022] DELETE /identity/v3/users/0e18c21513574ee88ee3fa41e29df01b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:08:43.994055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:43.995736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:44.009183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5ea56-5a36-421b-80b7-43c9434cb6c8 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:44.088557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:44.102415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0009a-50bb-436d-9dde-cd69aabbc964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:44.103489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0009a-50bb-436d-9dde-cd69aabbc964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:44.104053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0009a-50bb-436d-9dde-cd69aabbc964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:44.104341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0009a-50bb-436d-9dde-cd69aabbc964 admin admin] PATH_INFO: `/v3/projects/777e9412fc5343f9a6da070231fbaf08` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:44.105772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0009a-50bb-436d-9dde-cd69aabbc964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=777e9412fc5343f9a6da070231fbaf08)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:44.108026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0009a-50bb-436d-9dde-cd69aabbc964 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:44.169575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-20d0009a-50bb-436d-9dde-cd69aabbc964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777e9412fc5343f9a6da070231fbaf08', 'request_id': 'req-20d0009a-50bb-436d-9dde-cd69aabbc964'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:44.179991 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-20d0009a-50bb-436d-9dde-cd69aabbc964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777e9412fc5343f9a6da070231fbaf08', 'request_id': 'req-20d0009a-50bb-436d-9dde-cd69aabbc964'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:44.189358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-20d0009a-50bb-436d-9dde-cd69aabbc964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777e9412fc5343f9a6da070231fbaf08', 'request_id': 'req-20d0009a-50bb-436d-9dde-cd69aabbc964'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:44.203054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-20d0009a-50bb-436d-9dde-cd69aabbc964 admin admin] The token cache is being invalidate because project 777e9412fc5343f9a6da070231fbaf08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:08:44.203365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-20d0009a-50bb-436d-9dde-cd69aabbc964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:44.204015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-20d0009a-50bb-436d-9dde-cd69aabbc964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:44.207424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1295/2577] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:08:43 2022] DELETE /identity/v3/projects/777e9412fc5343f9a6da070231fbaf08 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:44.210918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5933c1-d63d-4da3-9539-1cc443dc0a35 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:44.211824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5933c1-d63d-4da3-9539-1cc443dc0a35 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:44.212116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5933c1-d63d-4da3-9539-1cc443dc0a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:44.233940 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0f5933c1-d63d-4da3-9539-1cc443dc0a35 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:44.235233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0f5933c1-d63d-4da3-9539-1cc443dc0a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:44.306749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1283/2578] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:44.316242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae474-04b2-4087-a827-c9a9ab19efae None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:44.316555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae474-04b2-4087-a827-c9a9ab19efae None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:44.316832 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae474-04b2-4087-a827-c9a9ab19efae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:44.339571 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-25dae474-04b2-4087-a827-c9a9ab19efae None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:44.340989 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-25dae474-04b2-4087-a827-c9a9ab19efae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:44.349603 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1296/2579] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:44.354329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5933c1-d63d-4da3-9539-1cc443dc0a35 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:44.364957 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5933c1-d63d-4da3-9539-1cc443dc0a35 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:44.370300 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42810909-0046-4a1e-bddb-06146fc1ad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:44.370971 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42810909-0046-4a1e-bddb-06146fc1ad2a admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:44.371306 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42810909-0046-4a1e-bddb-06146fc1ad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:44.371576 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42810909-0046-4a1e-bddb-06146fc1ad2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:44.372297 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42810909-0046-4a1e-bddb-06146fc1ad2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:08:44.372613 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42810909-0046-4a1e-bddb-06146fc1ad2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:44.374227 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42810909-0046-4a1e-bddb-06146fc1ad2a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:44.391015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1284/2580] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:08:44.396055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dae474-04b2-4087-a827-c9a9ab19efae None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:44.405663 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dae474-04b2-4087-a827-c9a9ab19efae None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:44.410379 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf28846-33f3-46b1-b79f-1092117c62ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:44.411031 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf28846-33f3-46b1-b79f-1092117c62ea admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:44.411308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf28846-33f3-46b1-b79f-1092117c62ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:44.411579 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf28846-33f3-46b1-b79f-1092117c62ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:44.412363 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf28846-33f3-46b1-b79f-1092117c62ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:44.414316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf28846-33f3-46b1-b79f-1092117c62ea admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:44.445815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1297/2581] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:08:44 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:44.450038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42810909-0046-4a1e-bddb-06146fc1ad2a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:44.461165 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42810909-0046-4a1e-bddb-06146fc1ad2a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:44.499483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:44.521366 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08333f-ce2e-40db-b9a4-6680709cbd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:44.521985 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08333f-ce2e-40db-b9a4-6680709cbd3f admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:44.522260 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08333f-ce2e-40db-b9a4-6680709cbd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:44.522535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08333f-ce2e-40db-b9a4-6680709cbd3f admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:44.523285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08333f-ce2e-40db-b9a4-6680709cbd3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:44.525220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08333f-ce2e-40db-b9a4-6680709cbd3f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:44.550511 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1285/2582] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:08:44 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:44.552462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf28846-33f3-46b1-b79f-1092117c62ea admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:44.563780 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf28846-33f3-46b1-b79f-1092117c62ea admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:44.569203 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aec4ac-84d4-4b57-a2f0-c69929626888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:44.569854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aec4ac-84d4-4b57-a2f0-c69929626888 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:44.570118 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aec4ac-84d4-4b57-a2f0-c69929626888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:44.570408 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aec4ac-84d4-4b57-a2f0-c69929626888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:44.571080 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aec4ac-84d4-4b57-a2f0-c69929626888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:44.572737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aec4ac-84d4-4b57-a2f0-c69929626888 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:44.595033 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1298/2583] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:44.595924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08333f-ce2e-40db-b9a4-6680709cbd3f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:44.606582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08333f-ce2e-40db-b9a4-6680709cbd3f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:44.612224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91933e-f9c7-4ddf-9d4a-5c09523e9f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:44.612991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91933e-f9c7-4ddf-9d4a-5c09523e9f7b admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:44.613368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91933e-f9c7-4ddf-9d4a-5c09523e9f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:44.613739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91933e-f9c7-4ddf-9d4a-5c09523e9f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:44.614559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91933e-f9c7-4ddf-9d4a-5c09523e9f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:44.616476 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91933e-f9c7-4ddf-9d4a-5c09523e9f7b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:44.630639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1286/2584] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:08:44.635460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aec4ac-84d4-4b57-a2f0-c69929626888 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:44.659388 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aec4ac-84d4-4b57-a2f0-c69929626888 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:44.669580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26759943-03b4-476d-bc44-c60453499b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:44.670688 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26759943-03b4-476d-bc44-c60453499b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:44.671152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26759943-03b4-476d-bc44-c60453499b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:44.672111 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26759943-03b4-476d-bc44-c60453499b7e admin admin] PATH_INFO: `/v3/projects/76b73eb64df84b4c947c7e929b8cac08/users/e9fac27fd8c04b73b837e6336ad0fa52/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:44.699574 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26759943-03b4-476d-bc44-c60453499b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b73eb64df84b4c947c7e929b8cac08, user_id=e9fac27fd8c04b73b837e6336ad0fa52, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:44.704193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26759943-03b4-476d-bc44-c60453499b7e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:44.746046 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1299/2585] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:44 2022] PUT /identity/v3/projects/76b73eb64df84b4c947c7e929b8cac08/users/e9fac27fd8c04b73b837e6336ad0fa52/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:44.748998 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b429-b527-4d8b-a92d-4ed9f3dbc8f0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:44.750312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b429-b527-4d8b-a92d-4ed9f3dbc8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:44.751725 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b429-b527-4d8b-a92d-4ed9f3dbc8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:44.789750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3ee7b429-b527-4d8b-a92d-4ed9f3dbc8f0 None None] MFA Rules not processed for user `e9fac27fd8c04b73b837e6336ad0fa52`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:44.791151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3ee7b429-b527-4d8b-a92d-4ed9f3dbc8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:44.859138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1287/2586] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:44.863696 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26759943-03b4-476d-bc44-c60453499b7e admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:44.929842 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26759943-03b4-476d-bc44-c60453499b7e admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:44.934752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759778a-5935-4439-9f4d-d3c9790e77a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:44.935371 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759778a-5935-4439-9f4d-d3c9790e77a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:44.935651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759778a-5935-4439-9f4d-d3c9790e77a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:44.935925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759778a-5935-4439-9f4d-d3c9790e77a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:44.936572 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759778a-5935-4439-9f4d-d3c9790e77a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:44.938514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759778a-5935-4439-9f4d-d3c9790e77a6 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:44.970243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1300/2587] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:08:44 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:08:44.971900 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7b429-b527-4d8b-a92d-4ed9f3dbc8f0 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:44.983232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7b429-b527-4d8b-a92d-4ed9f3dbc8f0 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:45.046364 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d473683-9a47-492c-b42b-cb5503992130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:45.047094 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d473683-9a47-492c-b42b-cb5503992130 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:45.047496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d473683-9a47-492c-b42b-cb5503992130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:45.047851 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d473683-9a47-492c-b42b-cb5503992130 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:45.048586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d473683-9a47-492c-b42b-cb5503992130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:45.050676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d473683-9a47-492c-b42b-cb5503992130 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:45.079303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1288/2588] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:08:44 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:45.084063 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759778a-5935-4439-9f4d-d3c9790e77a6 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:45.091834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:45.096497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759778a-5935-4439-9f4d-d3c9790e77a6 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:45.104713 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4c5f-2342-480a-ab43-79d1f14823b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:45.105600 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4c5f-2342-480a-ab43-79d1f14823b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:45.105954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4c5f-2342-480a-ab43-79d1f14823b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:45.106459 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4c5f-2342-480a-ab43-79d1f14823b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:45.107159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d4c5f-2342-480a-ab43-79d1f14823b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:45.108790 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d4c5f-2342-480a-ab43-79d1f14823b3 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:45.122494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1301/2589] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:45.127645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d473683-9a47-492c-b42b-cb5503992130 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:45.137786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d473683-9a47-492c-b42b-cb5503992130 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:45.142571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8635e2e-0fd6-495f-bce5-ce7608192138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:45.143260 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8635e2e-0fd6-495f-bce5-ce7608192138 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:45.143541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8635e2e-0fd6-495f-bce5-ce7608192138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:45.143814 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8635e2e-0fd6-495f-bce5-ce7608192138 admin admin] PATH_INFO: `/v3/projects/c3ca9f86c08d4d26b80686343f122ca2/users/5e7ffbcd3f784c059d2ecb8e6560d9d3/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:45.160231 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8635e2e-0fd6-495f-bce5-ce7608192138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ca9f86c08d4d26b80686343f122ca2, user_id=5e7ffbcd3f784c059d2ecb8e6560d9d3, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:45.163245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8635e2e-0fd6-495f-bce5-ce7608192138 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:45.177076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1289/2590] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:45 2022] PUT /identity/v3/projects/c3ca9f86c08d4d26b80686343f122ca2/users/5e7ffbcd3f784c059d2ecb8e6560d9d3/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:45.181082 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4c5f-2342-480a-ab43-79d1f14823b3 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:45.192126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4c5f-2342-480a-ab43-79d1f14823b3 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:45.269093 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3d9b2-2e13-4853-bf54-cf5061ee02c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:45.269673 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3d9b2-2e13-4853-bf54-cf5061ee02c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:45.269956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3d9b2-2e13-4853-bf54-cf5061ee02c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:45.270274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3d9b2-2e13-4853-bf54-cf5061ee02c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:45.270965 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3d9b2-2e13-4853-bf54-cf5061ee02c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:45.272610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3d9b2-2e13-4853-bf54-cf5061ee02c0 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:45.284005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1302/2591] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:45.288567 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8635e2e-0fd6-495f-bce5-ce7608192138 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:45.299326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8635e2e-0fd6-495f-bce5-ce7608192138 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:45.304517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fe3c6-a09c-400e-9788-290b15763543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:45.305181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fe3c6-a09c-400e-9788-290b15763543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:45.305456 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fe3c6-a09c-400e-9788-290b15763543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:45.305729 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fe3c6-a09c-400e-9788-290b15763543 admin admin] PATH_INFO: `/v3/projects/c3ca9f86c08d4d26b80686343f122ca2/users/5e7ffbcd3f784c059d2ecb8e6560d9d3/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:45.307698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fe3c6-a09c-400e-9788-290b15763543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ca9f86c08d4d26b80686343f122ca2, user_id=5e7ffbcd3f784c059d2ecb8e6560d9d3, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:45.310458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432fe3c6-a09c-400e-9788-290b15763543 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:45.313870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:45.322531 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1290/2592] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:45 2022] PUT /identity/v3/projects/c3ca9f86c08d4d26b80686343f122ca2/users/5e7ffbcd3f784c059d2ecb8e6560d9d3/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:08:45.334565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a1f8f-4f12-4d4e-bd51-d0bb8dc9b9bc None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:45.334946 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a1f8f-4f12-4d4e-bd51-d0bb8dc9b9bc None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:45.335221 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a1f8f-4f12-4d4e-bd51-d0bb8dc9b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:45.364018 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-395a1f8f-4f12-4d4e-bd51-d0bb8dc9b9bc None None] MFA Rules not processed for user `5e7ffbcd3f784c059d2ecb8e6560d9d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:45.365439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-395a1f8f-4f12-4d4e-bd51-d0bb8dc9b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:45.448429 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1303/2593] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:45.458223 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fe3c6-a09c-400e-9788-290b15763543 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:45.460403 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-432fe3c6-a09c-400e-9788-290b15763543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:45.530350 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fe3c6-a09c-400e-9788-290b15763543 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:45.534154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126b15d-0baa-4adb-9048-a1fb4989a109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:45.534847 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126b15d-0baa-4adb-9048-a1fb4989a109 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:45.535119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126b15d-0baa-4adb-9048-a1fb4989a109 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:45.535386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126b15d-0baa-4adb-9048-a1fb4989a109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:45.546095 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126b15d-0baa-4adb-9048-a1fb4989a109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:45.547578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126b15d-0baa-4adb-9048-a1fb4989a109 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:45.558352 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1291/2594] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:45.643789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a1f8f-4f12-4d4e-bd51-d0bb8dc9b9bc None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:45.653469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a1f8f-4f12-4d4e-bd51-d0bb8dc9b9bc None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:45.657174 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b0a96-2fff-487c-9cfa-029acb44731c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:45.657784 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b0a96-2fff-487c-9cfa-029acb44731c service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:45.658064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b0a96-2fff-487c-9cfa-029acb44731c service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:45.658338 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b0a96-2fff-487c-9cfa-029acb44731c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:45.718737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b0a96-2fff-487c-9cfa-029acb44731c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:45.720209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b0a96-2fff-487c-9cfa-029acb44731c service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:45.729334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1304/2595] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:08:48.500341 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126b15d-0baa-4adb-9048-a1fb4989a109 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:48.564414 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126b15d-0baa-4adb-9048-a1fb4989a109 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:48.569088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff164980-cfa0-463f-99ab-84c0afb536d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:48.569765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff164980-cfa0-463f-99ab-84c0afb536d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:48.570206 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff164980-cfa0-463f-99ab-84c0afb536d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:48.570478 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff164980-cfa0-463f-99ab-84c0afb536d6 admin admin] PATH_INFO: `/v3/users/e9fac27fd8c04b73b837e6336ad0fa52` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:48.571720 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff164980-cfa0-463f-99ab-84c0afb536d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9fac27fd8c04b73b837e6336ad0fa52)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:48.573675 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff164980-cfa0-463f-99ab-84c0afb536d6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:48.626891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ff164980-cfa0-463f-99ab-84c0afb536d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9fac27fd8c04b73b837e6336ad0fa52'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:48.627555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ff164980-cfa0-463f-99ab-84c0afb536d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9fac27fd8c04b73b837e6336ad0fa52'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:48.628152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ff164980-cfa0-463f-99ab-84c0afb536d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9fac27fd8c04b73b837e6336ad0fa52'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:48.636404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ff164980-cfa0-463f-99ab-84c0afb536d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9fac27fd8c04b73b837e6336ad0fa52'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:48.644451 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ff164980-cfa0-463f-99ab-84c0afb536d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9fac27fd8c04b73b837e6336ad0fa52'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:48.663251 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1292/2596] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:08:48 2022] DELETE /identity/v3/users/e9fac27fd8c04b73b837e6336ad0fa52 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:48.668242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caa1e8-e21e-4a43-8590-bad963729218 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:48.668773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caa1e8-e21e-4a43-8590-bad963729218 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:48.668773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caa1e8-e21e-4a43-8590-bad963729218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:48.688330 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-54caa1e8-e21e-4a43-8590-bad963729218 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:48.689630 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-54caa1e8-e21e-4a43-8590-bad963729218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:48.699327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:48.754748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1305/2597] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:48.765463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff164980-cfa0-463f-99ab-84c0afb536d6 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:48.767035 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ff164980-cfa0-463f-99ab-84c0afb536d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:48.789511 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:48.836036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff164980-cfa0-463f-99ab-84c0afb536d6 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:48.840145 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1ac20-51b9-4eac-9fc6-cdf1bf6b6d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:48.840747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1ac20-51b9-4eac-9fc6-cdf1bf6b6d0c service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:48.841020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1ac20-51b9-4eac-9fc6-cdf1bf6b6d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:48.841268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1ac20-51b9-4eac-9fc6-cdf1bf6b6d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:48.851397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1ac20-51b9-4eac-9fc6-cdf1bf6b6d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:48.852830 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1ac20-51b9-4eac-9fc6-cdf1bf6b6d0c service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:48.862284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1293/2598] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:49.176309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caa1e8-e21e-4a43-8590-bad963729218 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:49.177874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-54caa1e8-e21e-4a43-8590-bad963729218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:49.190311 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caa1e8-e21e-4a43-8590-bad963729218 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:49.197345 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:49.198001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:49.198284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:49.198624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] PATH_INFO: `/v3/projects/76b73eb64df84b4c947c7e929b8cac08` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:49.199981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b73eb64df84b4c947c7e929b8cac08)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:49.202395 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:49.260065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b73eb64df84b4c947c7e929b8cac08', 'request_id': 'req-ff9fec2e-f27d-4463-80ae-80ef52de0026'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.268467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b73eb64df84b4c947c7e929b8cac08', 'request_id': 'req-ff9fec2e-f27d-4463-80ae-80ef52de0026'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.275307 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b73eb64df84b4c947c7e929b8cac08', 'request_id': 'req-ff9fec2e-f27d-4463-80ae-80ef52de0026'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.286054 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] The token cache is being invalidate because project 76b73eb64df84b4c947c7e929b8cac08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:08:49.286339 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.286989 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.288503 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1306/2599] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:08:49 2022] DELETE /identity/v3/projects/76b73eb64df84b4c947c7e929b8cac08 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:49.292529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1ac20-51b9-4eac-9fc6-cdf1bf6b6d0c service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:49.302483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1ac20-51b9-4eac-9fc6-cdf1bf6b6d0c service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:49.363052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2faf7b-e1f7-43ed-9aeb-80ede3034953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:49.363685 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2faf7b-e1f7-43ed-9aeb-80ede3034953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:49.363997 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2faf7b-e1f7-43ed-9aeb-80ede3034953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:49.364250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2faf7b-e1f7-43ed-9aeb-80ede3034953 admin admin] PATH_INFO: `/v3/users/5e7ffbcd3f784c059d2ecb8e6560d9d3` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:49.365475 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2faf7b-e1f7-43ed-9aeb-80ede3034953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7ffbcd3f784c059d2ecb8e6560d9d3)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:49.367475 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2faf7b-e1f7-43ed-9aeb-80ede3034953 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:49.417034 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2e2faf7b-e1f7-43ed-9aeb-80ede3034953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7ffbcd3f784c059d2ecb8e6560d9d3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.417698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2e2faf7b-e1f7-43ed-9aeb-80ede3034953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7ffbcd3f784c059d2ecb8e6560d9d3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.418287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2e2faf7b-e1f7-43ed-9aeb-80ede3034953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7ffbcd3f784c059d2ecb8e6560d9d3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.425037 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2e2faf7b-e1f7-43ed-9aeb-80ede3034953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7ffbcd3f784c059d2ecb8e6560d9d3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.432249 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2e2faf7b-e1f7-43ed-9aeb-80ede3034953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7ffbcd3f784c059d2ecb8e6560d9d3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.449394 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1294/2600] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:08:49 2022] DELETE /identity/v3/users/5e7ffbcd3f784c059d2ecb8e6560d9d3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:49.738510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:49.740323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:49.755428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fec2e-f27d-4463-80ae-80ef52de0026 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:49.818302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f59d56-24d7-4444-be76-cbf63adf67d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:49.818912 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f59d56-24d7-4444-be76-cbf63adf67d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:49.819191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f59d56-24d7-4444-be76-cbf63adf67d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:49.819463 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f59d56-24d7-4444-be76-cbf63adf67d3 admin admin] PATH_INFO: `/v3/projects/c3ca9f86c08d4d26b80686343f122ca2` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:49.820632 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f59d56-24d7-4444-be76-cbf63adf67d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3ca9f86c08d4d26b80686343f122ca2)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:49.822539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f59d56-24d7-4444-be76-cbf63adf67d3 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:49.874821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:49.883223 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b1f59d56-24d7-4444-be76-cbf63adf67d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ca9f86c08d4d26b80686343f122ca2', 'request_id': 'req-b1f59d56-24d7-4444-be76-cbf63adf67d3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.892610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b1f59d56-24d7-4444-be76-cbf63adf67d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ca9f86c08d4d26b80686343f122ca2', 'request_id': 'req-b1f59d56-24d7-4444-be76-cbf63adf67d3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.900953 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b1f59d56-24d7-4444-be76-cbf63adf67d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ca9f86c08d4d26b80686343f122ca2', 'request_id': 'req-b1f59d56-24d7-4444-be76-cbf63adf67d3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.913473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b1f59d56-24d7-4444-be76-cbf63adf67d3 admin admin] The token cache is being invalidate because project c3ca9f86c08d4d26b80686343f122ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:08:49.913767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b1f59d56-24d7-4444-be76-cbf63adf67d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.914570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b1f59d56-24d7-4444-be76-cbf63adf67d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:49.916252 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1307/2601] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:08:49 2022] DELETE /identity/v3/projects/c3ca9f86c08d4d26b80686343f122ca2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:49.921333 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24e377-d18a-4e41-8f32-9d6fa8a67262 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:49.921867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24e377-d18a-4e41-8f32-9d6fa8a67262 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:49.921977 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24e377-d18a-4e41-8f32-9d6fa8a67262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:49.943840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8a24e377-d18a-4e41-8f32-9d6fa8a67262 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:49.945057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8a24e377-d18a-4e41-8f32-9d6fa8a67262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:49.978957 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:50.007709 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1295/2602] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:50.015721 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9f1a5-6ff9-4a2c-ada3-67729f0fd254 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.016002 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9f1a5-6ff9-4a2c-ada3-67729f0fd254 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.016274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9f1a5-6ff9-4a2c-ada3-67729f0fd254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.036680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-87a9f1a5-6ff9-4a2c-ada3-67729f0fd254 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:50.037895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-87a9f1a5-6ff9-4a2c-ada3-67729f0fd254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:50.046641 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1308/2603] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:50.051152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24e377-d18a-4e41-8f32-9d6fa8a67262 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:50.061727 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24e377-d18a-4e41-8f32-9d6fa8a67262 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:50.066323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f4c4e-7cf2-414c-8778-e87ddc7c892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:50.066955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f4c4e-7cf2-414c-8778-e87ddc7c892a admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.067235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f4c4e-7cf2-414c-8778-e87ddc7c892a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.067509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f4c4e-7cf2-414c-8778-e87ddc7c892a admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.068160 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f4c4e-7cf2-414c-8778-e87ddc7c892a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:08:50.068511 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f4c4e-7cf2-414c-8778-e87ddc7c892a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:50.070077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f4c4e-7cf2-414c-8778-e87ddc7c892a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:50.085505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1296/2604] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:08:50.090115 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9f1a5-6ff9-4a2c-ada3-67729f0fd254 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:50.100527 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9f1a5-6ff9-4a2c-ada3-67729f0fd254 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:50.106908 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985308d4-c1cd-4533-b286-01786d0042be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:50.107512 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985308d4-c1cd-4533-b286-01786d0042be admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.107790 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985308d4-c1cd-4533-b286-01786d0042be admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.108064 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985308d4-c1cd-4533-b286-01786d0042be admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.108691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985308d4-c1cd-4533-b286-01786d0042be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:50.110635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985308d4-c1cd-4533-b286-01786d0042be admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:50.140929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1309/2605] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:08:50 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:50.145295 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f4c4e-7cf2-414c-8778-e87ddc7c892a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:50.155740 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f4c4e-7cf2-414c-8778-e87ddc7c892a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:50.213344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf23e7-9441-46a3-b268-33e4803b483a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:50.213955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf23e7-9441-46a3-b268-33e4803b483a admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.214239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf23e7-9441-46a3-b268-33e4803b483a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.214513 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf23e7-9441-46a3-b268-33e4803b483a admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.215179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf23e7-9441-46a3-b268-33e4803b483a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:50.217168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf23e7-9441-46a3-b268-33e4803b483a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:50.240060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1297/2606] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:08:50 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:50.245513 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985308d4-c1cd-4533-b286-01786d0042be admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:50.258107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985308d4-c1cd-4533-b286-01786d0042be admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:50.262933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349016c-6384-44ab-9ff9-d5b705589b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:50.263913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349016c-6384-44ab-9ff9-d5b705589b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.263913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349016c-6384-44ab-9ff9-d5b705589b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.264126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349016c-6384-44ab-9ff9-d5b705589b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.264798 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349016c-6384-44ab-9ff9-d5b705589b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:50.266432 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349016c-6384-44ab-9ff9-d5b705589b42 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:50.277085 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1310/2607] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:50.281482 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf23e7-9441-46a3-b268-33e4803b483a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:50.295695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf23e7-9441-46a3-b268-33e4803b483a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:50.303140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f7a39-4312-495c-91b6-793f369047fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:50.303823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f7a39-4312-495c-91b6-793f369047fc admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.304097 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f7a39-4312-495c-91b6-793f369047fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.304367 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f7a39-4312-495c-91b6-793f369047fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.305075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f7a39-4312-495c-91b6-793f369047fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:50.306712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f7a39-4312-495c-91b6-793f369047fc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:50.319372 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1298/2608] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:08:50.323639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349016c-6384-44ab-9ff9-d5b705589b42 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:50.339558 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349016c-6384-44ab-9ff9-d5b705589b42 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:50.344469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e76dd-58ec-42cc-9f68-345daccd52d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:50.345137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e76dd-58ec-42cc-9f68-345daccd52d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.345417 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e76dd-58ec-42cc-9f68-345daccd52d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.345932 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e76dd-58ec-42cc-9f68-345daccd52d2 admin admin] PATH_INFO: `/v3/projects/dccbcb89394643d49942fb51eaeb679d/users/ebd645f2d2fa4c98ae54adb9aac8e344/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.361661 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e76dd-58ec-42cc-9f68-345daccd52d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dccbcb89394643d49942fb51eaeb679d, user_id=ebd645f2d2fa4c98ae54adb9aac8e344, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:50.364486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e76dd-58ec-42cc-9f68-345daccd52d2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:50.379652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1311/2609] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:50 2022] PUT /identity/v3/projects/dccbcb89394643d49942fb51eaeb679d/users/ebd645f2d2fa4c98ae54adb9aac8e344/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:08:50.390047 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4851b7d-bf31-421f-8c9a-9d7bf8c9fd3d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.390340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4851b7d-bf31-421f-8c9a-9d7bf8c9fd3d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.390624 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4851b7d-bf31-421f-8c9a-9d7bf8c9fd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.420085 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a4851b7d-bf31-421f-8c9a-9d7bf8c9fd3d None None] MFA Rules not processed for user `ebd645f2d2fa4c98ae54adb9aac8e344`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:50.421318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a4851b7d-bf31-421f-8c9a-9d7bf8c9fd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:50.485502 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1299/2610] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:50.490245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e76dd-58ec-42cc-9f68-345daccd52d2 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:50.567986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e76dd-58ec-42cc-9f68-345daccd52d2 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:50.573332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2ed84-49e9-4f14-879a-019345c78f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:50.574001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2ed84-49e9-4f14-879a-019345c78f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.574469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2ed84-49e9-4f14-879a-019345c78f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.574789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2ed84-49e9-4f14-879a-019345c78f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.575463 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2ed84-49e9-4f14-879a-019345c78f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:50.577771 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2ed84-49e9-4f14-879a-019345c78f09 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:50.610447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1312/2611] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:08:50 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:50.611760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4851b7d-bf31-421f-8c9a-9d7bf8c9fd3d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:50.623043 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4851b7d-bf31-421f-8c9a-9d7bf8c9fd3d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:50.656887 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:50.683697 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43828270-8a51-4394-93b4-282638c63d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:50.684307 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43828270-8a51-4394-93b4-282638c63d0c admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.684587 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43828270-8a51-4394-93b4-282638c63d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.684861 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43828270-8a51-4394-93b4-282638c63d0c admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.685502 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43828270-8a51-4394-93b4-282638c63d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:50.687890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43828270-8a51-4394-93b4-282638c63d0c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:50.713101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1300/2612] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:08:50 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:08:50.717188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2ed84-49e9-4f14-879a-019345c78f09 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:50.729640 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2ed84-49e9-4f14-879a-019345c78f09 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:50.734732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee45af0-d268-4d3a-a59a-7a0656d19921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:50.735761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee45af0-d268-4d3a-a59a-7a0656d19921 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.735907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee45af0-d268-4d3a-a59a-7a0656d19921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.736243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee45af0-d268-4d3a-a59a-7a0656d19921 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.737035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee45af0-d268-4d3a-a59a-7a0656d19921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:50.738872 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee45af0-d268-4d3a-a59a-7a0656d19921 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:50.751580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1313/2613] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:50.756030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43828270-8a51-4394-93b4-282638c63d0c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:50.767751 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43828270-8a51-4394-93b4-282638c63d0c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:50.774311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b789a-4188-4ca4-bd6d-2cd8624db546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:50.775219 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b789a-4188-4ca4-bd6d-2cd8624db546 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.775502 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b789a-4188-4ca4-bd6d-2cd8624db546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.775782 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b789a-4188-4ca4-bd6d-2cd8624db546 admin admin] PATH_INFO: `/v3/projects/098080773324458882176209ff213555/users/057a7b80a5d943ebac6f4705fa1dddca/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.792003 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b789a-4188-4ca4-bd6d-2cd8624db546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098080773324458882176209ff213555, user_id=057a7b80a5d943ebac6f4705fa1dddca, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:50.795074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b789a-4188-4ca4-bd6d-2cd8624db546 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:50.810641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1301/2614] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:50 2022] PUT /identity/v3/projects/098080773324458882176209ff213555/users/057a7b80a5d943ebac6f4705fa1dddca/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:50.814565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee45af0-d268-4d3a-a59a-7a0656d19921 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:50.827243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee45af0-d268-4d3a-a59a-7a0656d19921 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:50.862683 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:50.888284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d856f-1254-41b1-b0cc-8366172e05cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:50.888987 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d856f-1254-41b1-b0cc-8366172e05cc admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.889266 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d856f-1254-41b1-b0cc-8366172e05cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.889641 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d856f-1254-41b1-b0cc-8366172e05cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.890467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d856f-1254-41b1-b0cc-8366172e05cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:50.892245 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d856f-1254-41b1-b0cc-8366172e05cc admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:50.906856 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1314/2615] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:08:50.907913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b789a-4188-4ca4-bd6d-2cd8624db546 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:50.920141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b789a-4188-4ca4-bd6d-2cd8624db546 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:50.924973 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ba748-ebb6-4c52-b91b-e94621953aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:50.925964 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba748-ebb6-4c52-b91b-e94621953aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.926290 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba748-ebb6-4c52-b91b-e94621953aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.926709 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba748-ebb6-4c52-b91b-e94621953aa0 admin admin] PATH_INFO: `/v3/projects/098080773324458882176209ff213555/users/057a7b80a5d943ebac6f4705fa1dddca/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.928894 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ba748-ebb6-4c52-b91b-e94621953aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098080773324458882176209ff213555, user_id=057a7b80a5d943ebac6f4705fa1dddca, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:50.932254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ba748-ebb6-4c52-b91b-e94621953aa0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:50.945701 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1302/2616] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:50 2022] PUT /identity/v3/projects/098080773324458882176209ff213555/users/057a7b80a5d943ebac6f4705fa1dddca/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:08:50.957580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3b311-ea29-44aa-97a3-27ef83c5b2e2 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:50.957870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3b311-ea29-44aa-97a3-27ef83c5b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:50.958144 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3b311-ea29-44aa-97a3-27ef83c5b2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:50.988044 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-38e3b311-ea29-44aa-97a3-27ef83c5b2e2 None None] MFA Rules not processed for user `057a7b80a5d943ebac6f4705fa1dddca`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:50.989270 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-38e3b311-ea29-44aa-97a3-27ef83c5b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:51.074440 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1315/2617] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:51.086121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ba748-ebb6-4c52-b91b-e94621953aa0 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:51.088239 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-444ba748-ebb6-4c52-b91b-e94621953aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:51.147966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ba748-ebb6-4c52-b91b-e94621953aa0 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:51.152285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb6004-ec24-4cf0-b5f9-b98a37ed9e79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:51.152890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb6004-ec24-4cf0-b5f9-b98a37ed9e79 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:51.153163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb6004-ec24-4cf0-b5f9-b98a37ed9e79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:51.153432 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb6004-ec24-4cf0-b5f9-b98a37ed9e79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:51.163268 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb6004-ec24-4cf0-b5f9-b98a37ed9e79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:51.164704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb6004-ec24-4cf0-b5f9-b98a37ed9e79 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:51.174314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1303/2618] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:51.826824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3b311-ea29-44aa-97a3-27ef83c5b2e2 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:51.905580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3b311-ea29-44aa-97a3-27ef83c5b2e2 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:51.910934 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625e257-1249-4fe6-89b3-7e1649723eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:51.911566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e257-1249-4fe6-89b3-7e1649723eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:51.911847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e257-1249-4fe6-89b3-7e1649723eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:51.912121 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625e257-1249-4fe6-89b3-7e1649723eb2 admin admin] PATH_INFO: `/v3/users/ebd645f2d2fa4c98ae54adb9aac8e344` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:51.913334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625e257-1249-4fe6-89b3-7e1649723eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd645f2d2fa4c98ae54adb9aac8e344)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:51.917170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625e257-1249-4fe6-89b3-7e1649723eb2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:51.968841 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e625e257-1249-4fe6-89b3-7e1649723eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd645f2d2fa4c98ae54adb9aac8e344'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:51.983583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:51.986610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e625e257-1249-4fe6-89b3-7e1649723eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd645f2d2fa4c98ae54adb9aac8e344'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:51.997385 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e625e257-1249-4fe6-89b3-7e1649723eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd645f2d2fa4c98ae54adb9aac8e344'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:52.006647 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e625e257-1249-4fe6-89b3-7e1649723eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd645f2d2fa4c98ae54adb9aac8e344'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:52.007518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-e625e257-1249-4fe6-89b3-7e1649723eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd645f2d2fa4c98ae54adb9aac8e344'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:52.019222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1316/2619] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:08:51 2022] DELETE /identity/v3/users/ebd645f2d2fa4c98ae54adb9aac8e344 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:52.024316 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e7a5e-0a3f-46ae-95d2-b9d5d1f1f9a9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:52.024807 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e7a5e-0a3f-46ae-95d2-b9d5d1f1f9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:52.024926 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e7a5e-0a3f-46ae-95d2-b9d5d1f1f9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:52.045369 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5c3e7a5e-0a3f-46ae-95d2-b9d5d1f1f9a9 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:52.046621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5c3e7a5e-0a3f-46ae-95d2-b9d5d1f1f9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:52.112718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1304/2620] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:52.127721 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625e257-1249-4fe6-89b3-7e1649723eb2 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:52.130264 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e625e257-1249-4fe6-89b3-7e1649723eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:52.203680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625e257-1249-4fe6-89b3-7e1649723eb2 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:52.207913 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31739760-4389-44ca-8977-96b98df1dd5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:52.208531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31739760-4389-44ca-8977-96b98df1dd5a service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:52.208809 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31739760-4389-44ca-8977-96b98df1dd5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:52.209173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31739760-4389-44ca-8977-96b98df1dd5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:52.218816 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31739760-4389-44ca-8977-96b98df1dd5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:52.220254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31739760-4389-44ca-8977-96b98df1dd5a service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:52.232509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1317/2621] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:52.515088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e7a5e-0a3f-46ae-95d2-b9d5d1f1f9a9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:52.516599 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5c3e7a5e-0a3f-46ae-95d2-b9d5d1f1f9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:52.528785 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e7a5e-0a3f-46ae-95d2-b9d5d1f1f9a9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:52.534059 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:52.535488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:52.535762 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:52.536031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] PATH_INFO: `/v3/projects/dccbcb89394643d49942fb51eaeb679d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:52.537573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dccbcb89394643d49942fb51eaeb679d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:52.540668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:52.575044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:52.599491 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dccbcb89394643d49942fb51eaeb679d', 'request_id': 'req-c62eef01-4432-4608-892d-e3ae493d4625'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:52.605713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dccbcb89394643d49942fb51eaeb679d', 'request_id': 'req-c62eef01-4432-4608-892d-e3ae493d4625'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:52.615660 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dccbcb89394643d49942fb51eaeb679d', 'request_id': 'req-c62eef01-4432-4608-892d-e3ae493d4625'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:52.630301 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] The token cache is being invalidate because project dccbcb89394643d49942fb51eaeb679d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:08:52.630618 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:52.631483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:52.633380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1305/2622] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:08:52 2022] DELETE /identity/v3/projects/dccbcb89394643d49942fb51eaeb679d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:52.637404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31739760-4389-44ca-8977-96b98df1dd5a service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:52.651412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31739760-4389-44ca-8977-96b98df1dd5a service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:52.716317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cdb62-d1f2-43f5-9985-858bee705809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:52.717080 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cdb62-d1f2-43f5-9985-858bee705809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:52.717455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cdb62-d1f2-43f5-9985-858bee705809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:52.717818 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cdb62-d1f2-43f5-9985-858bee705809 admin admin] PATH_INFO: `/v3/users/057a7b80a5d943ebac6f4705fa1dddca` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:52.719094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469cdb62-d1f2-43f5-9985-858bee705809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=057a7b80a5d943ebac6f4705fa1dddca)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:52.721381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469cdb62-d1f2-43f5-9985-858bee705809 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:52.791161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-469cdb62-d1f2-43f5-9985-858bee705809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '057a7b80a5d943ebac6f4705fa1dddca'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:52.803664 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-469cdb62-d1f2-43f5-9985-858bee705809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '057a7b80a5d943ebac6f4705fa1dddca'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:52.812126 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-469cdb62-d1f2-43f5-9985-858bee705809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '057a7b80a5d943ebac6f4705fa1dddca'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:52.819405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-469cdb62-d1f2-43f5-9985-858bee705809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '057a7b80a5d943ebac6f4705fa1dddca'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:52.820179 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-469cdb62-d1f2-43f5-9985-858bee705809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '057a7b80a5d943ebac6f4705fa1dddca'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:52.824179 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:52.827069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1318/2623] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:08:52 2022] DELETE /identity/v3/users/057a7b80a5d943ebac6f4705fa1dddca => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:08:53.113823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:53.115358 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:53.129307 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62eef01-4432-4608-892d-e3ae493d4625 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:53.197124 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606a224-df04-4efd-97d7-0c7b00a2529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:53.199582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606a224-df04-4efd-97d7-0c7b00a2529d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:53.199582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606a224-df04-4efd-97d7-0c7b00a2529d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:53.199582 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606a224-df04-4efd-97d7-0c7b00a2529d admin admin] PATH_INFO: `/v3/projects/098080773324458882176209ff213555` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:53.200687 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606a224-df04-4efd-97d7-0c7b00a2529d admin admin] RBAC: Authorizing `identity:delete_project(project_id=098080773324458882176209ff213555)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:53.202647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606a224-df04-4efd-97d7-0c7b00a2529d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:53.255354 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0606a224-df04-4efd-97d7-0c7b00a2529d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098080773324458882176209ff213555', 'request_id': 'req-0606a224-df04-4efd-97d7-0c7b00a2529d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:53.261118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0606a224-df04-4efd-97d7-0c7b00a2529d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098080773324458882176209ff213555', 'request_id': 'req-0606a224-df04-4efd-97d7-0c7b00a2529d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:53.269477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0606a224-df04-4efd-97d7-0c7b00a2529d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098080773324458882176209ff213555', 'request_id': 'req-0606a224-df04-4efd-97d7-0c7b00a2529d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:53.281677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0606a224-df04-4efd-97d7-0c7b00a2529d admin admin] The token cache is being invalidate because project 098080773324458882176209ff213555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:08:53.281966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0606a224-df04-4efd-97d7-0c7b00a2529d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:53.282806 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0606a224-df04-4efd-97d7-0c7b00a2529d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:08:53.284428 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1306/2624] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:08:53 2022] DELETE /identity/v3/projects/098080773324458882176209ff213555 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:53.289474 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22298dc1-fce5-4aa5-a1ee-6b989c7a30ca None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:53.289754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22298dc1-fce5-4aa5-a1ee-6b989c7a30ca None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:53.290021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22298dc1-fce5-4aa5-a1ee-6b989c7a30ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:53.311749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-22298dc1-fce5-4aa5-a1ee-6b989c7a30ca None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:53.313298 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-22298dc1-fce5-4aa5-a1ee-6b989c7a30ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:53.374916 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1319/2625] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:53.383158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bca1d4-d659-4462-a399-4f9ee98d8654 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:53.383486 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bca1d4-d659-4462-a399-4f9ee98d8654 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:53.383965 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bca1d4-d659-4462-a399-4f9ee98d8654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:53.404296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c5bca1d4-d659-4462-a399-4f9ee98d8654 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:53.405518 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c5bca1d4-d659-4462-a399-4f9ee98d8654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:53.414717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1307/2626] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:53.419397 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22298dc1-fce5-4aa5-a1ee-6b989c7a30ca None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:53.429456 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22298dc1-fce5-4aa5-a1ee-6b989c7a30ca None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:53.434680 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6ef24-655c-400e-9f4a-e4ea85b85841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:53.435287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ef24-655c-400e-9f4a-e4ea85b85841 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:53.435598 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ef24-655c-400e-9f4a-e4ea85b85841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:53.435864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ef24-655c-400e-9f4a-e4ea85b85841 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:53.436515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6ef24-655c-400e-9f4a-e4ea85b85841 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:08:53.436815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6ef24-655c-400e-9f4a-e4ea85b85841 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:53.438391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6ef24-655c-400e-9f4a-e4ea85b85841 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:53.450355 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1320/2627] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:08:53.455244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bca1d4-d659-4462-a399-4f9ee98d8654 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:53.464688 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bca1d4-d659-4462-a399-4f9ee98d8654 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:53.469618 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dfc67-e47f-4ded-91e0-af88f8fec648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:53.470219 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dfc67-e47f-4ded-91e0-af88f8fec648 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:53.470497 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dfc67-e47f-4ded-91e0-af88f8fec648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:53.470808 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dfc67-e47f-4ded-91e0-af88f8fec648 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:53.471436 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dfc67-e47f-4ded-91e0-af88f8fec648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:53.473341 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dfc67-e47f-4ded-91e0-af88f8fec648 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:53.508811 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1308/2628] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:08:53 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:08:53.513465 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6ef24-655c-400e-9f4a-e4ea85b85841 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:53.523976 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6ef24-655c-400e-9f4a-e4ea85b85841 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:53.590537 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234e98c-8ca0-4284-8572-c53d680c05dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:53.591168 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234e98c-8ca0-4284-8572-c53d680c05dc admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:53.591446 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234e98c-8ca0-4284-8572-c53d680c05dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:53.591722 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234e98c-8ca0-4284-8572-c53d680c05dc admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:53.592349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234e98c-8ca0-4284-8572-c53d680c05dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:53.594323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234e98c-8ca0-4284-8572-c53d680c05dc admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:53.620653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1321/2629] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:08:53 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:53.621991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dfc67-e47f-4ded-91e0-af88f8fec648 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:53.632577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dfc67-e47f-4ded-91e0-af88f8fec648 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:53.637517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881425f-e60b-44b1-ab30-746d698c648c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:53.638125 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881425f-e60b-44b1-ab30-746d698c648c admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:53.638371 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881425f-e60b-44b1-ab30-746d698c648c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:53.638680 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881425f-e60b-44b1-ab30-746d698c648c admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:53.639358 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881425f-e60b-44b1-ab30-746d698c648c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:53.640975 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881425f-e60b-44b1-ab30-746d698c648c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:53.651606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1309/2630] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:53.655672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234e98c-8ca0-4284-8572-c53d680c05dc admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:53.666348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234e98c-8ca0-4284-8572-c53d680c05dc admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:53.671821 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8135fea-4f2a-4678-a311-ce873f5d4720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:53.672419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8135fea-4f2a-4678-a311-ce873f5d4720 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:53.672701 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8135fea-4f2a-4678-a311-ce873f5d4720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:53.672966 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8135fea-4f2a-4678-a311-ce873f5d4720 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:53.673608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8135fea-4f2a-4678-a311-ce873f5d4720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:53.675267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8135fea-4f2a-4678-a311-ce873f5d4720 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:53.688033 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1322/2631] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:08:53.690968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881425f-e60b-44b1-ab30-746d698c648c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:53.697563 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:53.702152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881425f-e60b-44b1-ab30-746d698c648c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:53.708739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bd6f6-13e5-4fc8-8af7-252d95e85b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:53.709495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bd6f6-13e5-4fc8-8af7-252d95e85b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:53.709984 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bd6f6-13e5-4fc8-8af7-252d95e85b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:53.710479 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bd6f6-13e5-4fc8-8af7-252d95e85b46 admin admin] PATH_INFO: `/v3/projects/e43c1425c15a42b98fc223bef22a8842/users/80984ce244624787bfda0ea94ef0b77e/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:53.731746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bd6f6-13e5-4fc8-8af7-252d95e85b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43c1425c15a42b98fc223bef22a8842, user_id=80984ce244624787bfda0ea94ef0b77e, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:53.735558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bd6f6-13e5-4fc8-8af7-252d95e85b46 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:53.751169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1310/2632] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:53 2022] PUT /identity/v3/projects/e43c1425c15a42b98fc223bef22a8842/users/80984ce244624787bfda0ea94ef0b77e/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:53.756531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a911e0b-b4d2-492a-ae56-af72d1540774 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:53.756864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a911e0b-b4d2-492a-ae56-af72d1540774 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:53.757193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a911e0b-b4d2-492a-ae56-af72d1540774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:53.777542 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-2a911e0b-b4d2-492a-ae56-af72d1540774 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:53.778800 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-2a911e0b-b4d2-492a-ae56-af72d1540774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:53.841357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1323/2633] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:53.851066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bd6f6-13e5-4fc8-8af7-252d95e85b46 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:53.852970 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-455bd6f6-13e5-4fc8-8af7-252d95e85b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:53.913577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bd6f6-13e5-4fc8-8af7-252d95e85b46 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:53.917283 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a0758-3393-4b86-8eda-ec269dfac79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:53.917896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a0758-3393-4b86-8eda-ec269dfac79a service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:53.918173 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a0758-3393-4b86-8eda-ec269dfac79a service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:53.918443 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a0758-3393-4b86-8eda-ec269dfac79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:53.937683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a0758-3393-4b86-8eda-ec269dfac79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:53.939753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a0758-3393-4b86-8eda-ec269dfac79a service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:53.951954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1311/2634] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:54.728321 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a54956-c69b-4b18-a68f-e522d1c3a3c1 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:54.728610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a54956-c69b-4b18-a68f-e522d1c3a3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:54.728998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a54956-c69b-4b18-a68f-e522d1c3a3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:54.747233 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:54.766558 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c0a54956-c69b-4b18-a68f-e522d1c3a3c1 None None] MFA Rules not processed for user `80984ce244624787bfda0ea94ef0b77e`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:54.767834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c0a54956-c69b-4b18-a68f-e522d1c3a3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:54.849045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1324/2635] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:54.855190 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a0758-3393-4b86-8eda-ec269dfac79a service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:54.865489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a0758-3393-4b86-8eda-ec269dfac79a service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:54.870338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d697bd2-acdf-4cec-961b-ade43b198de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:54.870983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697bd2-acdf-4cec-961b-ade43b198de2 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:54.871265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697bd2-acdf-4cec-961b-ade43b198de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:54.871645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d697bd2-acdf-4cec-961b-ade43b198de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:54.872274 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d697bd2-acdf-4cec-961b-ade43b198de2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:54.874776 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d697bd2-acdf-4cec-961b-ade43b198de2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:54.906231 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1312/2636] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:08:54 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:54.911558 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a54956-c69b-4b18-a68f-e522d1c3a3c1 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:54.926507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a54956-c69b-4b18-a68f-e522d1c3a3c1 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:54.988980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c59bbd-c00e-47a1-8dcd-737e539156fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:54.989629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c59bbd-c00e-47a1-8dcd-737e539156fe admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:54.989931 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c59bbd-c00e-47a1-8dcd-737e539156fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:54.990204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c59bbd-c00e-47a1-8dcd-737e539156fe admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:54.990982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c59bbd-c00e-47a1-8dcd-737e539156fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:54.992982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c59bbd-c00e-47a1-8dcd-737e539156fe admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:55.018097 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1325/2637] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:08:54 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:08:55.022159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d697bd2-acdf-4cec-961b-ade43b198de2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:55.032646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d697bd2-acdf-4cec-961b-ade43b198de2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:55.037447 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c7d96-349a-40e9-9891-80b64672aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:55.038038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7d96-349a-40e9-9891-80b64672aad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:55.038315 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7d96-349a-40e9-9891-80b64672aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:55.038584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7d96-349a-40e9-9891-80b64672aad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:55.039281 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c7d96-349a-40e9-9891-80b64672aad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:55.040876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c7d96-349a-40e9-9891-80b64672aad5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:55.051804 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1313/2638] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:55.056277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c59bbd-c00e-47a1-8dcd-737e539156fe admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:55.067039 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c59bbd-c00e-47a1-8dcd-737e539156fe admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:55.072317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc88d28-4da9-47cf-aab5-4416095e556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:55.072976 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc88d28-4da9-47cf-aab5-4416095e556c admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:55.073252 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc88d28-4da9-47cf-aab5-4416095e556c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:55.073518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc88d28-4da9-47cf-aab5-4416095e556c admin admin] PATH_INFO: `/v3/projects/ee89a20b7dfb455da43b204ff6667520/users/0ad25fe885f8491ba6d651d4dd85e0c6/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:55.090702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc88d28-4da9-47cf-aab5-4416095e556c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee89a20b7dfb455da43b204ff6667520, user_id=0ad25fe885f8491ba6d651d4dd85e0c6, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:55.093380 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc88d28-4da9-47cf-aab5-4416095e556c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:55.106961 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1326/2639] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:55 2022] PUT /identity/v3/projects/ee89a20b7dfb455da43b204ff6667520/users/0ad25fe885f8491ba6d651d4dd85e0c6/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:08:55.111057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c7d96-349a-40e9-9891-80b64672aad5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:55.121693 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c7d96-349a-40e9-9891-80b64672aad5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:55.186205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a169bc2-2c13-4574-895e-a4ac0fb85df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:55.186844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a169bc2-2c13-4574-895e-a4ac0fb85df4 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:55.187117 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a169bc2-2c13-4574-895e-a4ac0fb85df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:55.187387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a169bc2-2c13-4574-895e-a4ac0fb85df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:55.187999 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a169bc2-2c13-4574-895e-a4ac0fb85df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:55.189578 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a169bc2-2c13-4574-895e-a4ac0fb85df4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:55.199462 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1314/2640] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:08:55.204209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc88d28-4da9-47cf-aab5-4416095e556c admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:55.215160 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc88d28-4da9-47cf-aab5-4416095e556c admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:55.220235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc83f22-0455-47bd-90ae-2f05f67ef665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:55.220875 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc83f22-0455-47bd-90ae-2f05f67ef665 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:55.221146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc83f22-0455-47bd-90ae-2f05f67ef665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:55.221415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc83f22-0455-47bd-90ae-2f05f67ef665 admin admin] PATH_INFO: `/v3/projects/ee89a20b7dfb455da43b204ff6667520/users/0ad25fe885f8491ba6d651d4dd85e0c6/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:55.223415 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc83f22-0455-47bd-90ae-2f05f67ef665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee89a20b7dfb455da43b204ff6667520, user_id=0ad25fe885f8491ba6d651d4dd85e0c6, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:55.226087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc83f22-0455-47bd-90ae-2f05f67ef665 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:55.237416 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1327/2641] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:08:55 2022] PUT /identity/v3/projects/ee89a20b7dfb455da43b204ff6667520/users/0ad25fe885f8491ba6d651d4dd85e0c6/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:08:55.895730 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7ff0-a88c-4387-a963-c001cd56ccf1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:55.896850 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7ff0-a88c-4387-a963-c001cd56ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:55.897136 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad7ff0-a88c-4387-a963-c001cd56ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:55.928157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0bad7ff0-a88c-4387-a963-c001cd56ccf1 None None] MFA Rules not processed for user `0ad25fe885f8491ba6d651d4dd85e0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:55.929432 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0bad7ff0-a88c-4387-a963-c001cd56ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:55.967572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:56.010966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1315/2642] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:56.021812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40317172-dd22-4da4-90fd-9c1a6a676577 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:56.022332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40317172-dd22-4da4-90fd-9c1a6a676577 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:56.022332 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40317172-dd22-4da4-90fd-9c1a6a676577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:56.041934 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-40317172-dd22-4da4-90fd-9c1a6a676577 None None] MFA Rules not processed for user `80984ce244624787bfda0ea94ef0b77e`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:08:56.043260 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-40317172-dd22-4da4-90fd-9c1a6a676577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:56.097551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:08:56.110404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1328/2643] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:08:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:08:56.121568 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad7ff0-a88c-4387-a963-c001cd56ccf1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:56.123126 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0bad7ff0-a88c-4387-a963-c001cd56ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:56.201944 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad7ff0-a88c-4387-a963-c001cd56ccf1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:56.208332 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6c5fd-5aad-4530-a15b-ea58f6660d3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:56.208939 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6c5fd-5aad-4530-a15b-ea58f6660d3f service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:56.209250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6c5fd-5aad-4530-a15b-ea58f6660d3f service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:56.209520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6c5fd-5aad-4530-a15b-ea58f6660d3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:56.217547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6c5fd-5aad-4530-a15b-ea58f6660d3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:56.219182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6c5fd-5aad-4530-a15b-ea58f6660d3f service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:56.228177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1316/2644] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:08:56.475125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40317172-dd22-4da4-90fd-9c1a6a676577 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:08:56.540992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40317172-dd22-4da4-90fd-9c1a6a676577 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:08:56.544974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457d6a3-a471-4a86-8fd7-841a4a05ceea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:08:56.545580 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d6a3-a471-4a86-8fd7-841a4a05ceea service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:08:56.545852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d6a3-a471-4a86-8fd7-841a4a05ceea service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:08:56.546173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d6a3-a471-4a86-8fd7-841a4a05ceea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:08:56.548018 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0457d6a3-a471-4a86-8fd7-841a4a05ceea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:08:56.558265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457d6a3-a471-4a86-8fd7-841a4a05ceea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:08:56.559737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457d6a3-a471-4a86-8fd7-841a4a05ceea service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:08:56.567791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1329/2645] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:08:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:06.043233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6c5fd-5aad-4530-a15b-ea58f6660d3f service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:06.044689 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3dd6c5fd-5aad-4530-a15b-ea58f6660d3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:06.057808 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6c5fd-5aad-4530-a15b-ea58f6660d3f service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:06.062561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a59ce-e455-4d93-8acd-e5a5e8d8fdd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:06.063198 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a59ce-e455-4d93-8acd-e5a5e8d8fdd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:06.063477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a59ce-e455-4d93-8acd-e5a5e8d8fdd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:06.063941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a59ce-e455-4d93-8acd-e5a5e8d8fdd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:06.066077 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-395a59ce-e455-4d93-8acd-e5a5e8d8fdd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:06.137956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a59ce-e455-4d93-8acd-e5a5e8d8fdd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:06.139416 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a59ce-e455-4d93-8acd-e5a5e8d8fdd8 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:06.149585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1317/2646] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:06.564334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=29 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:09.607239 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457d6a3-a471-4a86-8fd7-841a4a05ceea service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:09.608767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0457d6a3-a471-4a86-8fd7-841a4a05ceea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:09.715315 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a59ce-e455-4d93-8acd-e5a5e8d8fdd8 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:09.716824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-395a59ce-e455-4d93-8acd-e5a5e8d8fdd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:09.735022 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a59ce-e455-4d93-8acd-e5a5e8d8fdd8 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:09.758336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad572047-1da7-4caa-85f1-4daa09eeaf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:09.759357 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad572047-1da7-4caa-85f1-4daa09eeaf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:09.759781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad572047-1da7-4caa-85f1-4daa09eeaf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:09.760154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad572047-1da7-4caa-85f1-4daa09eeaf4d admin admin] PATH_INFO: `/v3/users/9c75b97977c2433fb27aa21e4f82ce2e` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:09.762434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad572047-1da7-4caa-85f1-4daa09eeaf4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c75b97977c2433fb27aa21e4f82ce2e)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:09.764755 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad572047-1da7-4caa-85f1-4daa09eeaf4d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:09.779283 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457d6a3-a471-4a86-8fd7-841a4a05ceea service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:09.784535 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c776b1-fd0d-42ea-b974-0b39378de064 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be9a664d10d438382b9e359b26ba86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:09.785156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c776b1-fd0d-42ea-b974-0b39378de064 service placement] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:09.785438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c776b1-fd0d-42ea-b974-0b39378de064 service placement] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:09.785715 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c776b1-fd0d-42ea-b974-0b39378de064 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:09.787761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-03c776b1-fd0d-42ea-b974-0b39378de064 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:09.800650 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c776b1-fd0d-42ea-b974-0b39378de064 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:09.802343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c776b1-fd0d-42ea-b974-0b39378de064 service placement] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:09.814481 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1330/2647] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:09.827583 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:09.834677 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad572047-1da7-4caa-85f1-4daa09eeaf4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c75b97977c2433fb27aa21e4f82ce2e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:09.837588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad572047-1da7-4caa-85f1-4daa09eeaf4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c75b97977c2433fb27aa21e4f82ce2e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:09.838563 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad572047-1da7-4caa-85f1-4daa09eeaf4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c75b97977c2433fb27aa21e4f82ce2e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:09.848274 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad572047-1da7-4caa-85f1-4daa09eeaf4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c75b97977c2433fb27aa21e4f82ce2e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:09.858708 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad572047-1da7-4caa-85f1-4daa09eeaf4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c75b97977c2433fb27aa21e4f82ce2e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:09.876467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1318/2648] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:09:09 2022] DELETE /identity/v3/users/9c75b97977c2433fb27aa21e4f82ce2e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:09:10.093197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c776b1-fd0d-42ea-b974-0b39378de064 service placement] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:10.109808 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c776b1-fd0d-42ea-b974-0b39378de064 service placement] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:10.173596 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a0cee-8afb-440d-94a0-570759b734ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:10.174228 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a0cee-8afb-440d-94a0-570759b734ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:10.174503 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a0cee-8afb-440d-94a0-570759b734ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:10.174797 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a0cee-8afb-440d-94a0-570759b734ab admin admin] PATH_INFO: `/v3/projects/ab89d49f96c74b0990b05ff13d89c7ce` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:10.175985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a0cee-8afb-440d-94a0-570759b734ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab89d49f96c74b0990b05ff13d89c7ce)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:10.178623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a0cee-8afb-440d-94a0-570759b734ab admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:10.229006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-da1a0cee-8afb-440d-94a0-570759b734ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab89d49f96c74b0990b05ff13d89c7ce', 'request_id': 'req-da1a0cee-8afb-440d-94a0-570759b734ab'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:10.237871 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-da1a0cee-8afb-440d-94a0-570759b734ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab89d49f96c74b0990b05ff13d89c7ce', 'request_id': 'req-da1a0cee-8afb-440d-94a0-570759b734ab'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:10.245444 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-da1a0cee-8afb-440d-94a0-570759b734ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab89d49f96c74b0990b05ff13d89c7ce', 'request_id': 'req-da1a0cee-8afb-440d-94a0-570759b734ab'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:10.258372 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-da1a0cee-8afb-440d-94a0-570759b734ab admin admin] The token cache is being invalidate because project ab89d49f96c74b0990b05ff13d89c7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:09:10.258752 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-da1a0cee-8afb-440d-94a0-570759b734ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:10.259492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-da1a0cee-8afb-440d-94a0-570759b734ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:10.261107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1331/2649] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:09:10 2022] DELETE /identity/v3/projects/ab89d49f96c74b0990b05ff13d89c7ce => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:09:10.266359 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d710f6-413a-4863-a464-71110eda1577 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:10.266686 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d710f6-413a-4863-a464-71110eda1577 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:10.267048 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d710f6-413a-4863-a464-71110eda1577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:10.286854 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-02d710f6-413a-4863-a464-71110eda1577 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:10.288096 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-02d710f6-413a-4863-a464-71110eda1577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:10.367199 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1319/2650] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:10.368849 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d367f91-6cfb-4575-bae7-d6bd92ae1f1a None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:10.369114 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d367f91-6cfb-4575-bae7-d6bd92ae1f1a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:10.369404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d367f91-6cfb-4575-bae7-d6bd92ae1f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:10.395708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-5d367f91-6cfb-4575-bae7-d6bd92ae1f1a None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:10.397087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5d367f91-6cfb-4575-bae7-d6bd92ae1f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:10.405609 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1332/2651] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:10.411386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d710f6-413a-4863-a464-71110eda1577 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:10.422311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d710f6-413a-4863-a464-71110eda1577 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:10.427287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bc1b1-0145-4339-b39a-7ecdf858d50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:10.428148 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc1b1-0145-4339-b39a-7ecdf858d50f admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:10.428514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc1b1-0145-4339-b39a-7ecdf858d50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:10.428860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc1b1-0145-4339-b39a-7ecdf858d50f admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:10.429585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bc1b1-0145-4339-b39a-7ecdf858d50f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:09:10.429951 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bc1b1-0145-4339-b39a-7ecdf858d50f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:10.431623 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bc1b1-0145-4339-b39a-7ecdf858d50f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:10.445497 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1320/2652] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:09:10.450010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d367f91-6cfb-4575-bae7-d6bd92ae1f1a None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:10.459926 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d367f91-6cfb-4575-bae7-d6bd92ae1f1a None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:10.464546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9b5f4-2728-4b37-88c7-d75b6f55d72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:10.465138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9b5f4-2728-4b37-88c7-d75b6f55d72b admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:10.465412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9b5f4-2728-4b37-88c7-d75b6f55d72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:10.465678 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9b5f4-2728-4b37-88c7-d75b6f55d72b admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:10.466320 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9b5f4-2728-4b37-88c7-d75b6f55d72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:10.468309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9b5f4-2728-4b37-88c7-d75b6f55d72b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:10.479786 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:10.499259 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1333/2653] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:09:10 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:09:10.503363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bc1b1-0145-4339-b39a-7ecdf858d50f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:10.514113 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bc1b1-0145-4339-b39a-7ecdf858d50f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:10.576001 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5cdb6-e3dc-42c2-bb96-a35025b9595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:10.576617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5cdb6-e3dc-42c2-bb96-a35025b9595c admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:10.576891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5cdb6-e3dc-42c2-bb96-a35025b9595c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:10.577155 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5cdb6-e3dc-42c2-bb96-a35025b9595c admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:10.577787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5cdb6-e3dc-42c2-bb96-a35025b9595c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:10.580059 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5cdb6-e3dc-42c2-bb96-a35025b9595c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:10.603463 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1321/2654] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:09:10 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:09:10.607773 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9b5f4-2728-4b37-88c7-d75b6f55d72b admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:10.618567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9b5f4-2728-4b37-88c7-d75b6f55d72b admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:10.623560 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251baa3c-e1b4-44b2-aa74-ba6aa4c75f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:10.624305 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251baa3c-e1b4-44b2-aa74-ba6aa4c75f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:10.624664 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251baa3c-e1b4-44b2-aa74-ba6aa4c75f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:10.625065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251baa3c-e1b4-44b2-aa74-ba6aa4c75f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:10.625836 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251baa3c-e1b4-44b2-aa74-ba6aa4c75f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:10.627710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251baa3c-e1b4-44b2-aa74-ba6aa4c75f80 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:10.638357 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1334/2655] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:09:10.642563 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5cdb6-e3dc-42c2-bb96-a35025b9595c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:10.653168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5cdb6-e3dc-42c2-bb96-a35025b9595c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:10.659106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85306c7-bbd9-467c-8730-75b603d01dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:10.659829 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85306c7-bbd9-467c-8730-75b603d01dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:10.660121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85306c7-bbd9-467c-8730-75b603d01dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:10.660375 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85306c7-bbd9-467c-8730-75b603d01dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:10.661010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85306c7-bbd9-467c-8730-75b603d01dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:10.662792 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85306c7-bbd9-467c-8730-75b603d01dcc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:10.674164 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1322/2656] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:09:10.678672 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251baa3c-e1b4-44b2-aa74-ba6aa4c75f80 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:10.688996 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251baa3c-e1b4-44b2-aa74-ba6aa4c75f80 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:10.694106 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbae0e1-1682-4b23-9ea9-3d1109f7941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:10.694750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbae0e1-1682-4b23-9ea9-3d1109f7941c admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:10.695029 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbae0e1-1682-4b23-9ea9-3d1109f7941c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:10.695301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbae0e1-1682-4b23-9ea9-3d1109f7941c admin admin] PATH_INFO: `/v3/projects/4dc4f2c309ba4888b22f58c7fe030698/users/6e5b026ac5af4fbc84069f1580978bc8/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:10.710226 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbae0e1-1682-4b23-9ea9-3d1109f7941c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc4f2c309ba4888b22f58c7fe030698, user_id=6e5b026ac5af4fbc84069f1580978bc8, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:10.712909 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbae0e1-1682-4b23-9ea9-3d1109f7941c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:10.730004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1335/2657] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:09:10 2022] PUT /identity/v3/projects/4dc4f2c309ba4888b22f58c7fe030698/users/6e5b026ac5af4fbc84069f1580978bc8/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:09:10.735699 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caee4c-1dc2-47f5-880f-242a02f670f5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:10.736198 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caee4c-1dc2-47f5-880f-242a02f670f5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:10.736283 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caee4c-1dc2-47f5-880f-242a02f670f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:10.758904 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-69caee4c-1dc2-47f5-880f-242a02f670f5 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:10.760576 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-69caee4c-1dc2-47f5-880f-242a02f670f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:10.794818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:10.840059 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1323/2658] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:10.849710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbae0e1-1682-4b23-9ea9-3d1109f7941c admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:10.851727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8dbae0e1-1682-4b23-9ea9-3d1109f7941c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:10.910356 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbae0e1-1682-4b23-9ea9-3d1109f7941c admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:10.915627 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ff554-bb55-45b8-a6cb-45ae8c34de4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:10.916318 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ff554-bb55-45b8-a6cb-45ae8c34de4a service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:10.916657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ff554-bb55-45b8-a6cb-45ae8c34de4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:10.917024 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ff554-bb55-45b8-a6cb-45ae8c34de4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:10.928627 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ff554-bb55-45b8-a6cb-45ae8c34de4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:10.930067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ff554-bb55-45b8-a6cb-45ae8c34de4a service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:10.940721 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1336/2659] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:11.776329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caee4c-1dc2-47f5-880f-242a02f670f5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:11.778501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-69caee4c-1dc2-47f5-880f-242a02f670f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:11.841970 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caee4c-1dc2-47f5-880f-242a02f670f5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:11.845953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31e940-7a49-497a-abbe-5e4bba1b7806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:11.846666 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31e940-7a49-497a-abbe-5e4bba1b7806 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:11.847176 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31e940-7a49-497a-abbe-5e4bba1b7806 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:11.847514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31e940-7a49-497a-abbe-5e4bba1b7806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:11.849776 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1d31e940-7a49-497a-abbe-5e4bba1b7806 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:11.955936 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31e940-7a49-497a-abbe-5e4bba1b7806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:11.957557 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31e940-7a49-497a-abbe-5e4bba1b7806 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:11.972558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1324/2660] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:12.669622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13ecb3-a1e9-40c4-8f5e-2f12575aaf1f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:12.670491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13ecb3-a1e9-40c4-8f5e-2f12575aaf1f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:12.670491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13ecb3-a1e9-40c4-8f5e-2f12575aaf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:12.703476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-9c13ecb3-a1e9-40c4-8f5e-2f12575aaf1f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:12.705050 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9c13ecb3-a1e9-40c4-8f5e-2f12575aaf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:12.724493 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1337/2661] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Aug 22 16:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:12.741509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31e940-7a49-497a-abbe-5e4bba1b7806 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:12.743201 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1d31e940-7a49-497a-abbe-5e4bba1b7806 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:12.852169 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31e940-7a49-497a-abbe-5e4bba1b7806 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:12.858076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1aff90-8323-42b9-8c13-7b7adbf5c3be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:12.858903 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1aff90-8323-42b9-8c13-7b7adbf5c3be service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:12.859216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1aff90-8323-42b9-8c13-7b7adbf5c3be service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:12.859583 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1aff90-8323-42b9-8c13-7b7adbf5c3be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:12.868910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1aff90-8323-42b9-8c13-7b7adbf5c3be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:12.870800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1aff90-8323-42b9-8c13-7b7adbf5c3be service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:12.881982 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1325/2662] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:15.156443 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581304-51c5-497e-8c01-ac365c6f88fe None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:15.157085 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581304-51c5-497e-8c01-ac365c6f88fe None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:15.157085 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581304-51c5-497e-8c01-ac365c6f88fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:15.189084 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1b581304-51c5-497e-8c01-ac365c6f88fe None None] MFA Rules not processed for user `6e5b026ac5af4fbc84069f1580978bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:15.190246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1b581304-51c5-497e-8c01-ac365c6f88fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:15.277103 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1338/2663] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:15.287416 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1aff90-8323-42b9-8c13-7b7adbf5c3be service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:15.290140 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5a1aff90-8323-42b9-8c13-7b7adbf5c3be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:15.335234 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:15.347515 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1aff90-8323-42b9-8c13-7b7adbf5c3be service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:15.374869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329bd24-f6ed-4161-ac8b-341785e4a35b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:15.375622 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329bd24-f6ed-4161-ac8b-341785e4a35b service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:15.375939 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329bd24-f6ed-4161-ac8b-341785e4a35b service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:15.376279 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329bd24-f6ed-4161-ac8b-341785e4a35b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:15.391953 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329bd24-f6ed-4161-ac8b-341785e4a35b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:15.393572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329bd24-f6ed-4161-ac8b-341785e4a35b service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:15.405195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1326/2664] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:16.862230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045f18e-71e0-4547-8bc6-8b501015a0a4 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:16.862772 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045f18e-71e0-4547-8bc6-8b501015a0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:16.862883 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045f18e-71e0-4547-8bc6-8b501015a0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:16.886998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c045f18e-71e0-4547-8bc6-8b501015a0a4 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:16.886998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c045f18e-71e0-4547-8bc6-8b501015a0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:16.894506 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1339/2665] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Aug 22 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:16.910011 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329bd24-f6ed-4161-ac8b-341785e4a35b service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:16.922771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329bd24-f6ed-4161-ac8b-341785e4a35b service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:16.929848 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48115a-5a13-43dd-ac6a-61dd118d8dbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:16.930655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48115a-5a13-43dd-ac6a-61dd118d8dbc service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:16.931003 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48115a-5a13-43dd-ac6a-61dd118d8dbc service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:16.931338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48115a-5a13-43dd-ac6a-61dd118d8dbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:16.942639 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48115a-5a13-43dd-ac6a-61dd118d8dbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:16.944342 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48115a-5a13-43dd-ac6a-61dd118d8dbc service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:16.955290 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1327/2666] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:16.962681 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db7fd-dc0d-4622-a904-86bc46bdcb34 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:16.962966 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db7fd-dc0d-4622-a904-86bc46bdcb34 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:16.963236 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db7fd-dc0d-4622-a904-86bc46bdcb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:16.982652 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-2a2db7fd-dc0d-4622-a904-86bc46bdcb34 None None] MFA Rules not processed for user `6e5b026ac5af4fbc84069f1580978bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:16.984145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-2a2db7fd-dc0d-4622-a904-86bc46bdcb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:16.991886 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1340/2667] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:20.160065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71268e31-a3c9-4161-be51-3c8e306281e0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:20.160684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71268e31-a3c9-4161-be51-3c8e306281e0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:20.160684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71268e31-a3c9-4161-be51-3c8e306281e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:20.183404 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-71268e31-a3c9-4161-be51-3c8e306281e0 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:20.184770 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-71268e31-a3c9-4161-be51-3c8e306281e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:20.193548 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1328/2668] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Aug 22 16:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:20.208745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2db7fd-dc0d-4622-a904-86bc46bdcb34 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:20.230590 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2db7fd-dc0d-4622-a904-86bc46bdcb34 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:20.237444 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbd53f-9a9b-4f66-b54a-a67fbbd36bd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:20.238061 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd53f-9a9b-4f66-b54a-a67fbbd36bd5 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:20.238344 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd53f-9a9b-4f66-b54a-a67fbbd36bd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:20.238631 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbd53f-9a9b-4f66-b54a-a67fbbd36bd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:20.247543 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbd53f-9a9b-4f66-b54a-a67fbbd36bd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:20.249150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbd53f-9a9b-4f66-b54a-a67fbbd36bd5 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:20.259555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1341/2669] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:23.287773 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f979d-32c6-4bab-a980-a06d970873dc None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:23.288316 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f979d-32c6-4bab-a980-a06d970873dc None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:23.288454 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f979d-32c6-4bab-a980-a06d970873dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:23.310326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-419f979d-32c6-4bab-a980-a06d970873dc None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:23.311726 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-419f979d-32c6-4bab-a980-a06d970873dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:23.320019 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1329/2670] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Aug 22 16:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:23.336342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbd53f-9a9b-4f66-b54a-a67fbbd36bd5 service nova] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:23.347696 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbd53f-9a9b-4f66-b54a-a67fbbd36bd5 service nova] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:23.353926 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370a37b-01b0-4d8a-befe-54022f9ae246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:23.354551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370a37b-01b0-4d8a-befe-54022f9ae246 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:23.354866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370a37b-01b0-4d8a-befe-54022f9ae246 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:23.355145 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370a37b-01b0-4d8a-befe-54022f9ae246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:23.364306 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370a37b-01b0-4d8a-befe-54022f9ae246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:23.366186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370a37b-01b0-4d8a-befe-54022f9ae246 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:23.376755 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1342/2671] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:26.468173 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007654-a8fe-462c-871f-35f03c1c294d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:26.468694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007654-a8fe-462c-871f-35f03c1c294d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:26.468694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81007654-a8fe-462c-871f-35f03c1c294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:26.490400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-81007654-a8fe-462c-871f-35f03c1c294d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:26.491647 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-81007654-a8fe-462c-871f-35f03c1c294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:26.500885 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1330/2672] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Aug 22 16:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:26.519584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370a37b-01b0-4d8a-befe-54022f9ae246 service nova] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:26.527502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:26.536405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370a37b-01b0-4d8a-befe-54022f9ae246 service nova] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:26.543001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4428cd-24d5-410c-8f20-40e20f9f9959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:26.543611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4428cd-24d5-410c-8f20-40e20f9f9959 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:26.543883 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4428cd-24d5-410c-8f20-40e20f9f9959 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:26.544157 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4428cd-24d5-410c-8f20-40e20f9f9959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:26.553045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4428cd-24d5-410c-8f20-40e20f9f9959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:26.554764 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4428cd-24d5-410c-8f20-40e20f9f9959 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:26.565103 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1343/2673] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:29.648554 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4fcb2-aacc-40df-8907-15f2b724824c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:29.649083 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4fcb2-aacc-40df-8907-15f2b724824c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:29.649488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4fcb2-aacc-40df-8907-15f2b724824c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:29.679883 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-fce4fcb2-aacc-40df-8907-15f2b724824c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:29.681983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fce4fcb2-aacc-40df-8907-15f2b724824c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:29.695573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1331/2674] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Aug 22 16:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:29.714479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4428cd-24d5-410c-8f20-40e20f9f9959 service nova] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:29.734384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4428cd-24d5-410c-8f20-40e20f9f9959 service nova] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:29.741849 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f182a-1ad2-4632-9d35-64bc5103c6c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:29.742477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f182a-1ad2-4632-9d35-64bc5103c6c0 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:29.742985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f182a-1ad2-4632-9d35-64bc5103c6c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:29.743398 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f182a-1ad2-4632-9d35-64bc5103c6c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:29.758284 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f182a-1ad2-4632-9d35-64bc5103c6c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:29.761349 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f182a-1ad2-4632-9d35-64bc5103c6c0 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:29.775295 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1344/2675] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:34.115852 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4fcb2-aacc-40df-8907-15f2b724824c None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:34.117876 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fce4fcb2-aacc-40df-8907-15f2b724824c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:34.177691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f182a-1ad2-4632-9d35-64bc5103c6c0 service nova] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:34.179352 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-fc6f182a-1ad2-4632-9d35-64bc5103c6c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:34.193479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f182a-1ad2-4632-9d35-64bc5103c6c0 service nova] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:34.198643 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539561c9-fa72-4dab-b4bc-7ab635c87711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:34.199555 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539561c9-fa72-4dab-b4bc-7ab635c87711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:34.199985 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539561c9-fa72-4dab-b4bc-7ab635c87711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:34.200430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539561c9-fa72-4dab-b4bc-7ab635c87711 admin admin] PATH_INFO: `/v3/users/80984ce244624787bfda0ea94ef0b77e` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:34.201939 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539561c9-fa72-4dab-b4bc-7ab635c87711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80984ce244624787bfda0ea94ef0b77e)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:34.205351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539561c9-fa72-4dab-b4bc-7ab635c87711 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:34.220737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4fcb2-aacc-40df-8907-15f2b724824c None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:34.230413 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a9351-d8d4-4570-a922-889402797470 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be9a664d10d438382b9e359b26ba86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:34.231156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a9351-d8d4-4570-a922-889402797470 service placement] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:34.231501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a9351-d8d4-4570-a922-889402797470 service placement] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:34.231838 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a9351-d8d4-4570-a922-889402797470 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:34.233824 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d92a9351-d8d4-4570-a922-889402797470 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:34.253141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a9351-d8d4-4570-a922-889402797470 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:34.255080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a9351-d8d4-4570-a922-889402797470 service placement] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:34.266461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-539561c9-fa72-4dab-b4bc-7ab635c87711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80984ce244624787bfda0ea94ef0b77e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.269418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1332/2676] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:34.283053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-539561c9-fa72-4dab-b4bc-7ab635c87711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80984ce244624787bfda0ea94ef0b77e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.293045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-539561c9-fa72-4dab-b4bc-7ab635c87711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80984ce244624787bfda0ea94ef0b77e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.305106 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-539561c9-fa72-4dab-b4bc-7ab635c87711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80984ce244624787bfda0ea94ef0b77e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.305973 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-539561c9-fa72-4dab-b4bc-7ab635c87711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80984ce244624787bfda0ea94ef0b77e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.315682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1345/2677] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:09:34 2022] DELETE /identity/v3/users/80984ce244624787bfda0ea94ef0b77e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:09:34.500246 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a9351-d8d4-4570-a922-889402797470 service placement] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:34.522045 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a9351-d8d4-4570-a922-889402797470 service placement] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:34.600337 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:34.601040 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:34.601319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:34.601588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] PATH_INFO: `/v3/projects/e43c1425c15a42b98fc223bef22a8842` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:34.602775 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43c1425c15a42b98fc223bef22a8842)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:34.604700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:34.652951 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:34.657030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43c1425c15a42b98fc223bef22a8842', 'request_id': 'req-da57b737-95a2-41ad-8315-d4c69141ef21'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.663233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43c1425c15a42b98fc223bef22a8842', 'request_id': 'req-da57b737-95a2-41ad-8315-d4c69141ef21'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.671781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43c1425c15a42b98fc223bef22a8842', 'request_id': 'req-da57b737-95a2-41ad-8315-d4c69141ef21'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.684429 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] The token cache is being invalidate because project e43c1425c15a42b98fc223bef22a8842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:09:34.684715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.685483 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.687159 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1333/2678] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:09:34 2022] DELETE /identity/v3/projects/e43c1425c15a42b98fc223bef22a8842 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:09:34.692034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539561c9-fa72-4dab-b4bc-7ab635c87711 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:34.693505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-539561c9-fa72-4dab-b4bc-7ab635c87711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:34.708825 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539561c9-fa72-4dab-b4bc-7ab635c87711 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:34.781387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc9f84-b7e9-4111-a2c5-96a269dcbe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:34.781935 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc9f84-b7e9-4111-a2c5-96a269dcbe61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:34.782215 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc9f84-b7e9-4111-a2c5-96a269dcbe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:34.782645 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc9f84-b7e9-4111-a2c5-96a269dcbe61 admin admin] PATH_INFO: `/v3/users/0ad25fe885f8491ba6d651d4dd85e0c6` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:34.783828 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc9f84-b7e9-4111-a2c5-96a269dcbe61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad25fe885f8491ba6d651d4dd85e0c6)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:34.785787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc9f84-b7e9-4111-a2c5-96a269dcbe61 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:34.837649 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-7ffc9f84-b7e9-4111-a2c5-96a269dcbe61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad25fe885f8491ba6d651d4dd85e0c6'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.840280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:34.853910 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-7ffc9f84-b7e9-4111-a2c5-96a269dcbe61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad25fe885f8491ba6d651d4dd85e0c6'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.863696 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-7ffc9f84-b7e9-4111-a2c5-96a269dcbe61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad25fe885f8491ba6d651d4dd85e0c6'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.870954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-7ffc9f84-b7e9-4111-a2c5-96a269dcbe61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad25fe885f8491ba6d651d4dd85e0c6'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.871717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-7ffc9f84-b7e9-4111-a2c5-96a269dcbe61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad25fe885f8491ba6d651d4dd85e0c6'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:34.877938 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1346/2679] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:09:34 2022] DELETE /identity/v3/users/0ad25fe885f8491ba6d651d4dd85e0c6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:09:35.052113 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:35.053722 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:35.071209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57b737-95a2-41ad-8315-d4c69141ef21 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:35.132265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42240999-a394-494c-88d3-ec771b9b9f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:35.132947 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42240999-a394-494c-88d3-ec771b9b9f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:35.133170 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42240999-a394-494c-88d3-ec771b9b9f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:35.133444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42240999-a394-494c-88d3-ec771b9b9f0f admin admin] PATH_INFO: `/v3/projects/ee89a20b7dfb455da43b204ff6667520` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:35.134690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42240999-a394-494c-88d3-ec771b9b9f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee89a20b7dfb455da43b204ff6667520)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:35.136606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42240999-a394-494c-88d3-ec771b9b9f0f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:35.185301 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-42240999-a394-494c-88d3-ec771b9b9f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee89a20b7dfb455da43b204ff6667520', 'request_id': 'req-42240999-a394-494c-88d3-ec771b9b9f0f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:35.190926 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-42240999-a394-494c-88d3-ec771b9b9f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee89a20b7dfb455da43b204ff6667520', 'request_id': 'req-42240999-a394-494c-88d3-ec771b9b9f0f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:35.198312 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-42240999-a394-494c-88d3-ec771b9b9f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee89a20b7dfb455da43b204ff6667520', 'request_id': 'req-42240999-a394-494c-88d3-ec771b9b9f0f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:35.210781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-42240999-a394-494c-88d3-ec771b9b9f0f admin admin] The token cache is being invalidate because project ee89a20b7dfb455da43b204ff6667520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:09:35.211072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-42240999-a394-494c-88d3-ec771b9b9f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:35.211791 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-42240999-a394-494c-88d3-ec771b9b9f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:35.213402 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1334/2680] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:09:35 2022] DELETE /identity/v3/projects/ee89a20b7dfb455da43b204ff6667520 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:09:35.218696 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46049e1-ddbe-4c2a-99e4-01f39a08d424 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:35.219192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46049e1-ddbe-4c2a-99e4-01f39a08d424 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:35.219290 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46049e1-ddbe-4c2a-99e4-01f39a08d424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:35.239651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-e46049e1-ddbe-4c2a-99e4-01f39a08d424 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:35.240846 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e46049e1-ddbe-4c2a-99e4-01f39a08d424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:35.310648 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1347/2681] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:35.318467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee267-41e4-4c29-bc6d-48ce3ca9691e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:35.318770 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee267-41e4-4c29-bc6d-48ce3ca9691e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:35.319039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee267-41e4-4c29-bc6d-48ce3ca9691e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:35.340607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b0cee267-41e4-4c29-bc6d-48ce3ca9691e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:35.341832 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b0cee267-41e4-4c29-bc6d-48ce3ca9691e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:35.350281 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1335/2682] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:35.354783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46049e1-ddbe-4c2a-99e4-01f39a08d424 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:35.365385 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46049e1-ddbe-4c2a-99e4-01f39a08d424 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:35.370702 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b1c6b-881c-4352-bf09-720efde7031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:35.371383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b1c6b-881c-4352-bf09-720efde7031c admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:35.371662 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b1c6b-881c-4352-bf09-720efde7031c admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:35.371940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b1c6b-881c-4352-bf09-720efde7031c admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:35.372613 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b1c6b-881c-4352-bf09-720efde7031c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:09:35.372920 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b1c6b-881c-4352-bf09-720efde7031c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:35.374537 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b1c6b-881c-4352-bf09-720efde7031c admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:35.386889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1348/2683] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:09:35.393780 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cee267-41e4-4c29-bc6d-48ce3ca9691e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:35.408217 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cee267-41e4-4c29-bc6d-48ce3ca9691e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:35.414569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb0ace-ba6e-452d-863d-e22a186efd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:35.415243 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb0ace-ba6e-452d-863d-e22a186efd22 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:35.415520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb0ace-ba6e-452d-863d-e22a186efd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:35.415793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb0ace-ba6e-452d-863d-e22a186efd22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:35.416481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb0ace-ba6e-452d-863d-e22a186efd22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:35.418389 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb0ace-ba6e-452d-863d-e22a186efd22 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:35.451329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1336/2684] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:09:35 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:09:35.455686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b1c6b-881c-4352-bf09-720efde7031c admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:35.466473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b1c6b-881c-4352-bf09-720efde7031c admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:35.529800 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22463316-f8ce-46a2-8065-eb82ae81109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:35.530458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463316-f8ce-46a2-8065-eb82ae81109e admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:35.530766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463316-f8ce-46a2-8065-eb82ae81109e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:35.531034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463316-f8ce-46a2-8065-eb82ae81109e admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:35.531666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22463316-f8ce-46a2-8065-eb82ae81109e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:35.533628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22463316-f8ce-46a2-8065-eb82ae81109e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:35.572342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1349/2685] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:09:35 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:09:35.576486 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb0ace-ba6e-452d-863d-e22a186efd22 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:35.588731 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb0ace-ba6e-452d-863d-e22a186efd22 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:35.593538 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a001fe-f2b5-4463-b6bd-6e8b27f774ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:35.594152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a001fe-f2b5-4463-b6bd-6e8b27f774ca admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:35.594427 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a001fe-f2b5-4463-b6bd-6e8b27f774ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:35.594783 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a001fe-f2b5-4463-b6bd-6e8b27f774ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:35.595535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a001fe-f2b5-4463-b6bd-6e8b27f774ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:35.597165 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a001fe-f2b5-4463-b6bd-6e8b27f774ca admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:35.608516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1337/2686] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:09:35.612759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22463316-f8ce-46a2-8065-eb82ae81109e admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:35.623216 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22463316-f8ce-46a2-8065-eb82ae81109e admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:35.627933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11e936-4d73-499d-9580-0a7d93a620f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:35.628530 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11e936-4d73-499d-9580-0a7d93a620f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:35.628806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11e936-4d73-499d-9580-0a7d93a620f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:35.629074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11e936-4d73-499d-9580-0a7d93a620f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:35.629714 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11e936-4d73-499d-9580-0a7d93a620f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:35.631367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11e936-4d73-499d-9580-0a7d93a620f7 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:35.642254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1350/2687] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:09:35.648975 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a001fe-f2b5-4463-b6bd-6e8b27f774ca admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:35.665856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a001fe-f2b5-4463-b6bd-6e8b27f774ca admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:35.673389 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486ea73-f4b2-4dca-9406-3ff00ed34916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:35.674459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486ea73-f4b2-4dca-9406-3ff00ed34916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:35.674889 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486ea73-f4b2-4dca-9406-3ff00ed34916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:35.675319 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486ea73-f4b2-4dca-9406-3ff00ed34916 admin admin] PATH_INFO: `/v3/projects/5b5f9eee72aa46ce954d9696310baec6/users/2446bc5a1a684994876b77498f75971a/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:35.700424 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486ea73-f4b2-4dca-9406-3ff00ed34916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5f9eee72aa46ce954d9696310baec6, user_id=2446bc5a1a684994876b77498f75971a, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:35.703189 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486ea73-f4b2-4dca-9406-3ff00ed34916 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:35.714752 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:35.722973 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1338/2688] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:09:35 2022] PUT /identity/v3/projects/5b5f9eee72aa46ce954d9696310baec6/users/2446bc5a1a684994876b77498f75971a/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:09:35.733893 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234253b8-4ef9-4661-9f08-b7d12270560a None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:35.734175 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234253b8-4ef9-4661-9f08-b7d12270560a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:35.734449 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234253b8-4ef9-4661-9f08-b7d12270560a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:35.764170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-234253b8-4ef9-4661-9f08-b7d12270560a None None] MFA Rules not processed for user `2446bc5a1a684994876b77498f75971a`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:35.765474 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-234253b8-4ef9-4661-9f08-b7d12270560a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:35.785880 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:35.847181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1351/2689] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:35.864266 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486ea73-f4b2-4dca-9406-3ff00ed34916 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:35.867108 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7486ea73-f4b2-4dca-9406-3ff00ed34916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:35.939793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486ea73-f4b2-4dca-9406-3ff00ed34916 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:35.943812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07215b3-5e99-49b3-9ff2-10318db8b894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:35.944392 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07215b3-5e99-49b3-9ff2-10318db8b894 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:35.944761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07215b3-5e99-49b3-9ff2-10318db8b894 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:35.945032 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07215b3-5e99-49b3-9ff2-10318db8b894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:35.953764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07215b3-5e99-49b3-9ff2-10318db8b894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:35.955543 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07215b3-5e99-49b3-9ff2-10318db8b894 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:35.964577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1339/2690] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:35.986052 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234253b8-4ef9-4661-9f08-b7d12270560a None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:36.050649 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234253b8-4ef9-4661-9f08-b7d12270560a None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:36.055978 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58895ece-6068-4cf9-a49a-d2cfb105903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:36.056607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58895ece-6068-4cf9-a49a-d2cfb105903d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:36.056888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58895ece-6068-4cf9-a49a-d2cfb105903d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:36.057323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58895ece-6068-4cf9-a49a-d2cfb105903d admin admin] PATH_INFO: `/v3/users/2446bc5a1a684994876b77498f75971a` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:36.058684 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58895ece-6068-4cf9-a49a-d2cfb105903d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2446bc5a1a684994876b77498f75971a)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:36.061159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58895ece-6068-4cf9-a49a-d2cfb105903d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:36.112029 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-58895ece-6068-4cf9-a49a-d2cfb105903d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2446bc5a1a684994876b77498f75971a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:36.126034 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-58895ece-6068-4cf9-a49a-d2cfb105903d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2446bc5a1a684994876b77498f75971a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:36.135007 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-58895ece-6068-4cf9-a49a-d2cfb105903d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2446bc5a1a684994876b77498f75971a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:36.142346 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-58895ece-6068-4cf9-a49a-d2cfb105903d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2446bc5a1a684994876b77498f75971a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:36.143037 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-58895ece-6068-4cf9-a49a-d2cfb105903d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2446bc5a1a684994876b77498f75971a'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:36.149297 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1352/2691] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:09:35 2022] DELETE /identity/v3/users/2446bc5a1a684994876b77498f75971a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:09:36.153921 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7958e-afd4-4196-b794-dca11d22cf48 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:36.154526 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7958e-afd4-4196-b794-dca11d22cf48 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:36.154526 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7958e-afd4-4196-b794-dca11d22cf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:36.174475 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9cf7958e-afd4-4196-b794-dca11d22cf48 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:36.175720 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9cf7958e-afd4-4196-b794-dca11d22cf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:36.238875 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1340/2692] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:36.249464 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58895ece-6068-4cf9-a49a-d2cfb105903d admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:36.251670 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-58895ece-6068-4cf9-a49a-d2cfb105903d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:36.301796 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:36.317073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58895ece-6068-4cf9-a49a-d2cfb105903d admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:36.321185 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d9045-7327-4a86-9be5-d27a0eea0359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:36.321791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d9045-7327-4a86-9be5-d27a0eea0359 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:36.322066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d9045-7327-4a86-9be5-d27a0eea0359 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:36.322336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d9045-7327-4a86-9be5-d27a0eea0359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:36.332053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d9045-7327-4a86-9be5-d27a0eea0359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:36.333518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d9045-7327-4a86-9be5-d27a0eea0359 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:36.343152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1353/2693] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:36.618905 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7958e-afd4-4196-b794-dca11d22cf48 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:36.621381 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9cf7958e-afd4-4196-b794-dca11d22cf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:36.643376 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7958e-afd4-4196-b794-dca11d22cf48 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:36.648925 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:36.649614 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:36.649922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:36.650189 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40 admin admin] PATH_INFO: `/v3/projects/5b5f9eee72aa46ce954d9696310baec6` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:36.651410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5f9eee72aa46ce954d9696310baec6)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:36.653451 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:36.710246 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5f9eee72aa46ce954d9696310baec6', 'request_id': 'req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:36.715746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5f9eee72aa46ce954d9696310baec6', 'request_id': 'req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:36.723590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5f9eee72aa46ce954d9696310baec6', 'request_id': 'req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:36.735449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40 admin admin] The token cache is being invalidate because project 5b5f9eee72aa46ce954d9696310baec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:09:36.735636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:36.736293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fdb1cbb9-0866-41ab-b1d4-d2518d7fbc40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:09:36.737819 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1341/2694] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:09:36 2022] DELETE /identity/v3/projects/5b5f9eee72aa46ce954d9696310baec6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:09:36.743138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c252dc-9a76-4a7b-b64e-c38a8319c07d None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:36.743421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c252dc-9a76-4a7b-b64e-c38a8319c07d None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:36.743695 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c252dc-9a76-4a7b-b64e-c38a8319c07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:36.764083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-77c252dc-9a76-4a7b-b64e-c38a8319c07d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:36.765467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-77c252dc-9a76-4a7b-b64e-c38a8319c07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:36.827239 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1354/2695] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:09:36.836584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b3229-7781-4560-ae04-647df93b8735 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:36.836850 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b3229-7781-4560-ae04-647df93b8735 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:36.837158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b3229-7781-4560-ae04-647df93b8735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:36.857303 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2b2b3229-7781-4560-ae04-647df93b8735 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:36.858573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2b2b3229-7781-4560-ae04-647df93b8735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:36.867265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1342/2696] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:36.871718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c252dc-9a76-4a7b-b64e-c38a8319c07d None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:36.882254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c252dc-9a76-4a7b-b64e-c38a8319c07d None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:36.887336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce0262-be03-421a-8f83-04e2d36c93c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:36.887918 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0262-be03-421a-8f83-04e2d36c93c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:36.888201 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0262-be03-421a-8f83-04e2d36c93c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:36.888479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0262-be03-421a-8f83-04e2d36c93c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:36.889179 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce0262-be03-421a-8f83-04e2d36c93c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:09:36.889486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce0262-be03-421a-8f83-04e2d36c93c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:36.891163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce0262-be03-421a-8f83-04e2d36c93c5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:36.903796 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1355/2697] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:09:36.967075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b3229-7781-4560-ae04-647df93b8735 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:36.984698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b3229-7781-4560-ae04-647df93b8735 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:36.990464 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8567e-d160-4999-a810-b582810f16c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:36.991222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8567e-d160-4999-a810-b582810f16c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:36.991572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8567e-d160-4999-a810-b582810f16c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:36.991919 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8567e-d160-4999-a810-b582810f16c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:36.992983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8567e-d160-4999-a810-b582810f16c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:36.996341 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8567e-d160-4999-a810-b582810f16c7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:37.025284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:37.047158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1343/2698] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:09:36 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:09:37.053864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce0262-be03-421a-8f83-04e2d36c93c5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:37.071583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce0262-be03-421a-8f83-04e2d36c93c5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:37.167844 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73a388-e815-47d7-99c1-f8ea2e6e414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:37.168837 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73a388-e815-47d7-99c1-f8ea2e6e414e admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:37.169289 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73a388-e815-47d7-99c1-f8ea2e6e414e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:37.169744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73a388-e815-47d7-99c1-f8ea2e6e414e admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:37.170834 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73a388-e815-47d7-99c1-f8ea2e6e414e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:37.174069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73a388-e815-47d7-99c1-f8ea2e6e414e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:37.210310 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1356/2699] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:09:37 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:09:37.215272 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8567e-d160-4999-a810-b582810f16c7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:37.241486 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8567e-d160-4999-a810-b582810f16c7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:37.246547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d29361-612d-4156-aaf0-980de0ae283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:37.247266 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d29361-612d-4156-aaf0-980de0ae283e admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:37.247579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d29361-612d-4156-aaf0-980de0ae283e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:37.247891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d29361-612d-4156-aaf0-980de0ae283e admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:37.248598 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d29361-612d-4156-aaf0-980de0ae283e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:37.250772 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d29361-612d-4156-aaf0-980de0ae283e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:37.265766 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1344/2700] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:09:37.270466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73a388-e815-47d7-99c1-f8ea2e6e414e admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:37.287529 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73a388-e815-47d7-99c1-f8ea2e6e414e admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:37.295299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd890e-f340-423e-a832-d3b294db6052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:37.296291 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd890e-f340-423e-a832-d3b294db6052 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:37.296737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd890e-f340-423e-a832-d3b294db6052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:37.297173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd890e-f340-423e-a832-d3b294db6052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:37.298281 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd890e-f340-423e-a832-d3b294db6052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:37.302487 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd890e-f340-423e-a832-d3b294db6052 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:37.325648 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1357/2701] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:09:37.328192 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d29361-612d-4156-aaf0-980de0ae283e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:37.348880 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d29361-612d-4156-aaf0-980de0ae283e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:37.356165 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086fe34-52a7-4213-bade-0224ee6c2a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:37.357205 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086fe34-52a7-4213-bade-0224ee6c2a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:37.357642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086fe34-52a7-4213-bade-0224ee6c2a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:37.358074 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086fe34-52a7-4213-bade-0224ee6c2a88 admin admin] PATH_INFO: `/v3/projects/94445b09f7d84f5ab493c98491a65f18/users/6ed3a9d24f594e6bab8a0c2604a2e995/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:37.382093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086fe34-52a7-4213-bade-0224ee6c2a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94445b09f7d84f5ab493c98491a65f18, user_id=6ed3a9d24f594e6bab8a0c2604a2e995, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:37.386626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086fe34-52a7-4213-bade-0224ee6c2a88 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:37.403276 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1345/2702] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:09:37 2022] PUT /identity/v3/projects/94445b09f7d84f5ab493c98491a65f18/users/6ed3a9d24f594e6bab8a0c2604a2e995/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:09:37.408886 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e9363-cbb6-48d6-aba2-e957ce827e0c None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:37.409212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e9363-cbb6-48d6-aba2-e957ce827e0c None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:37.409529 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e9363-cbb6-48d6-aba2-e957ce827e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:37.430689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-255e9363-cbb6-48d6-aba2-e957ce827e0c None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:37.432107 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-255e9363-cbb6-48d6-aba2-e957ce827e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:37.499011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:37.516647 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1358/2703] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:37.527770 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086fe34-52a7-4213-bade-0224ee6c2a88 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:37.529540 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d086fe34-52a7-4213-bade-0224ee6c2a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:37.599900 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086fe34-52a7-4213-bade-0224ee6c2a88 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:37.604211 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a679b9-a0f5-45fa-91dd-510acd4312eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:37.604832 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a679b9-a0f5-45fa-91dd-510acd4312eb service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:37.605107 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a679b9-a0f5-45fa-91dd-510acd4312eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:37.605381 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a679b9-a0f5-45fa-91dd-510acd4312eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:37.615867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a679b9-a0f5-45fa-91dd-510acd4312eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:37.617723 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a679b9-a0f5-45fa-91dd-510acd4312eb service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:37.628122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1346/2704] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:09:38.405402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff8c99-1462-42cc-84ac-9e99b3fb3dbe None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:38.405972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff8c99-1462-42cc-84ac-9e99b3fb3dbe None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:38.406072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff8c99-1462-42cc-84ac-9e99b3fb3dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:38.437156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-ebff8c99-1462-42cc-84ac-9e99b3fb3dbe None None] MFA Rules not processed for user `6ed3a9d24f594e6bab8a0c2604a2e995`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:38.438413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ebff8c99-1462-42cc-84ac-9e99b3fb3dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:38.513653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1359/2705] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:38.525046 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a679b9-a0f5-45fa-91dd-510acd4312eb service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:38.526499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-30a679b9-a0f5-45fa-91dd-510acd4312eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:38.592411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a679b9-a0f5-45fa-91dd-510acd4312eb service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:38.596490 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f95f4-e83a-4c28-a603-4a0dd6955c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:38.597102 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f95f4-e83a-4c28-a603-4a0dd6955c1c service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:38.597373 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f95f4-e83a-4c28-a603-4a0dd6955c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:38.597641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f95f4-e83a-4c28-a603-4a0dd6955c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:38.607361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f95f4-e83a-4c28-a603-4a0dd6955c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:38.608806 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f95f4-e83a-4c28-a603-4a0dd6955c1c service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:38.618060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1347/2706] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:09:40.003761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd94db-edf6-49f7-b953-37eaacd44be1 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:40.004333 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd94db-edf6-49f7-b953-37eaacd44be1 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:40.004333 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd94db-edf6-49f7-b953-37eaacd44be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:40.027278 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-4acd94db-edf6-49f7-b953-37eaacd44be1 None None] MFA Rules not processed for user `6ed3a9d24f594e6bab8a0c2604a2e995`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:40.028490 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4acd94db-edf6-49f7-b953-37eaacd44be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:40.036496 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1360/2707] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:44.101793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fc344-fe70-4ff4-a8dd-b5d74f77fdd4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:44.102387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fc344-fe70-4ff4-a8dd-b5d74f77fdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:44.102387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fc344-fe70-4ff4-a8dd-b5d74f77fdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:44.123177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-fa7fc344-fe70-4ff4-a8dd-b5d74f77fdd4 None None] MFA Rules not processed for user `344c0b0d05284ef8a5c9e333d6bad3f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:44.124712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fa7fc344-fe70-4ff4-a8dd-b5d74f77fdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:44.186063 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1348/2708] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:50.020114 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=39 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:54.178812 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:09:55.879098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4221fa-35a6-4607-96ce-a67a7c8e54e7 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:55.879098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4221fa-35a6-4607-96ce-a67a7c8e54e7 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:55.879566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4221fa-35a6-4607-96ce-a67a7c8e54e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:55.900404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-bd4221fa-35a6-4607-96ce-a67a7c8e54e7 None None] MFA Rules not processed for user `6ed3a9d24f594e6bab8a0c2604a2e995`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:55.901648 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bd4221fa-35a6-4607-96ce-a67a7c8e54e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:55.908946 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1361/2709] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:09:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:58.472014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52c318-207b-4fc8-815a-2dc93a765a6e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:58.472584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52c318-207b-4fc8-815a-2dc93a765a6e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:58.472584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52c318-207b-4fc8-815a-2dc93a765a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:58.498073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-ad52c318-207b-4fc8-815a-2dc93a765a6e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:09:58.499246 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ad52c318-207b-4fc8-815a-2dc93a765a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:58.508746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1349/2710] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Aug 22 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:09:58.524686 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4221fa-35a6-4607-96ce-a67a7c8e54e7 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:09:58.526276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-bd4221fa-35a6-4607-96ce-a67a7c8e54e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:09:58.606859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4221fa-35a6-4607-96ce-a67a7c8e54e7 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:09:58.612673 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425212a-8407-466f-a7de-ec4717d7c4ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:09:58.613300 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425212a-8407-466f-a7de-ec4717d7c4ab service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:09:58.613576 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425212a-8407-466f-a7de-ec4717d7c4ab service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:09:58.613847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425212a-8407-466f-a7de-ec4717d7c4ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:09:58.622911 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425212a-8407-466f-a7de-ec4717d7c4ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:09:58.624519 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425212a-8407-466f-a7de-ec4717d7c4ab service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:09:58.634945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1362/2711] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:10:01.777505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1f2d-3828-4825-8ec1-7458d9c2347f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:01.778150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1f2d-3828-4825-8ec1-7458d9c2347f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:01.778150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd1f2d-3828-4825-8ec1-7458d9c2347f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:01.807955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-01dd1f2d-3828-4825-8ec1-7458d9c2347f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:10:01.809724 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-01dd1f2d-3828-4825-8ec1-7458d9c2347f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:01.821778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1350/2712] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Aug 22 16:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:10:01.838974 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425212a-8407-466f-a7de-ec4717d7c4ab service nova] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:01.840717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-7425212a-8407-466f-a7de-ec4717d7c4ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:01.858679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425212a-8407-466f-a7de-ec4717d7c4ab service nova] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:01.864961 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2efd78-f89b-43a5-900d-73fce99d97d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:01.865571 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2efd78-f89b-43a5-900d-73fce99d97d4 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:01.865847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2efd78-f89b-43a5-900d-73fce99d97d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:01.866117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2efd78-f89b-43a5-900d-73fce99d97d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:01.876120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2efd78-f89b-43a5-900d-73fce99d97d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:01.878814 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2efd78-f89b-43a5-900d-73fce99d97d4 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:01.890624 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1363/2713] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:10:04.432633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1f2d-3828-4825-8ec1-7458d9c2347f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:04.448576 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd1f2d-3828-4825-8ec1-7458d9c2347f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:04.457219 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed0b66-1661-4c6e-88e1-a021dae24f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:04.457884 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed0b66-1661-4c6e-88e1-a021dae24f66 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:04.458146 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed0b66-1661-4c6e-88e1-a021dae24f66 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:04.458411 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed0b66-1661-4c6e-88e1-a021dae24f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:04.460466 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-74ed0b66-1661-4c6e-88e1-a021dae24f66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:04.475299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed0b66-1661-4c6e-88e1-a021dae24f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:04.477058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed0b66-1661-4c6e-88e1-a021dae24f66 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:04.489030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1351/2714] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:10:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:10:04.903200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bae7a3-d876-4a7d-81cf-e12b671ae446 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:04.904113 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bae7a3-d876-4a7d-81cf-e12b671ae446 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:04.911285 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bae7a3-d876-4a7d-81cf-e12b671ae446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:04.935707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-52bae7a3-d876-4a7d-81cf-e12b671ae446 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:10:04.937020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-52bae7a3-d876-4a7d-81cf-e12b671ae446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:04.946088 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1364/2715] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Aug 22 16:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:10:04.961421 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed0b66-1661-4c6e-88e1-a021dae24f66 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:04.973471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed0b66-1661-4c6e-88e1-a021dae24f66 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:04.979674 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a1cd3-77ec-48ef-8849-de650272c49c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:04.980465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a1cd3-77ec-48ef-8849-de650272c49c service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:04.980912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a1cd3-77ec-48ef-8849-de650272c49c service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:04.981181 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a1cd3-77ec-48ef-8849-de650272c49c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:04.991335 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a1cd3-77ec-48ef-8849-de650272c49c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:04.993058 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a1cd3-77ec-48ef-8849-de650272c49c service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:05.003344 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1352/2716] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:10:09.106769 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b9e31-ad90-4112-991a-6229cede8068 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:09.107265 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b9e31-ad90-4112-991a-6229cede8068 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:09.107377 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b9e31-ad90-4112-991a-6229cede8068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:09.127759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-483b9e31-ad90-4112-991a-6229cede8068 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:10:09.128990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-483b9e31-ad90-4112-991a-6229cede8068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:09.137719 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1365/2717] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Aug 22 16:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:10:09.158898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a1cd3-77ec-48ef-8849-de650272c49c service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:09.170900 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a1cd3-77ec-48ef-8849-de650272c49c service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:09.177916 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b85f8-6fb6-4b9a-8053-16fbb1f46790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:09.178527 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b85f8-6fb6-4b9a-8053-16fbb1f46790 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:09.178835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b85f8-6fb6-4b9a-8053-16fbb1f46790 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:09.179106 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b85f8-6fb6-4b9a-8053-16fbb1f46790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:09.188535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b85f8-6fb6-4b9a-8053-16fbb1f46790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:09.190146 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b85f8-6fb6-4b9a-8053-16fbb1f46790 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:09.201856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1353/2718] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:10:13.439956 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf58d-77e7-41ab-86d6-533b3f6f1010 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:13.440510 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf58d-77e7-41ab-86d6-533b3f6f1010 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:13.440852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf58d-77e7-41ab-86d6-533b3f6f1010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:13.482977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-d1acf58d-77e7-41ab-86d6-533b3f6f1010 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:10:13.485197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d1acf58d-77e7-41ab-86d6-533b3f6f1010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:13.495277 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1366/2719] 10.222.0.85 () {58 vars in 1016 bytes} [Mon Aug 22 16:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:10:13.519101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b85f8-6fb6-4b9a-8053-16fbb1f46790 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:13.544939 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b85f8-6fb6-4b9a-8053-16fbb1f46790 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:13.555827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7ffac-24c5-4d5e-a76f-4ae5f0917bbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:13.557948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7ffac-24c5-4d5e-a76f-4ae5f0917bbb service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:13.559504 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7ffac-24c5-4d5e-a76f-4ae5f0917bbb service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:13.560788 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7ffac-24c5-4d5e-a76f-4ae5f0917bbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:13.574690 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7ffac-24c5-4d5e-a76f-4ae5f0917bbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:13.576685 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7ffac-24c5-4d5e-a76f-4ae5f0917bbb service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:13.589955 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1354/2720] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:10:17.145592 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acf58d-77e7-41ab-86d6-533b3f6f1010 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:17.149005 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d1acf58d-77e7-41ab-86d6-533b3f6f1010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:17.168403 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acf58d-77e7-41ab-86d6-533b3f6f1010 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:17.175597 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601b1f7-ca4c-4610-83ab-d87fda12571a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:17.176309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601b1f7-ca4c-4610-83ab-d87fda12571a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:17.176575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601b1f7-ca4c-4610-83ab-d87fda12571a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:17.176891 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601b1f7-ca4c-4610-83ab-d87fda12571a admin admin] PATH_INFO: `/v3/users/d68d011a3b014ee696a3e89b06085569` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:17.178446 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601b1f7-ca4c-4610-83ab-d87fda12571a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68d011a3b014ee696a3e89b06085569)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:17.180766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601b1f7-ca4c-4610-83ab-d87fda12571a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:17.239257 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d601b1f7-ca4c-4610-83ab-d87fda12571a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68d011a3b014ee696a3e89b06085569'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.252514 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d601b1f7-ca4c-4610-83ab-d87fda12571a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68d011a3b014ee696a3e89b06085569'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.263079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d601b1f7-ca4c-4610-83ab-d87fda12571a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68d011a3b014ee696a3e89b06085569'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.272455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d601b1f7-ca4c-4610-83ab-d87fda12571a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68d011a3b014ee696a3e89b06085569'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.273222 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d601b1f7-ca4c-4610-83ab-d87fda12571a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68d011a3b014ee696a3e89b06085569'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.279910 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1367/2721] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:10:17 2022] DELETE /identity/v3/users/d68d011a3b014ee696a3e89b06085569 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:10:17.499896 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7ffac-24c5-4d5e-a76f-4ae5f0917bbb service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:17.510530 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7ffac-24c5-4d5e-a76f-4ae5f0917bbb service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:17.586175 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:17.586918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:17.587267 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:17.587368 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] PATH_INFO: `/v3/projects/cd634e51f5e64bd18f959c4877370ce7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:17.588781 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd634e51f5e64bd18f959c4877370ce7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:17.593071 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:17.650851 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd290b-2e2d-45f6-84b9-597b7759616e None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:17.651339 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd290b-2e2d-45f6-84b9-597b7759616e None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:17.651738 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd290b-2e2d-45f6-84b9-597b7759616e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:17.675753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd634e51f5e64bd18f959c4877370ce7', 'request_id': 'req-e0589d76-fca0-4add-aac9-142cb527167f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.682398 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-8bfd290b-2e2d-45f6-84b9-597b7759616e None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:10:17.684041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8bfd290b-2e2d-45f6-84b9-597b7759616e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:17.688732 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd634e51f5e64bd18f959c4877370ce7', 'request_id': 'req-e0589d76-fca0-4add-aac9-142cb527167f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.708990 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd634e51f5e64bd18f959c4877370ce7', 'request_id': 'req-e0589d76-fca0-4add-aac9-142cb527167f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.711764 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:17.723112 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] The token cache is being invalidate because project cd634e51f5e64bd18f959c4877370ce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:10:17.723718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.724449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.729959 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1355/2722] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:10:17 2022] DELETE /identity/v3/projects/cd634e51f5e64bd18f959c4877370ce7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:10:17.731638 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:17.733472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:17.767281 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:17.782737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1368/2723] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 16:10:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:10:17.813856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0589d76-fca0-4add-aac9-142cb527167f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:17.820866 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e496f-ba00-4616-9f7b-de6d3ffaa07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:17.821651 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e496f-ba00-4616-9f7b-de6d3ffaa07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:17.822266 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e496f-ba00-4616-9f7b-de6d3ffaa07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:17.822425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e496f-ba00-4616-9f7b-de6d3ffaa07e admin admin] PATH_INFO: `/v3/users/78b78754292c4019ae3bcf40965caa69` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:17.824098 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e496f-ba00-4616-9f7b-de6d3ffaa07e admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b78754292c4019ae3bcf40965caa69)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:17.826431 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e496f-ba00-4616-9f7b-de6d3ffaa07e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:17.835146 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd290b-2e2d-45f6-84b9-597b7759616e None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:17.836692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8bfd290b-2e2d-45f6-84b9-597b7759616e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:17.900311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-363e496f-ba00-4616-9f7b-de6d3ffaa07e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b78754292c4019ae3bcf40965caa69'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.901028 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-363e496f-ba00-4616-9f7b-de6d3ffaa07e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b78754292c4019ae3bcf40965caa69'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.902566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-363e496f-ba00-4616-9f7b-de6d3ffaa07e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b78754292c4019ae3bcf40965caa69'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.910233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-363e496f-ba00-4616-9f7b-de6d3ffaa07e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b78754292c4019ae3bcf40965caa69'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.920325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-363e496f-ba00-4616-9f7b-de6d3ffaa07e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b78754292c4019ae3bcf40965caa69'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:17.945054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1356/2724] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:10:17 2022] DELETE /identity/v3/users/78b78754292c4019ae3bcf40965caa69 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:10:17.950723 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd290b-2e2d-45f6-84b9-597b7759616e None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:18.036704 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ba7e4-84ef-4bab-9099-72ed202f6e6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:18.037339 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ba7e4-84ef-4bab-9099-72ed202f6e6e service swift] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:18.037638 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ba7e4-84ef-4bab-9099-72ed202f6e6e service swift] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:18.037903 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ba7e4-84ef-4bab-9099-72ed202f6e6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:18.039907 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-271ba7e4-84ef-4bab-9099-72ed202f6e6e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:18.120234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ba7e4-84ef-4bab-9099-72ed202f6e6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:18.122163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ba7e4-84ef-4bab-9099-72ed202f6e6e service swift] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:18.134770 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1369/2725] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:10:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 16:10:18.153311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e496f-ba00-4616-9f7b-de6d3ffaa07e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:18.155417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-363e496f-ba00-4616-9f7b-de6d3ffaa07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:18.481451 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e496f-ba00-4616-9f7b-de6d3ffaa07e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:18.487695 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:18.488469 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:18.488801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:18.489024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] PATH_INFO: `/v3/projects/779428413fe74e578d1736a7c6eec224` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:18.490258 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=779428413fe74e578d1736a7c6eec224)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:18.492358 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:18.554323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:18.561840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779428413fe74e578d1736a7c6eec224', 'request_id': 'req-c0903f57-d752-47f1-9f98-85663192b8ea'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:18.573451 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779428413fe74e578d1736a7c6eec224', 'request_id': 'req-c0903f57-d752-47f1-9f98-85663192b8ea'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:18.583343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779428413fe74e578d1736a7c6eec224', 'request_id': 'req-c0903f57-d752-47f1-9f98-85663192b8ea'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:18.596719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] The token cache is being invalidate because project 779428413fe74e578d1736a7c6eec224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:10:18.597034 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:18.597731 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:18.599363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1357/2726] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:10:18 2022] DELETE /identity/v3/projects/779428413fe74e578d1736a7c6eec224 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:10:28.129626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=97 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:28.593937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:34.482521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715fdd9-8bad-44c3-8b99-0f6d8009a336 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:34.484607 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715fdd9-8bad-44c3-8b99-0f6d8009a336 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:34.485657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715fdd9-8bad-44c3-8b99-0f6d8009a336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:34.609501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-f715fdd9-8bad-44c3-8b99-0f6d8009a336 None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:10:34.611791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f715fdd9-8bad-44c3-8b99-0f6d8009a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:34.751139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1370/2727] 10.222.0.77 () {58 vars in 967 bytes} [Mon Aug 22 16:10:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:10:34.773745 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:34.775658 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:34.907913 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0903f57-d752-47f1-9f98-85663192b8ea admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:34.913569 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fe8b6-336a-4607-a8ca-bd74dfe34bfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:34.914236 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fe8b6-336a-4607-a8ca-bd74dfe34bfd service swift] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:34.914586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fe8b6-336a-4607-a8ca-bd74dfe34bfd service swift] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:34.915120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fe8b6-336a-4607-a8ca-bd74dfe34bfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:34.928298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fe8b6-336a-4607-a8ca-bd74dfe34bfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:34.929933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fe8b6-336a-4607-a8ca-bd74dfe34bfd service swift] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:34.939305 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1358/2728] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:10:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:10:37.303334 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715fdd9-8bad-44c3-8b99-0f6d8009a336 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:37.305529 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f715fdd9-8bad-44c3-8b99-0f6d8009a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:37.428200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715fdd9-8bad-44c3-8b99-0f6d8009a336 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:37.434783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d593eca-2c61-4885-a593-8ad356a436de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:37.435458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d593eca-2c61-4885-a593-8ad356a436de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:37.435736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d593eca-2c61-4885-a593-8ad356a436de admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:37.436004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d593eca-2c61-4885-a593-8ad356a436de admin admin] PATH_INFO: `/v3/users/6ed3a9d24f594e6bab8a0c2604a2e995` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:37.437148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d593eca-2c61-4885-a593-8ad356a436de admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed3a9d24f594e6bab8a0c2604a2e995)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:37.439155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d593eca-2c61-4885-a593-8ad356a436de admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:37.490814 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:37.503304 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0d593eca-2c61-4885-a593-8ad356a436de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed3a9d24f594e6bab8a0c2604a2e995'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:37.520117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0d593eca-2c61-4885-a593-8ad356a436de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed3a9d24f594e6bab8a0c2604a2e995'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:37.528981 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0d593eca-2c61-4885-a593-8ad356a436de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed3a9d24f594e6bab8a0c2604a2e995'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:37.537158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0d593eca-2c61-4885-a593-8ad356a436de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed3a9d24f594e6bab8a0c2604a2e995'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:37.537925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0d593eca-2c61-4885-a593-8ad356a436de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed3a9d24f594e6bab8a0c2604a2e995'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:37.545439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1371/2729] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:10:37 2022] DELETE /identity/v3/users/6ed3a9d24f594e6bab8a0c2604a2e995 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:10:37.743289 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fe8b6-336a-4607-a8ca-bd74dfe34bfd service swift] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:37.756010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fe8b6-336a-4607-a8ca-bd74dfe34bfd service swift] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:37.833465 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16f0bc-e85e-4aac-b054-f22cbfe58943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:37.834127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16f0bc-e85e-4aac-b054-f22cbfe58943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:37.834403 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16f0bc-e85e-4aac-b054-f22cbfe58943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:37.834719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16f0bc-e85e-4aac-b054-f22cbfe58943 admin admin] PATH_INFO: `/v3/projects/94445b09f7d84f5ab493c98491a65f18` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:37.835894 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16f0bc-e85e-4aac-b054-f22cbfe58943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94445b09f7d84f5ab493c98491a65f18)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:37.837863 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16f0bc-e85e-4aac-b054-f22cbfe58943 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:37.893607 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e16f0bc-e85e-4aac-b054-f22cbfe58943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94445b09f7d84f5ab493c98491a65f18', 'request_id': 'req-5e16f0bc-e85e-4aac-b054-f22cbfe58943'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:37.901299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e16f0bc-e85e-4aac-b054-f22cbfe58943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94445b09f7d84f5ab493c98491a65f18', 'request_id': 'req-5e16f0bc-e85e-4aac-b054-f22cbfe58943'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:37.910765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e16f0bc-e85e-4aac-b054-f22cbfe58943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94445b09f7d84f5ab493c98491a65f18', 'request_id': 'req-5e16f0bc-e85e-4aac-b054-f22cbfe58943'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:37.912988 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:37.925763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e16f0bc-e85e-4aac-b054-f22cbfe58943 admin admin] The token cache is being invalidate because project 94445b09f7d84f5ab493c98491a65f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:10:37.926051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e16f0bc-e85e-4aac-b054-f22cbfe58943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:37.926722 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e16f0bc-e85e-4aac-b054-f22cbfe58943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:37.928238 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1359/2730] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:10:37 2022] DELETE /identity/v3/projects/94445b09f7d84f5ab493c98491a65f18 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:10:37.934442 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51e88b-4ff8-497b-881d-77953a78f8d3 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:37.934802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51e88b-4ff8-497b-881d-77953a78f8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:37.935108 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51e88b-4ff8-497b-881d-77953a78f8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:38.027511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-0f51e88b-4ff8-497b-881d-77953a78f8d3 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:10:38.029502 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0f51e88b-4ff8-497b-881d-77953a78f8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:38.122072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1372/2731] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:10:38.133872 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceecd47-b2bd-4662-9afe-416406e2ecba None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:38.134352 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceecd47-b2bd-4662-9afe-416406e2ecba None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:38.134840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceecd47-b2bd-4662-9afe-416406e2ecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:38.166834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7ceecd47-b2bd-4662-9afe-416406e2ecba None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:10:38.166834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7ceecd47-b2bd-4662-9afe-416406e2ecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:38.175193 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1360/2732] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:10:38.179945 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51e88b-4ff8-497b-881d-77953a78f8d3 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:38.191902 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51e88b-4ff8-497b-881d-77953a78f8d3 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:38.197896 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92578f-632b-4147-b23a-267792b2b9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:38.199024 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92578f-632b-4147-b23a-267792b2b9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:38.199477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92578f-632b-4147-b23a-267792b2b9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:38.199870 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92578f-632b-4147-b23a-267792b2b9e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:38.200906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92578f-632b-4147-b23a-267792b2b9e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:10:38.201436 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92578f-632b-4147-b23a-267792b2b9e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:38.203830 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92578f-632b-4147-b23a-267792b2b9e8 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:38.220878 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1373/2733] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:10:38.227871 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceecd47-b2bd-4662-9afe-416406e2ecba None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:38.240369 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceecd47-b2bd-4662-9afe-416406e2ecba None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:38.251235 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412cd1b-08cf-4333-bd8e-085205658f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:38.252442 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412cd1b-08cf-4333-bd8e-085205658f59 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:38.252845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412cd1b-08cf-4333-bd8e-085205658f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:38.253211 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412cd1b-08cf-4333-bd8e-085205658f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:38.253926 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412cd1b-08cf-4333-bd8e-085205658f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:38.257105 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412cd1b-08cf-4333-bd8e-085205658f59 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:38.293528 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1361/2734] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:10:38 2022] POST /identity/v3/projects => generated 397 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:10:38.300002 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92578f-632b-4147-b23a-267792b2b9e8 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:38.318653 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92578f-632b-4147-b23a-267792b2b9e8 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:38.395076 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae527666-0738-48e7-bb6b-688e39d3229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:38.395745 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae527666-0738-48e7-bb6b-688e39d3229e admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:38.396047 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae527666-0738-48e7-bb6b-688e39d3229e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:38.396299 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae527666-0738-48e7-bb6b-688e39d3229e admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:38.396949 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae527666-0738-48e7-bb6b-688e39d3229e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:38.399195 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae527666-0738-48e7-bb6b-688e39d3229e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:38.416815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:38.425726 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1374/2735] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:10:38 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:10:38.430715 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412cd1b-08cf-4333-bd8e-085205658f59 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:38.443601 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412cd1b-08cf-4333-bd8e-085205658f59 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:38.450277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5fa13-f5ce-416b-9539-3bd8c6c5dc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:38.451015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5fa13-f5ce-416b-9539-3bd8c6c5dc32 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:38.451361 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5fa13-f5ce-416b-9539-3bd8c6c5dc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:38.451655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5fa13-f5ce-416b-9539-3bd8c6c5dc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:38.452308 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5fa13-f5ce-416b-9539-3bd8c6c5dc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:38.453917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5fa13-f5ce-416b-9539-3bd8c6c5dc32 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:38.465818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1362/2736] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:10:38.471008 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae527666-0738-48e7-bb6b-688e39d3229e admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:38.484546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae527666-0738-48e7-bb6b-688e39d3229e admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:38.491219 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7eb75-4991-4536-a6bb-34a04b04e30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:38.492042 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7eb75-4991-4536-a6bb-34a04b04e30f admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:38.492323 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7eb75-4991-4536-a6bb-34a04b04e30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:38.492690 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7eb75-4991-4536-a6bb-34a04b04e30f admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:38.493303 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7eb75-4991-4536-a6bb-34a04b04e30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:38.494987 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7eb75-4991-4536-a6bb-34a04b04e30f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:38.507374 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1375/2737] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:10:38.513004 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5fa13-f5ce-416b-9539-3bd8c6c5dc32 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:38.524705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5fa13-f5ce-416b-9539-3bd8c6c5dc32 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:38.532195 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fb18f-7daa-4b58-a207-47ba154b4ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:38.532855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fb18f-7daa-4b58-a207-47ba154b4ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:38.533137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fb18f-7daa-4b58-a207-47ba154b4ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:38.533637 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549fb18f-7daa-4b58-a207-47ba154b4ea5 admin admin] PATH_INFO: `/v3/projects/5a724a279f7e40dab1b2ccda20e49f56/users/6fa2c898a9ca42e4b388539590908c02/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:38.554343 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fb18f-7daa-4b58-a207-47ba154b4ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a724a279f7e40dab1b2ccda20e49f56, user_id=6fa2c898a9ca42e4b388539590908c02, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:38.558369 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549fb18f-7daa-4b58-a207-47ba154b4ea5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:38.577922 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1363/2738] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:10:38 2022] PUT /identity/v3/projects/5a724a279f7e40dab1b2ccda20e49f56/users/6fa2c898a9ca42e4b388539590908c02/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:10:38.593457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f823953-2e7c-4309-992c-bd9f6e98e051 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:38.593822 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f823953-2e7c-4309-992c-bd9f6e98e051 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:38.594102 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f823953-2e7c-4309-992c-bd9f6e98e051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:38.625896 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1f823953-2e7c-4309-992c-bd9f6e98e051 None None] MFA Rules not processed for user `6fa2c898a9ca42e4b388539590908c02`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:10:38.627262 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1f823953-2e7c-4309-992c-bd9f6e98e051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:38.704301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1376/2739] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:10:38.716712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fb18f-7daa-4b58-a207-47ba154b4ea5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:38.718762 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-549fb18f-7daa-4b58-a207-47ba154b4ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:38.785837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549fb18f-7daa-4b58-a207-47ba154b4ea5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:38.789714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2e864-ba25-4b65-81e0-eb7086906267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:38.790356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2e864-ba25-4b65-81e0-eb7086906267 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:38.790628 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2e864-ba25-4b65-81e0-eb7086906267 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:38.790903 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2e864-ba25-4b65-81e0-eb7086906267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:38.800654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2e864-ba25-4b65-81e0-eb7086906267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:38.802182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2e864-ba25-4b65-81e0-eb7086906267 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:38.811844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1364/2740] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:10:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:10:44.071697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f823953-2e7c-4309-992c-bd9f6e98e051 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:44.157350 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f823953-2e7c-4309-992c-bd9f6e98e051 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:44.164717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54f973-6602-47f0-8732-2a7a0ae0ac4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:44.165471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54f973-6602-47f0-8732-2a7a0ae0ac4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:44.165756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54f973-6602-47f0-8732-2a7a0ae0ac4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:44.166033 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54f973-6602-47f0-8732-2a7a0ae0ac4a admin admin] PATH_INFO: `/v3/users/6fa2c898a9ca42e4b388539590908c02` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:44.168131 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54f973-6602-47f0-8732-2a7a0ae0ac4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa2c898a9ca42e4b388539590908c02)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:44.170469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54f973-6602-47f0-8732-2a7a0ae0ac4a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:44.247232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6f54f973-6602-47f0-8732-2a7a0ae0ac4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa2c898a9ca42e4b388539590908c02'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:44.268414 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6f54f973-6602-47f0-8732-2a7a0ae0ac4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa2c898a9ca42e4b388539590908c02'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:44.280273 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6f54f973-6602-47f0-8732-2a7a0ae0ac4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa2c898a9ca42e4b388539590908c02'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:44.287815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:44.291497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6f54f973-6602-47f0-8732-2a7a0ae0ac4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa2c898a9ca42e4b388539590908c02'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:44.292635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-6f54f973-6602-47f0-8732-2a7a0ae0ac4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa2c898a9ca42e4b388539590908c02'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:44.306443 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1377/2741] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:10:44 2022] DELETE /identity/v3/users/6fa2c898a9ca42e4b388539590908c02 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:10:44.310706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fabf1-ea8b-4ea1-8617-299599e55e85 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:44.311558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fabf1-ea8b-4ea1-8617-299599e55e85 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:44.312030 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fabf1-ea8b-4ea1-8617-299599e55e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:44.341041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a32fabf1-ea8b-4ea1-8617-299599e55e85 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:10:44.342624 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a32fabf1-ea8b-4ea1-8617-299599e55e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:44.421717 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1365/2742] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:10:44.438181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54f973-6602-47f0-8732-2a7a0ae0ac4a admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:44.439964 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-6f54f973-6602-47f0-8732-2a7a0ae0ac4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:44.523402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54f973-6602-47f0-8732-2a7a0ae0ac4a admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:44.528421 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af78ea-14b2-4713-86b0-1b118bd69178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:44.529180 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af78ea-14b2-4713-86b0-1b118bd69178 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:44.529460 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af78ea-14b2-4713-86b0-1b118bd69178 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:44.529709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af78ea-14b2-4713-86b0-1b118bd69178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:44.540801 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af78ea-14b2-4713-86b0-1b118bd69178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:44.543707 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af78ea-14b2-4713-86b0-1b118bd69178 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:44.555228 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1378/2743] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:10:44.673512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fabf1-ea8b-4ea1-8617-299599e55e85 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:44.675170 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a32fabf1-ea8b-4ea1-8617-299599e55e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:44.689840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fabf1-ea8b-4ea1-8617-299599e55e85 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:44.696272 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1091882-750a-498c-a23b-f2d9fa5e1273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:44.697157 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1091882-750a-498c-a23b-f2d9fa5e1273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:44.697942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1091882-750a-498c-a23b-f2d9fa5e1273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:44.697942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1091882-750a-498c-a23b-f2d9fa5e1273 admin admin] PATH_INFO: `/v3/users/344c0b0d05284ef8a5c9e333d6bad3f7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:44.699070 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1091882-750a-498c-a23b-f2d9fa5e1273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=344c0b0d05284ef8a5c9e333d6bad3f7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:44.701382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1091882-750a-498c-a23b-f2d9fa5e1273 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:44.747163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:44.768702 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d1091882-750a-498c-a23b-f2d9fa5e1273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344c0b0d05284ef8a5c9e333d6bad3f7'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:44.769459 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d1091882-750a-498c-a23b-f2d9fa5e1273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344c0b0d05284ef8a5c9e333d6bad3f7'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:44.770129 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d1091882-750a-498c-a23b-f2d9fa5e1273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344c0b0d05284ef8a5c9e333d6bad3f7'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:44.777891 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d1091882-750a-498c-a23b-f2d9fa5e1273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344c0b0d05284ef8a5c9e333d6bad3f7'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:44.787283 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d1091882-750a-498c-a23b-f2d9fa5e1273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344c0b0d05284ef8a5c9e333d6bad3f7'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:44.818932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1366/2744] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:10:44 2022] DELETE /identity/v3/users/344c0b0d05284ef8a5c9e333d6bad3f7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:10:44.909399 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af78ea-14b2-4713-86b0-1b118bd69178 service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:44.911739 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-64af78ea-14b2-4713-86b0-1b118bd69178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:44.928246 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af78ea-14b2-4713-86b0-1b118bd69178 service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:44.997942 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:44.998470 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:44.998777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:44.999134 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] PATH_INFO: `/v3/projects/5a724a279f7e40dab1b2ccda20e49f56` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:45.000428 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a724a279f7e40dab1b2ccda20e49f56)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:45.002387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:45.018023 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1091882-750a-498c-a23b-f2d9fa5e1273 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:45.020224 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d1091882-750a-498c-a23b-f2d9fa5e1273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:45.042329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1091882-750a-498c-a23b-f2d9fa5e1273 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:45.048966 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438d1ec-6629-40e7-b5c1-5251d98e4f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:45.049625 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438d1ec-6629-40e7-b5c1-5251d98e4f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:45.049910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438d1ec-6629-40e7-b5c1-5251d98e4f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:45.050176 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438d1ec-6629-40e7-b5c1-5251d98e4f19 admin admin] PATH_INFO: `/v3/projects/755c8ec562364bc389b8d6be75438789` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:45.051544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438d1ec-6629-40e7-b5c1-5251d98e4f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=755c8ec562364bc389b8d6be75438789)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:45.053948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438d1ec-6629-40e7-b5c1-5251d98e4f19 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:45.078515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a724a279f7e40dab1b2ccda20e49f56', 'request_id': 'req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:45.089172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a724a279f7e40dab1b2ccda20e49f56', 'request_id': 'req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:45.097490 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a724a279f7e40dab1b2ccda20e49f56', 'request_id': 'req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:45.111497 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] The token cache is being invalidate because project 5a724a279f7e40dab1b2ccda20e49f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:10:45.111795 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:45.112538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:45.113655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6438d1ec-6629-40e7-b5c1-5251d98e4f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755c8ec562364bc389b8d6be75438789', 'request_id': 'req-6438d1ec-6629-40e7-b5c1-5251d98e4f19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:45.114104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1379/2745] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:10:44 2022] DELETE /identity/v3/projects/5a724a279f7e40dab1b2ccda20e49f56 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:10:45.121403 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6438d1ec-6629-40e7-b5c1-5251d98e4f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755c8ec562364bc389b8d6be75438789', 'request_id': 'req-6438d1ec-6629-40e7-b5c1-5251d98e4f19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:45.133535 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6438d1ec-6629-40e7-b5c1-5251d98e4f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755c8ec562364bc389b8d6be75438789', 'request_id': 'req-6438d1ec-6629-40e7-b5c1-5251d98e4f19'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:45.148805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6438d1ec-6629-40e7-b5c1-5251d98e4f19 admin admin] The token cache is being invalidate because project 755c8ec562364bc389b8d6be75438789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:10:45.149259 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6438d1ec-6629-40e7-b5c1-5251d98e4f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:45.150138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6438d1ec-6629-40e7-b5c1-5251d98e4f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:10:45.151857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1367/2746] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:10:45 2022] DELETE /identity/v3/projects/755c8ec562364bc389b8d6be75438789 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:10:46.623467 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:10:46.625036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:46.670386 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:46.743038 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93c25b-f056-43e5-ac2a-6ff0d8204b08 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:10:46.808873 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f288f54-c6ac-445f-af03-86f2391fae10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be9a664d10d438382b9e359b26ba86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:10:46.809492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f288f54-c6ac-445f-af03-86f2391fae10 service placement] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:10:46.809778 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f288f54-c6ac-445f-af03-86f2391fae10 service placement] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:10:46.810045 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f288f54-c6ac-445f-af03-86f2391fae10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:10:46.811882 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-6f288f54-c6ac-445f-af03-86f2391fae10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:10:46.823947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f288f54-c6ac-445f-af03-86f2391fae10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:10:46.825564 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f288f54-c6ac-445f-af03-86f2391fae10 service placement] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:10:46.836654 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1380/2747] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:10:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:10:55.145066 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=45,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:10:56.831687 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=54 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:12:21.608753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3221de-5822-4730-ae5e-8be33d64271c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:12:21.609376 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3221de-5822-4730-ae5e-8be33d64271c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:12:21.609376 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3221de-5822-4730-ae5e-8be33d64271c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:12:21.630652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5d3221de-5822-4730-ae5e-8be33d64271c None None] MFA Rules not processed for user `6e5b026ac5af4fbc84069f1580978bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:12:21.631898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5d3221de-5822-4730-ae5e-8be33d64271c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:12:21.703466 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1368/2748] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:12:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:12:31.703228 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=25 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:12:37.171780 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f288f54-c6ac-445f-af03-86f2391fae10 service placement] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:12:37.173400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-6f288f54-c6ac-445f-af03-86f2391fae10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:12:37.269151 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f288f54-c6ac-445f-af03-86f2391fae10 service placement] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:12:37.272933 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7215e3-0041-4f5d-8ae0-fc483e537eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:12:37.273519 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7215e3-0041-4f5d-8ae0-fc483e537eae service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:12:37.273792 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7215e3-0041-4f5d-8ae0-fc483e537eae service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:12:37.274060 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7215e3-0041-4f5d-8ae0-fc483e537eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:12:37.275953 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9c7215e3-0041-4f5d-8ae0-fc483e537eae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:12:37.369939 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7215e3-0041-4f5d-8ae0-fc483e537eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:12:37.371383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7215e3-0041-4f5d-8ae0-fc483e537eae service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:12:37.394947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1381/2749] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:12:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:12:38.586209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3221de-5822-4730-ae5e-8be33d64271c None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:12:38.587747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5d3221de-5822-4730-ae5e-8be33d64271c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:12:38.601287 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3221de-5822-4730-ae5e-8be33d64271c None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:12:38.605817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e49a5-cc35-4ca3-bac4-e2da1c2a12e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:12:38.606438 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e49a5-cc35-4ca3-bac4-e2da1c2a12e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:12:38.606820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e49a5-cc35-4ca3-bac4-e2da1c2a12e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:12:38.607014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e49a5-cc35-4ca3-bac4-e2da1c2a12e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:12:38.609524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a98e49a5-cc35-4ca3-bac4-e2da1c2a12e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:12:38.624512 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e49a5-cc35-4ca3-bac4-e2da1c2a12e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:12:38.625945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e49a5-cc35-4ca3-bac4-e2da1c2a12e2 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:12:38.637580 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1369/2750] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:12:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:12:47.391600 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=72 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:12:48.632481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=6 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:29.538153 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7215e3-0041-4f5d-8ae0-fc483e537eae service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:29.540020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-9c7215e3-0041-4f5d-8ae0-fc483e537eae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:29.561508 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7215e3-0041-4f5d-8ae0-fc483e537eae service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:29.570079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca31ef-010b-43e2-8b09-fddd31d15d53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:29.570954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca31ef-010b-43e2-8b09-fddd31d15d53 service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:29.571243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca31ef-010b-43e2-8b09-fddd31d15d53 service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:29.571579 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca31ef-010b-43e2-8b09-fddd31d15d53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:29.574026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8aca31ef-010b-43e2-8b09-fddd31d15d53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:29.598682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca31ef-010b-43e2-8b09-fddd31d15d53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:29.600788 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca31ef-010b-43e2-8b09-fddd31d15d53 service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:29.615405 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1382/2751] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:13:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:13:39.163509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e49a5-cc35-4ca3-bac4-e2da1c2a12e2 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:39.165909 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a98e49a5-cc35-4ca3-bac4-e2da1c2a12e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:39.235890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e49a5-cc35-4ca3-bac4-e2da1c2a12e2 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:39.241800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac037ca7-f0a0-447d-bc7e-3fc10deecc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:39.242529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac037ca7-f0a0-447d-bc7e-3fc10deecc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:39.242848 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac037ca7-f0a0-447d-bc7e-3fc10deecc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:39.243122 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac037ca7-f0a0-447d-bc7e-3fc10deecc04 admin admin] PATH_INFO: `/v3/users/6e5b026ac5af4fbc84069f1580978bc8` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:39.244313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac037ca7-f0a0-447d-bc7e-3fc10deecc04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e5b026ac5af4fbc84069f1580978bc8)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:39.246393 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac037ca7-f0a0-447d-bc7e-3fc10deecc04 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:39.307661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ac037ca7-f0a0-447d-bc7e-3fc10deecc04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e5b026ac5af4fbc84069f1580978bc8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:39.308351 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ac037ca7-f0a0-447d-bc7e-3fc10deecc04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e5b026ac5af4fbc84069f1580978bc8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:39.309031 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ac037ca7-f0a0-447d-bc7e-3fc10deecc04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e5b026ac5af4fbc84069f1580978bc8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:39.317365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ac037ca7-f0a0-447d-bc7e-3fc10deecc04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e5b026ac5af4fbc84069f1580978bc8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:39.326836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ac037ca7-f0a0-447d-bc7e-3fc10deecc04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e5b026ac5af4fbc84069f1580978bc8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:39.347389 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1370/2752] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:13:39 2022] DELETE /identity/v3/users/6e5b026ac5af4fbc84069f1580978bc8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:39.554191 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca31ef-010b-43e2-8b09-fddd31d15d53 service nova] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:39.571619 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca31ef-010b-43e2-8b09-fddd31d15d53 service nova] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:39.636387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d633b-8fff-48a0-b58a-fd76fac7ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:39.637029 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d633b-8fff-48a0-b58a-fd76fac7ab1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:39.637303 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d633b-8fff-48a0-b58a-fd76fac7ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:39.637576 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d633b-8fff-48a0-b58a-fd76fac7ab1f admin admin] PATH_INFO: `/v3/projects/4dc4f2c309ba4888b22f58c7fe030698` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:39.638968 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d633b-8fff-48a0-b58a-fd76fac7ab1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc4f2c309ba4888b22f58c7fe030698)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:39.640930 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d633b-8fff-48a0-b58a-fd76fac7ab1f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:39.697135 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-189d633b-8fff-48a0-b58a-fd76fac7ab1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc4f2c309ba4888b22f58c7fe030698', 'request_id': 'req-189d633b-8fff-48a0-b58a-fd76fac7ab1f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:39.706143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-189d633b-8fff-48a0-b58a-fd76fac7ab1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc4f2c309ba4888b22f58c7fe030698', 'request_id': 'req-189d633b-8fff-48a0-b58a-fd76fac7ab1f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:39.713393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-189d633b-8fff-48a0-b58a-fd76fac7ab1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc4f2c309ba4888b22f58c7fe030698', 'request_id': 'req-189d633b-8fff-48a0-b58a-fd76fac7ab1f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:39.727261 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-189d633b-8fff-48a0-b58a-fd76fac7ab1f admin admin] The token cache is being invalidate because project 4dc4f2c309ba4888b22f58c7fe030698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:13:39.727547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-189d633b-8fff-48a0-b58a-fd76fac7ab1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:39.728359 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-189d633b-8fff-48a0-b58a-fd76fac7ab1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:39.730249 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1383/2753] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:13:39 2022] DELETE /identity/v3/projects/4dc4f2c309ba4888b22f58c7fe030698 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:39.735987 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7741a-84b9-42b6-ab65-b93810486e0e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:39.736264 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7741a-84b9-42b6-ab65-b93810486e0e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:39.736533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7741a-84b9-42b6-ab65-b93810486e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:39.759152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c5b7741a-84b9-42b6-ab65-b93810486e0e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:39.760657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c5b7741a-84b9-42b6-ab65-b93810486e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:39.837996 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1371/2754] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:39.848117 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbf5af-a0ee-4270-b75a-cee9489c75f1 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:39.848417 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbf5af-a0ee-4270-b75a-cee9489c75f1 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:39.848864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbf5af-a0ee-4270-b75a-cee9489c75f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:39.883480 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-25bbf5af-a0ee-4270-b75a-cee9489c75f1 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:39.885025 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-25bbf5af-a0ee-4270-b75a-cee9489c75f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:39.893904 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1384/2755] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:39.899075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7741a-84b9-42b6-ab65-b93810486e0e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:39.913782 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7741a-84b9-42b6-ab65-b93810486e0e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:39.919209 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f46dcb-825d-4186-9c23-e6f1c217f834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:39.919847 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f46dcb-825d-4186-9c23-e6f1c217f834 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:39.920126 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f46dcb-825d-4186-9c23-e6f1c217f834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:39.920425 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f46dcb-825d-4186-9c23-e6f1c217f834 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:39.921161 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f46dcb-825d-4186-9c23-e6f1c217f834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:13:39.921614 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f46dcb-825d-4186-9c23-e6f1c217f834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:39.923450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f46dcb-825d-4186-9c23-e6f1c217f834 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:39.937765 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1372/2756] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:13:39.942541 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbf5af-a0ee-4270-b75a-cee9489c75f1 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:39.952766 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbf5af-a0ee-4270-b75a-cee9489c75f1 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:39.958278 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d4b17-4284-4431-87de-9f237b9edac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:39.958959 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d4b17-4284-4431-87de-9f237b9edac4 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:39.959240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d4b17-4284-4431-87de-9f237b9edac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:39.959518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d4b17-4284-4431-87de-9f237b9edac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:39.960230 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d4b17-4284-4431-87de-9f237b9edac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:39.962316 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d4b17-4284-4431-87de-9f237b9edac4 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:40.004815 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1385/2757] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:13:39 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:13:40.009790 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f46dcb-825d-4186-9c23-e6f1c217f834 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:40.020397 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f46dcb-825d-4186-9c23-e6f1c217f834 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:40.024440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:40.100646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20148e-7e02-45f4-bef1-d2dde3956e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:40.101336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20148e-7e02-45f4-bef1-d2dde3956e9e admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:40.101657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20148e-7e02-45f4-bef1-d2dde3956e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:40.101927 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20148e-7e02-45f4-bef1-d2dde3956e9e admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:40.102585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20148e-7e02-45f4-bef1-d2dde3956e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:40.104603 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20148e-7e02-45f4-bef1-d2dde3956e9e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:40.131007 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1373/2758] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:13:40 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:13:40.137186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d4b17-4284-4431-87de-9f237b9edac4 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:40.150643 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d4b17-4284-4431-87de-9f237b9edac4 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:40.156158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d194c-a503-4b3f-a7c7-13003542de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:40.156836 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d194c-a503-4b3f-a7c7-13003542de1b admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:40.157120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d194c-a503-4b3f-a7c7-13003542de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:40.157389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d194c-a503-4b3f-a7c7-13003542de1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:40.158073 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d194c-a503-4b3f-a7c7-13003542de1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:40.159854 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d194c-a503-4b3f-a7c7-13003542de1b admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:40.171845 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1386/2759] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:40.176759 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20148e-7e02-45f4-bef1-d2dde3956e9e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:40.192444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20148e-7e02-45f4-bef1-d2dde3956e9e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:40.199118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807201e-5110-4dc7-8ca2-612a3bd32b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:40.199836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807201e-5110-4dc7-8ca2-612a3bd32b2f admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:40.200111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807201e-5110-4dc7-8ca2-612a3bd32b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:40.200378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807201e-5110-4dc7-8ca2-612a3bd32b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:40.201444 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807201e-5110-4dc7-8ca2-612a3bd32b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:40.202705 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807201e-5110-4dc7-8ca2-612a3bd32b2f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:40.223296 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1374/2760] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:40.231835 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d194c-a503-4b3f-a7c7-13003542de1b admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:40.249170 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d194c-a503-4b3f-a7c7-13003542de1b admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:40.256053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e2714-318f-4856-bb3f-185c3ee52181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:40.257006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e2714-318f-4856-bb3f-185c3ee52181 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:40.257424 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e2714-318f-4856-bb3f-185c3ee52181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:40.257887 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e2714-318f-4856-bb3f-185c3ee52181 admin admin] PATH_INFO: `/v3/projects/f8e1051a7d3a4f69a3022503ac7a7266/users/20fe86f9806a4f7a8294093f2b1fbf47/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:40.276705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e2714-318f-4856-bb3f-185c3ee52181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e1051a7d3a4f69a3022503ac7a7266, user_id=20fe86f9806a4f7a8294093f2b1fbf47, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:40.279159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e2714-318f-4856-bb3f-185c3ee52181 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:40.295735 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1387/2761] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:40 2022] PUT /identity/v3/projects/f8e1051a7d3a4f69a3022503ac7a7266/users/20fe86f9806a4f7a8294093f2b1fbf47/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:40.308118 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db776b-8051-4205-be2a-4bb7d4cb4eb5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:40.308575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db776b-8051-4205-be2a-4bb7d4cb4eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:40.309042 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db776b-8051-4205-be2a-4bb7d4cb4eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:40.355797 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a7db776b-8051-4205-be2a-4bb7d4cb4eb5 None None] MFA Rules not processed for user `20fe86f9806a4f7a8294093f2b1fbf47`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:40.357510 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a7db776b-8051-4205-be2a-4bb7d4cb4eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:40.437583 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1375/2762] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:40.444491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e2714-318f-4856-bb3f-185c3ee52181 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:40.451632 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:40.527324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e2714-318f-4856-bb3f-185c3ee52181 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:40.533569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37823723-d245-40b6-a0e8-642bf9a7ec5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:40.534186 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37823723-d245-40b6-a0e8-642bf9a7ec5a admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:40.534633 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37823723-d245-40b6-a0e8-642bf9a7ec5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:40.534951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37823723-d245-40b6-a0e8-642bf9a7ec5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:40.535671 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37823723-d245-40b6-a0e8-642bf9a7ec5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:40.537643 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37823723-d245-40b6-a0e8-642bf9a7ec5a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:40.573452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1388/2763] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:13:40 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:13:40.579372 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db776b-8051-4205-be2a-4bb7d4cb4eb5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:40.595828 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db776b-8051-4205-be2a-4bb7d4cb4eb5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:40.675818 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feeb0eb-8d4a-450c-a231-fed19dc2390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:40.676685 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeb0eb-8d4a-450c-a231-fed19dc2390f admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:40.677095 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeb0eb-8d4a-450c-a231-fed19dc2390f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:40.677477 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeb0eb-8d4a-450c-a231-fed19dc2390f admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:40.678384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feeb0eb-8d4a-450c-a231-fed19dc2390f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:40.681523 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feeb0eb-8d4a-450c-a231-fed19dc2390f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:40.709617 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1376/2764] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:13:40 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:13:40.714098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37823723-d245-40b6-a0e8-642bf9a7ec5a admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:40.726020 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37823723-d245-40b6-a0e8-642bf9a7ec5a admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:40.731783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2d590-ca59-45d7-9e8b-e1985e3f5896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:40.732469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2d590-ca59-45d7-9e8b-e1985e3f5896 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:40.732958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2d590-ca59-45d7-9e8b-e1985e3f5896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:40.732958 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2d590-ca59-45d7-9e8b-e1985e3f5896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:40.733564 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2d590-ca59-45d7-9e8b-e1985e3f5896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:40.735231 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2d590-ca59-45d7-9e8b-e1985e3f5896 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:40.747350 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1389/2765] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:40.751831 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feeb0eb-8d4a-450c-a231-fed19dc2390f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:40.758989 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:40.763262 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feeb0eb-8d4a-450c-a231-fed19dc2390f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:40.769609 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496084e-db98-4d8f-a74e-87ddea726455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:40.770455 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496084e-db98-4d8f-a74e-87ddea726455 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:40.770974 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496084e-db98-4d8f-a74e-87ddea726455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:40.771245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496084e-db98-4d8f-a74e-87ddea726455 admin admin] PATH_INFO: `/v3/projects/35c474874751456b9120b62143f95339/users/d8ecfe7c14d34da6914136e1bc65e012/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:40.790784 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496084e-db98-4d8f-a74e-87ddea726455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c474874751456b9120b62143f95339, user_id=d8ecfe7c14d34da6914136e1bc65e012, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:40.793758 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496084e-db98-4d8f-a74e-87ddea726455 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:40.814377 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1377/2766] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:40 2022] PUT /identity/v3/projects/35c474874751456b9120b62143f95339/users/d8ecfe7c14d34da6914136e1bc65e012/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:40.820407 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2d590-ca59-45d7-9e8b-e1985e3f5896 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:40.836481 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2d590-ca59-45d7-9e8b-e1985e3f5896 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:40.926384 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba50e3d-96a1-46da-9a8d-96177b34969f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:40.927389 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50e3d-96a1-46da-9a8d-96177b34969f admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:40.927839 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50e3d-96a1-46da-9a8d-96177b34969f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:40.928278 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50e3d-96a1-46da-9a8d-96177b34969f admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:40.929343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba50e3d-96a1-46da-9a8d-96177b34969f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:40.932235 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba50e3d-96a1-46da-9a8d-96177b34969f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:40.949505 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1390/2767] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:40.953813 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496084e-db98-4d8f-a74e-87ddea726455 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:40.965654 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496084e-db98-4d8f-a74e-87ddea726455 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:40.971023 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6dba9-b538-4821-ad74-f84f1e7b3ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:40.971694 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6dba9-b538-4821-ad74-f84f1e7b3ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:40.971961 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6dba9-b538-4821-ad74-f84f1e7b3ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:40.972231 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6dba9-b538-4821-ad74-f84f1e7b3ea9 admin admin] PATH_INFO: `/v3/projects/35c474874751456b9120b62143f95339/users/d8ecfe7c14d34da6914136e1bc65e012/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:40.974203 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6dba9-b538-4821-ad74-f84f1e7b3ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c474874751456b9120b62143f95339, user_id=d8ecfe7c14d34da6914136e1bc65e012, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:40.977053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6dba9-b538-4821-ad74-f84f1e7b3ea9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:40.988507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1378/2768] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:40 2022] PUT /identity/v3/projects/35c474874751456b9120b62143f95339/users/d8ecfe7c14d34da6914136e1bc65e012/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:41.001621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e10850-98b7-46cb-b02e-30ef0c32c63f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:41.001889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e10850-98b7-46cb-b02e-30ef0c32c63f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:41.002168 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e10850-98b7-46cb-b02e-30ef0c32c63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:41.036578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-52e10850-98b7-46cb-b02e-30ef0c32c63f None None] MFA Rules not processed for user `d8ecfe7c14d34da6914136e1bc65e012`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:41.037832 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-52e10850-98b7-46cb-b02e-30ef0c32c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:41.109455 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:41.115865 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1391/2769] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:41.130458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6dba9-b538-4821-ad74-f84f1e7b3ea9 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:41.133076 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5dd6dba9-b538-4821-ad74-f84f1e7b3ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:41.221968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6dba9-b538-4821-ad74-f84f1e7b3ea9 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:41.226948 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f52af8-6b72-4f80-8fb7-5ea42a941071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:41.227555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f52af8-6b72-4f80-8fb7-5ea42a941071 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:41.227830 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f52af8-6b72-4f80-8fb7-5ea42a941071 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:41.228096 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f52af8-6b72-4f80-8fb7-5ea42a941071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:41.237790 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f52af8-6b72-4f80-8fb7-5ea42a941071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:41.239277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f52af8-6b72-4f80-8fb7-5ea42a941071 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:41.249044 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1379/2770] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:13:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:13:41.297375 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e10850-98b7-46cb-b02e-30ef0c32c63f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:41.298986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-52e10850-98b7-46cb-b02e-30ef0c32c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:41.311528 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e10850-98b7-46cb-b02e-30ef0c32c63f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:41.315584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bd397-05df-452e-a33c-e23463ec2ebd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:41.316185 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bd397-05df-452e-a33c-e23463ec2ebd service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:41.316458 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bd397-05df-452e-a33c-e23463ec2ebd service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:41.317033 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bd397-05df-452e-a33c-e23463ec2ebd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:41.377663 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bd397-05df-452e-a33c-e23463ec2ebd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:41.379087 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bd397-05df-452e-a33c-e23463ec2ebd service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:41.388343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1392/2771] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:13:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:13:44.795093 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f52af8-6b72-4f80-8fb7-5ea42a941071 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:44.860994 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f52af8-6b72-4f80-8fb7-5ea42a941071 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:44.865983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c81a18-1433-45f4-b9b6-e5450dea0b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:44.866621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c81a18-1433-45f4-b9b6-e5450dea0b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:44.866898 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c81a18-1433-45f4-b9b6-e5450dea0b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:44.867179 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c81a18-1433-45f4-b9b6-e5450dea0b48 admin admin] PATH_INFO: `/v3/users/20fe86f9806a4f7a8294093f2b1fbf47` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:44.868443 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c81a18-1433-45f4-b9b6-e5450dea0b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20fe86f9806a4f7a8294093f2b1fbf47)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:44.870408 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c81a18-1433-45f4-b9b6-e5450dea0b48 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:44.921354 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d8c81a18-1433-45f4-b9b6-e5450dea0b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20fe86f9806a4f7a8294093f2b1fbf47'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:44.922007 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d8c81a18-1433-45f4-b9b6-e5450dea0b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20fe86f9806a4f7a8294093f2b1fbf47'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:44.922629 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d8c81a18-1433-45f4-b9b6-e5450dea0b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20fe86f9806a4f7a8294093f2b1fbf47'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:44.927247 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:44.930080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d8c81a18-1433-45f4-b9b6-e5450dea0b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20fe86f9806a4f7a8294093f2b1fbf47'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:44.939314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d8c81a18-1433-45f4-b9b6-e5450dea0b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20fe86f9806a4f7a8294093f2b1fbf47'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:44.956800 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1380/2772] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:13:44 2022] DELETE /identity/v3/users/20fe86f9806a4f7a8294093f2b1fbf47 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:44.961656 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f450e4-e7f0-4fbf-b789-47bce0f17c50 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:44.962150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f450e4-e7f0-4fbf-b789-47bce0f17c50 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:44.962150 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f450e4-e7f0-4fbf-b789-47bce0f17c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:44.981916 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-c0f450e4-e7f0-4fbf-b789-47bce0f17c50 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:44.983163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c0f450e4-e7f0-4fbf-b789-47bce0f17c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:45.045267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1393/2773] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:45.056865 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c81a18-1433-45f4-b9b6-e5450dea0b48 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:45.058484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d8c81a18-1433-45f4-b9b6-e5450dea0b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:45.118937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c81a18-1433-45f4-b9b6-e5450dea0b48 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:45.123197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9cc78-b2f2-4b93-a414-5a5176af691b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:45.123808 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9cc78-b2f2-4b93-a414-5a5176af691b service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:45.124065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9cc78-b2f2-4b93-a414-5a5176af691b service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:45.124318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9cc78-b2f2-4b93-a414-5a5176af691b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:45.136653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9cc78-b2f2-4b93-a414-5a5176af691b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:45.138089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9cc78-b2f2-4b93-a414-5a5176af691b service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:45.148089 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1381/2774] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:13:45.433287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f450e4-e7f0-4fbf-b789-47bce0f17c50 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:45.435253 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-c0f450e4-e7f0-4fbf-b789-47bce0f17c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:45.453067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f450e4-e7f0-4fbf-b789-47bce0f17c50 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:45.459658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:45.460418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:45.460718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:45.461194 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] PATH_INFO: `/v3/projects/f8e1051a7d3a4f69a3022503ac7a7266` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:45.462562 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e1051a7d3a4f69a3022503ac7a7266)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:45.464588 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:45.514644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e1051a7d3a4f69a3022503ac7a7266', 'request_id': 'req-d6bbafae-5cfa-4362-b89a-144c4e05c44f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:45.523110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e1051a7d3a4f69a3022503ac7a7266', 'request_id': 'req-d6bbafae-5cfa-4362-b89a-144c4e05c44f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:45.530370 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e1051a7d3a4f69a3022503ac7a7266', 'request_id': 'req-d6bbafae-5cfa-4362-b89a-144c4e05c44f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:45.546043 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] The token cache is being invalidate because project f8e1051a7d3a4f69a3022503ac7a7266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:13:45.546331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:45.547131 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:45.549552 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1394/2775] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:13:45 2022] DELETE /identity/v3/projects/f8e1051a7d3a4f69a3022503ac7a7266 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:45.554210 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9cc78-b2f2-4b93-a414-5a5176af691b service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:45.567910 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9cc78-b2f2-4b93-a414-5a5176af691b service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:45.646539 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215035c-1666-4882-9289-85c237624b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:45.647227 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215035c-1666-4882-9289-85c237624b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:45.647499 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215035c-1666-4882-9289-85c237624b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:45.647776 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215035c-1666-4882-9289-85c237624b2f admin admin] PATH_INFO: `/v3/users/d8ecfe7c14d34da6914136e1bc65e012` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:45.649120 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215035c-1666-4882-9289-85c237624b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ecfe7c14d34da6914136e1bc65e012)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:45.651554 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215035c-1666-4882-9289-85c237624b2f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:45.707508 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8215035c-1666-4882-9289-85c237624b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ecfe7c14d34da6914136e1bc65e012'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:45.708222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8215035c-1666-4882-9289-85c237624b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ecfe7c14d34da6914136e1bc65e012'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:45.708832 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8215035c-1666-4882-9289-85c237624b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ecfe7c14d34da6914136e1bc65e012'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:45.716153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8215035c-1666-4882-9289-85c237624b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ecfe7c14d34da6914136e1bc65e012'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:45.725749 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8215035c-1666-4882-9289-85c237624b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ecfe7c14d34da6914136e1bc65e012'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:45.734855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:45.751832 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1382/2776] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:13:45 2022] DELETE /identity/v3/users/d8ecfe7c14d34da6914136e1bc65e012 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:46.043765 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:46.045263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:46.059857 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbafae-5cfa-4362-b89a-144c4e05c44f admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:46.080954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:46.122705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cb8d0-0904-498d-a662-0f94970a75a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:46.123348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb8d0-0904-498d-a662-0f94970a75a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:46.123622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb8d0-0904-498d-a662-0f94970a75a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:46.123904 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb8d0-0904-498d-a662-0f94970a75a6 admin admin] PATH_INFO: `/v3/projects/35c474874751456b9120b62143f95339` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:46.125074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cb8d0-0904-498d-a662-0f94970a75a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c474874751456b9120b62143f95339)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:46.127053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cb8d0-0904-498d-a662-0f94970a75a6 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:46.178453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-557cb8d0-0904-498d-a662-0f94970a75a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c474874751456b9120b62143f95339', 'request_id': 'req-557cb8d0-0904-498d-a662-0f94970a75a6'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:46.187250 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-557cb8d0-0904-498d-a662-0f94970a75a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c474874751456b9120b62143f95339', 'request_id': 'req-557cb8d0-0904-498d-a662-0f94970a75a6'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:46.195028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-557cb8d0-0904-498d-a662-0f94970a75a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c474874751456b9120b62143f95339', 'request_id': 'req-557cb8d0-0904-498d-a662-0f94970a75a6'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:46.206759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-557cb8d0-0904-498d-a662-0f94970a75a6 admin admin] The token cache is being invalidate because project 35c474874751456b9120b62143f95339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:13:46.207053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-557cb8d0-0904-498d-a662-0f94970a75a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:46.207789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-557cb8d0-0904-498d-a662-0f94970a75a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:46.209404 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1395/2777] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:13:46 2022] DELETE /identity/v3/projects/35c474874751456b9120b62143f95339 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:13:46.214908 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a0917-143a-4dfb-84a8-9ef693783ca7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:46.215442 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a0917-143a-4dfb-84a8-9ef693783ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:46.215442 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a0917-143a-4dfb-84a8-9ef693783ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:46.237533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2f2a0917-143a-4dfb-84a8-9ef693783ca7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:46.238787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2f2a0917-143a-4dfb-84a8-9ef693783ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:46.305314 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1383/2778] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:46.313343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398a3c-3a43-4e8a-b0d6-52579ea4a60f None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:46.313623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398a3c-3a43-4e8a-b0d6-52579ea4a60f None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:46.313894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398a3c-3a43-4e8a-b0d6-52579ea4a60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:46.338391 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-f1398a3c-3a43-4e8a-b0d6-52579ea4a60f None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:46.339507 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f1398a3c-3a43-4e8a-b0d6-52579ea4a60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:46.348982 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1396/2779] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:46.354068 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a0917-143a-4dfb-84a8-9ef693783ca7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:46.364525 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a0917-143a-4dfb-84a8-9ef693783ca7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:46.369455 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9624f-f96f-4570-a5db-5820be4d01a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:46.370064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9624f-f96f-4570-a5db-5820be4d01a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:46.370336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9624f-f96f-4570-a5db-5820be4d01a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:46.370623 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9624f-f96f-4570-a5db-5820be4d01a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:46.371917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9624f-f96f-4570-a5db-5820be4d01a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:13:46.372221 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9624f-f96f-4570-a5db-5820be4d01a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:46.373817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9624f-f96f-4570-a5db-5820be4d01a6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:46.391315 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1384/2780] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:13:46.395951 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1398a3c-3a43-4e8a-b0d6-52579ea4a60f None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:46.406583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1398a3c-3a43-4e8a-b0d6-52579ea4a60f None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:46.412355 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea682188-2631-49c7-a079-89e3d2a95804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:46.412590 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea682188-2631-49c7-a079-89e3d2a95804 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:46.412759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea682188-2631-49c7-a079-89e3d2a95804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:46.413027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea682188-2631-49c7-a079-89e3d2a95804 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:46.413888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea682188-2631-49c7-a079-89e3d2a95804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:46.415639 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea682188-2631-49c7-a079-89e3d2a95804 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:46.451086 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1397/2781] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:13:46 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:13:46.455642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9624f-f96f-4570-a5db-5820be4d01a6 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:46.466250 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9624f-f96f-4570-a5db-5820be4d01a6 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:46.529414 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307f6c-0cd3-4091-ae3f-8f0d2f9956a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:46.530022 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307f6c-0cd3-4091-ae3f-8f0d2f9956a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:46.530311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307f6c-0cd3-4091-ae3f-8f0d2f9956a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:46.530680 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307f6c-0cd3-4091-ae3f-8f0d2f9956a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:46.531229 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14307f6c-0cd3-4091-ae3f-8f0d2f9956a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:46.533187 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14307f6c-0cd3-4091-ae3f-8f0d2f9956a9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:46.561968 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1385/2782] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:13:46 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:13:46.567176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea682188-2631-49c7-a079-89e3d2a95804 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:46.580452 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea682188-2631-49c7-a079-89e3d2a95804 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:46.585616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a07f3-7ec3-4b2d-9e29-152f07604ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:46.586267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a07f3-7ec3-4b2d-9e29-152f07604ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:46.586540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a07f3-7ec3-4b2d-9e29-152f07604ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:46.586840 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a07f3-7ec3-4b2d-9e29-152f07604ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:46.587486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a07f3-7ec3-4b2d-9e29-152f07604ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:46.589110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a07f3-7ec3-4b2d-9e29-152f07604ec5 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:46.600489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1398/2783] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:46.605131 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307f6c-0cd3-4091-ae3f-8f0d2f9956a9 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:46.616038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307f6c-0cd3-4091-ae3f-8f0d2f9956a9 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:46.622254 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b290c4-83a0-4966-904b-1d66a12fc4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:46.623128 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b290c4-83a0-4966-904b-1d66a12fc4af admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:46.623441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b290c4-83a0-4966-904b-1d66a12fc4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:46.623978 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b290c4-83a0-4966-904b-1d66a12fc4af admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:46.624624 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b290c4-83a0-4966-904b-1d66a12fc4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:46.626329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b290c4-83a0-4966-904b-1d66a12fc4af admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:46.638084 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1386/2784] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:46.642585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a07f3-7ec3-4b2d-9e29-152f07604ec5 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:46.653351 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a07f3-7ec3-4b2d-9e29-152f07604ec5 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:46.659256 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dbd14-3028-4ba9-918d-bfc67378e6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:46.659918 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dbd14-3028-4ba9-918d-bfc67378e6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:46.660193 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dbd14-3028-4ba9-918d-bfc67378e6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:46.660462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dbd14-3028-4ba9-918d-bfc67378e6ed admin admin] PATH_INFO: `/v3/projects/8b397540dc0a42fbb5d2776ea2f494b9/users/20f4f241c3954c0fb07fb2a9fef87f18/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:46.678517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dbd14-3028-4ba9-918d-bfc67378e6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b397540dc0a42fbb5d2776ea2f494b9, user_id=20f4f241c3954c0fb07fb2a9fef87f18, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:46.680859 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674dbd14-3028-4ba9-918d-bfc67378e6ed admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:46.708691 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1399/2785] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:46 2022] PUT /identity/v3/projects/8b397540dc0a42fbb5d2776ea2f494b9/users/20f4f241c3954c0fb07fb2a9fef87f18/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:13:46.731137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132488a-780c-479c-b7a2-575bac3c0ccf None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:46.731422 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132488a-780c-479c-b7a2-575bac3c0ccf None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:46.731683 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132488a-780c-479c-b7a2-575bac3c0ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:46.766458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1132488a-780c-479c-b7a2-575bac3c0ccf None None] MFA Rules not processed for user `20f4f241c3954c0fb07fb2a9fef87f18`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:46.767768 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1132488a-780c-479c-b7a2-575bac3c0ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:46.816751 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:46.840041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1387/2786] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:46.845137 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dbd14-3028-4ba9-918d-bfc67378e6ed admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:46.896509 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:46.912689 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dbd14-3028-4ba9-918d-bfc67378e6ed admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:46.917696 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59bf5e-8204-4dfa-9f29-886ba9178d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:46.918308 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59bf5e-8204-4dfa-9f29-886ba9178d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:46.918585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59bf5e-8204-4dfa-9f29-886ba9178d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:46.918891 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59bf5e-8204-4dfa-9f29-886ba9178d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:46.919527 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59bf5e-8204-4dfa-9f29-886ba9178d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:46.921457 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59bf5e-8204-4dfa-9f29-886ba9178d3a admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:46.951085 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1400/2787] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:13:46 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:13:46.955158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132488a-780c-479c-b7a2-575bac3c0ccf None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:46.966439 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132488a-780c-479c-b7a2-575bac3c0ccf None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:47.024771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10ef8b-d5ad-4f6f-ad00-f4a05ee7f4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:47.025382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10ef8b-d5ad-4f6f-ad00-f4a05ee7f4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:47.025662 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10ef8b-d5ad-4f6f-ad00-f4a05ee7f4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:47.025931 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10ef8b-d5ad-4f6f-ad00-f4a05ee7f4c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:47.026555 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10ef8b-d5ad-4f6f-ad00-f4a05ee7f4c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:47.028601 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10ef8b-d5ad-4f6f-ad00-f4a05ee7f4c4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:47.050271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1388/2788] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:13:46 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:13:47.054540 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59bf5e-8204-4dfa-9f29-886ba9178d3a admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:47.065353 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59bf5e-8204-4dfa-9f29-886ba9178d3a admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:47.071097 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b7b3c-a194-4c9e-918c-1a08eb5d91b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:47.071645 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b7b3c-a194-4c9e-918c-1a08eb5d91b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:47.071921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b7b3c-a194-4c9e-918c-1a08eb5d91b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:47.072188 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b7b3c-a194-4c9e-918c-1a08eb5d91b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:47.072838 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b7b3c-a194-4c9e-918c-1a08eb5d91b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:47.074571 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b7b3c-a194-4c9e-918c-1a08eb5d91b9 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:47.086215 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1401/2789] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:13:47.091037 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10ef8b-d5ad-4f6f-ad00-f4a05ee7f4c4 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:47.102323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10ef8b-d5ad-4f6f-ad00-f4a05ee7f4c4 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:47.107374 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490f1b3-5418-4bd2-b74b-b64323582fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:47.108053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490f1b3-5418-4bd2-b74b-b64323582fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:47.108329 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490f1b3-5418-4bd2-b74b-b64323582fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:47.108598 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490f1b3-5418-4bd2-b74b-b64323582fbe admin admin] PATH_INFO: `/v3/projects/6da0cee2f65749ee9b1e4f7f4005f7df/users/d78c2249eb054de7b43eb8a9cc5d1c9f/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:47.124075 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490f1b3-5418-4bd2-b74b-b64323582fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da0cee2f65749ee9b1e4f7f4005f7df, user_id=d78c2249eb054de7b43eb8a9cc5d1c9f, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:47.126822 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490f1b3-5418-4bd2-b74b-b64323582fbe admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:47.141737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1389/2790] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:47 2022] PUT /identity/v3/projects/6da0cee2f65749ee9b1e4f7f4005f7df/users/d78c2249eb054de7b43eb8a9cc5d1c9f/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:47.146234 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b7b3c-a194-4c9e-918c-1a08eb5d91b9 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:47.156873 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b7b3c-a194-4c9e-918c-1a08eb5d91b9 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:47.214484 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19846a20-6e99-42d0-8eb2-f5cf2e7e05cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:47.215139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19846a20-6e99-42d0-8eb2-f5cf2e7e05cd admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:47.215409 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19846a20-6e99-42d0-8eb2-f5cf2e7e05cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:47.215674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19846a20-6e99-42d0-8eb2-f5cf2e7e05cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:47.216315 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19846a20-6e99-42d0-8eb2-f5cf2e7e05cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:47.218281 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19846a20-6e99-42d0-8eb2-f5cf2e7e05cd admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:47.228986 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1402/2791] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:47.233418 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490f1b3-5418-4bd2-b74b-b64323582fbe admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:47.244442 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490f1b3-5418-4bd2-b74b-b64323582fbe admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:47.249946 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac118f-cfa7-4919-884b-ef00f82cce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:47.250626 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac118f-cfa7-4919-884b-ef00f82cce64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:47.250932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac118f-cfa7-4919-884b-ef00f82cce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:47.251211 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac118f-cfa7-4919-884b-ef00f82cce64 admin admin] PATH_INFO: `/v3/projects/6da0cee2f65749ee9b1e4f7f4005f7df/users/d78c2249eb054de7b43eb8a9cc5d1c9f/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:47.253215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac118f-cfa7-4919-884b-ef00f82cce64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da0cee2f65749ee9b1e4f7f4005f7df, user_id=d78c2249eb054de7b43eb8a9cc5d1c9f, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:47.255956 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac118f-cfa7-4919-884b-ef00f82cce64 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:47.266515 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1390/2792] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:47 2022] PUT /identity/v3/projects/6da0cee2f65749ee9b1e4f7f4005f7df/users/d78c2249eb054de7b43eb8a9cc5d1c9f/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:47.279143 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef51e4-9ee6-4bbe-8729-0cb7e5228f19 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:47.279422 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef51e4-9ee6-4bbe-8729-0cb7e5228f19 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:47.279777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef51e4-9ee6-4bbe-8729-0cb7e5228f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:47.310438 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-34ef51e4-9ee6-4bbe-8729-0cb7e5228f19 None None] MFA Rules not processed for user `d78c2249eb054de7b43eb8a9cc5d1c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:47.311747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-34ef51e4-9ee6-4bbe-8729-0cb7e5228f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:47.395227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1403/2793] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:47.407665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac118f-cfa7-4919-884b-ef00f82cce64 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:47.409846 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6dac118f-cfa7-4919-884b-ef00f82cce64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:47.476678 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac118f-cfa7-4919-884b-ef00f82cce64 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:47.481874 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa16d21-2149-473e-8a2e-95f46eaeace6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:47.482507 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa16d21-2149-473e-8a2e-95f46eaeace6 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:47.482817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa16d21-2149-473e-8a2e-95f46eaeace6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:47.483090 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa16d21-2149-473e-8a2e-95f46eaeace6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:47.494191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa16d21-2149-473e-8a2e-95f46eaeace6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:47.495900 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa16d21-2149-473e-8a2e-95f46eaeace6 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:47.507390 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1391/2794] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:13:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:13:47.542869 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef51e4-9ee6-4bbe-8729-0cb7e5228f19 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:47.620016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:47.639287 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef51e4-9ee6-4bbe-8729-0cb7e5228f19 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:47.644155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b720f-a0cf-48e4-81f9-ee835d3ff3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:47.644806 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b720f-a0cf-48e4-81f9-ee835d3ff3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:47.645075 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b720f-a0cf-48e4-81f9-ee835d3ff3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:47.645348 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b720f-a0cf-48e4-81f9-ee835d3ff3e6 admin admin] PATH_INFO: `/v3/users/20f4f241c3954c0fb07fb2a9fef87f18` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:47.646611 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b720f-a0cf-48e4-81f9-ee835d3ff3e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f4f241c3954c0fb07fb2a9fef87f18)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:47.648636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b720f-a0cf-48e4-81f9-ee835d3ff3e6 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:47.710181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-3a7b720f-a0cf-48e4-81f9-ee835d3ff3e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f4f241c3954c0fb07fb2a9fef87f18'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:47.723147 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-3a7b720f-a0cf-48e4-81f9-ee835d3ff3e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f4f241c3954c0fb07fb2a9fef87f18'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:47.732866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-3a7b720f-a0cf-48e4-81f9-ee835d3ff3e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f4f241c3954c0fb07fb2a9fef87f18'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:47.741159 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-3a7b720f-a0cf-48e4-81f9-ee835d3ff3e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f4f241c3954c0fb07fb2a9fef87f18'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:47.741895 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-3a7b720f-a0cf-48e4-81f9-ee835d3ff3e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f4f241c3954c0fb07fb2a9fef87f18'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:47.747919 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1404/2795] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:13:47 2022] DELETE /identity/v3/users/20f4f241c3954c0fb07fb2a9fef87f18 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:47.752561 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42afb7-4aaf-4e5e-9b9b-cccd592980b9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:47.752845 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42afb7-4aaf-4e5e-9b9b-cccd592980b9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:47.753149 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42afb7-4aaf-4e5e-9b9b-cccd592980b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:47.772835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7a42afb7-4aaf-4e5e-9b9b-cccd592980b9 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:47.774056 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7a42afb7-4aaf-4e5e-9b9b-cccd592980b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:47.817531 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:47.839668 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1392/2796] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:47.850251 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b720f-a0cf-48e4-81f9-ee835d3ff3e6 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:47.852048 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3a7b720f-a0cf-48e4-81f9-ee835d3ff3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:47.912535 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b720f-a0cf-48e4-81f9-ee835d3ff3e6 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:47.917116 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcc5fe-e2ff-420f-94a1-306499643627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:47.917749 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc5fe-e2ff-420f-94a1-306499643627 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:47.918004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc5fe-e2ff-420f-94a1-306499643627 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:47.918267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc5fe-e2ff-420f-94a1-306499643627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:47.928787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcc5fe-e2ff-420f-94a1-306499643627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:47.930303 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcc5fe-e2ff-420f-94a1-306499643627 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:47.941066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1405/2797] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:13:48.227608 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42afb7-4aaf-4e5e-9b9b-cccd592980b9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:48.229317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7a42afb7-4aaf-4e5e-9b9b-cccd592980b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:48.243856 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42afb7-4aaf-4e5e-9b9b-cccd592980b9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:48.251508 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:48.252185 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:48.252645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:48.253283 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] PATH_INFO: `/v3/projects/8b397540dc0a42fbb5d2776ea2f494b9` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:48.254549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b397540dc0a42fbb5d2776ea2f494b9)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:48.256778 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:48.319712 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b397540dc0a42fbb5d2776ea2f494b9', 'request_id': 'req-ce821ad0-895c-4371-839e-7ef6901efc00'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:48.329519 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b397540dc0a42fbb5d2776ea2f494b9', 'request_id': 'req-ce821ad0-895c-4371-839e-7ef6901efc00'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:48.343415 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b397540dc0a42fbb5d2776ea2f494b9', 'request_id': 'req-ce821ad0-895c-4371-839e-7ef6901efc00'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:48.356548 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] The token cache is being invalidate because project 8b397540dc0a42fbb5d2776ea2f494b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:13:48.356844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:48.357495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:48.359382 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1393/2798] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:13:48 2022] DELETE /identity/v3/projects/8b397540dc0a42fbb5d2776ea2f494b9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:48.363627 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcc5fe-e2ff-420f-94a1-306499643627 service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:48.374473 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcc5fe-e2ff-420f-94a1-306499643627 service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:48.440608 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3dc0a-79f0-488f-ac5f-2d7200d2b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:48.441252 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3dc0a-79f0-488f-ac5f-2d7200d2b4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:48.441547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3dc0a-79f0-488f-ac5f-2d7200d2b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:48.441789 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3dc0a-79f0-488f-ac5f-2d7200d2b4a1 admin admin] PATH_INFO: `/v3/users/d78c2249eb054de7b43eb8a9cc5d1c9f` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:48.443156 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3dc0a-79f0-488f-ac5f-2d7200d2b4a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78c2249eb054de7b43eb8a9cc5d1c9f)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:48.445120 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3dc0a-79f0-488f-ac5f-2d7200d2b4a1 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:48.451606 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:48.504489 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0ee3dc0a-79f0-488f-ac5f-2d7200d2b4a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78c2249eb054de7b43eb8a9cc5d1c9f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:48.518282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0ee3dc0a-79f0-488f-ac5f-2d7200d2b4a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78c2249eb054de7b43eb8a9cc5d1c9f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:48.536158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0ee3dc0a-79f0-488f-ac5f-2d7200d2b4a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78c2249eb054de7b43eb8a9cc5d1c9f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:48.544096 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0ee3dc0a-79f0-488f-ac5f-2d7200d2b4a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78c2249eb054de7b43eb8a9cc5d1c9f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:48.544812 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-0ee3dc0a-79f0-488f-ac5f-2d7200d2b4a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78c2249eb054de7b43eb8a9cc5d1c9f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:48.551226 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1406/2799] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:13:48 2022] DELETE /identity/v3/users/d78c2249eb054de7b43eb8a9cc5d1c9f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:48.843448 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:48.845080 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:48.860334 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce821ad0-895c-4371-839e-7ef6901efc00 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:48.923590 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:48.924228 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:48.924505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:48.924780 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007 admin admin] PATH_INFO: `/v3/projects/6da0cee2f65749ee9b1e4f7f4005f7df` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:48.925943 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da0cee2f65749ee9b1e4f7f4005f7df)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:48.927930 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:48.978588 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da0cee2f65749ee9b1e4f7f4005f7df', 'request_id': 'req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:48.984827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da0cee2f65749ee9b1e4f7f4005f7df', 'request_id': 'req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:48.993565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da0cee2f65749ee9b1e4f7f4005f7df', 'request_id': 'req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:48.995637 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:49.006116 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007 admin admin] The token cache is being invalidate because project 6da0cee2f65749ee9b1e4f7f4005f7df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:13:49.006409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:49.007514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a7072b77-9fdc-4b1f-ba47-1135d6ef5007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:49.009328 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1394/2800] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:13:48 2022] DELETE /identity/v3/projects/6da0cee2f65749ee9b1e4f7f4005f7df => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:49.014727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d03b7-7652-402a-b383-7a2d1babe587 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:49.015008 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d03b7-7652-402a-b383-7a2d1babe587 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:49.015276 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d03b7-7652-402a-b383-7a2d1babe587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:49.035162 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-ce7d03b7-7652-402a-b383-7a2d1babe587 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:49.036376 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-ce7d03b7-7652-402a-b383-7a2d1babe587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:49.102142 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1407/2801] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:49.110325 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46057d1e-496f-4dda-a823-7e6a90c4bbfe None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:49.110653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46057d1e-496f-4dda-a823-7e6a90c4bbfe None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:49.110924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46057d1e-496f-4dda-a823-7e6a90c4bbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:49.133014 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-46057d1e-496f-4dda-a823-7e6a90c4bbfe None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:49.134238 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-46057d1e-496f-4dda-a823-7e6a90c4bbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:49.145282 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1395/2802] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:49.150302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d03b7-7652-402a-b383-7a2d1babe587 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:49.160556 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d03b7-7652-402a-b383-7a2d1babe587 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:49.165850 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a56ed-8a7a-4a0c-a75c-afe2412b45e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:49.166453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a56ed-8a7a-4a0c-a75c-afe2412b45e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:49.166761 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a56ed-8a7a-4a0c-a75c-afe2412b45e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:49.167028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a56ed-8a7a-4a0c-a75c-afe2412b45e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:49.167682 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a56ed-8a7a-4a0c-a75c-afe2412b45e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:13:49.167980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a56ed-8a7a-4a0c-a75c-afe2412b45e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:49.169566 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a56ed-8a7a-4a0c-a75c-afe2412b45e3 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:49.182252 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1408/2803] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:13:49.186842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46057d1e-496f-4dda-a823-7e6a90c4bbfe None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:49.196502 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46057d1e-496f-4dda-a823-7e6a90c4bbfe None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:49.201598 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7381aca-5950-4e2b-b63e-f9707f1e02aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:49.202197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7381aca-5950-4e2b-b63e-f9707f1e02aa admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:49.202467 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7381aca-5950-4e2b-b63e-f9707f1e02aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:49.202757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7381aca-5950-4e2b-b63e-f9707f1e02aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:49.203400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7381aca-5950-4e2b-b63e-f9707f1e02aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:49.205318 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7381aca-5950-4e2b-b63e-f9707f1e02aa admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:49.244417 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1396/2804] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:13:49 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:13:49.249239 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a56ed-8a7a-4a0c-a75c-afe2412b45e3 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:49.260015 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a56ed-8a7a-4a0c-a75c-afe2412b45e3 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:49.322992 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecb78f-ad36-40fb-ab58-31573452db60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:49.323615 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecb78f-ad36-40fb-ab58-31573452db60 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:49.323861 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecb78f-ad36-40fb-ab58-31573452db60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:49.324204 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecb78f-ad36-40fb-ab58-31573452db60 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:49.329374 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecb78f-ad36-40fb-ab58-31573452db60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:49.329374 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecb78f-ad36-40fb-ab58-31573452db60 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:49.353148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1409/2805] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:13:49 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:13:49.357754 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7381aca-5950-4e2b-b63e-f9707f1e02aa admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:49.377033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7381aca-5950-4e2b-b63e-f9707f1e02aa admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:49.382068 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbaeeb-944f-4a95-b4e8-66454b550d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:49.382734 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbaeeb-944f-4a95-b4e8-66454b550d02 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:49.382734 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbaeeb-944f-4a95-b4e8-66454b550d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:49.383336 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbaeeb-944f-4a95-b4e8-66454b550d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:49.384020 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbaeeb-944f-4a95-b4e8-66454b550d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:49.385859 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbaeeb-944f-4a95-b4e8-66454b550d02 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:49.397741 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1397/2806] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:49.402539 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecb78f-ad36-40fb-ab58-31573452db60 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:49.408164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:49.414538 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecb78f-ad36-40fb-ab58-31573452db60 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:49.421788 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fe7ab-52b7-44a7-afa7-f0598dd84bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:49.422622 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fe7ab-52b7-44a7-afa7-f0598dd84bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:49.423149 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fe7ab-52b7-44a7-afa7-f0598dd84bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:49.423480 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fe7ab-52b7-44a7-afa7-f0598dd84bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:49.426198 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fe7ab-52b7-44a7-afa7-f0598dd84bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:49.428483 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fe7ab-52b7-44a7-afa7-f0598dd84bb9 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:49.440383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1410/2807] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:49.445479 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbaeeb-944f-4a95-b4e8-66454b550d02 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:49.456065 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbaeeb-944f-4a95-b4e8-66454b550d02 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:49.461072 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e00e0b-330b-48bc-b740-ad9e6db05cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:49.461909 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e00e0b-330b-48bc-b740-ad9e6db05cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:49.462264 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e00e0b-330b-48bc-b740-ad9e6db05cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:49.462840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e00e0b-330b-48bc-b740-ad9e6db05cdd admin admin] PATH_INFO: `/v3/projects/7712eeb3e3244a1aaa3da068f86141ae/users/ddef9d55706b43aeb7b1c425b91e5501/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:49.483317 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e00e0b-330b-48bc-b740-ad9e6db05cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7712eeb3e3244a1aaa3da068f86141ae, user_id=ddef9d55706b43aeb7b1c425b91e5501, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:49.486036 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e00e0b-330b-48bc-b740-ad9e6db05cdd admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:49.502949 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1398/2808] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:49 2022] PUT /identity/v3/projects/7712eeb3e3244a1aaa3da068f86141ae/users/ddef9d55706b43aeb7b1c425b91e5501/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:49.514393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63acb4-4ddf-4a11-b89a-9b5605d5ffc5 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:49.514663 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63acb4-4ddf-4a11-b89a-9b5605d5ffc5 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:49.514970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63acb4-4ddf-4a11-b89a-9b5605d5ffc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:49.550401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-4d63acb4-4ddf-4a11-b89a-9b5605d5ffc5 None None] MFA Rules not processed for user `ddef9d55706b43aeb7b1c425b91e5501`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:49.551696 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-4d63acb4-4ddf-4a11-b89a-9b5605d5ffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:49.619980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1411/2809] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:49.624682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e00e0b-330b-48bc-b740-ad9e6db05cdd admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:49.689489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e00e0b-330b-48bc-b740-ad9e6db05cdd admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:49.694776 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550a8fe-0b41-4799-8f10-34c7c9f6996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:49.695399 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550a8fe-0b41-4799-8f10-34c7c9f6996d admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:49.695678 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550a8fe-0b41-4799-8f10-34c7c9f6996d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:49.695933 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550a8fe-0b41-4799-8f10-34c7c9f6996d admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:49.696585 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550a8fe-0b41-4799-8f10-34c7c9f6996d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:49.698481 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550a8fe-0b41-4799-8f10-34c7c9f6996d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:49.730763 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1399/2810] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:13:49 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:13:49.732826 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63acb4-4ddf-4a11-b89a-9b5605d5ffc5 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:49.745545 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63acb4-4ddf-4a11-b89a-9b5605d5ffc5 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:49.806183 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49047d-c7ca-4406-947d-12bc3b377af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:49.806804 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49047d-c7ca-4406-947d-12bc3b377af8 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:49.807074 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49047d-c7ca-4406-947d-12bc3b377af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:49.807347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49047d-c7ca-4406-947d-12bc3b377af8 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:49.807970 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49047d-c7ca-4406-947d-12bc3b377af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:49.809931 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49047d-c7ca-4406-947d-12bc3b377af8 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:49.832610 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1412/2811] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:13:49 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:13:49.836916 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550a8fe-0b41-4799-8f10-34c7c9f6996d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:49.848441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550a8fe-0b41-4799-8f10-34c7c9f6996d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:49.854232 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963777c-eecf-412a-86b8-6c7002f1ac23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:49.854886 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963777c-eecf-412a-86b8-6c7002f1ac23 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:49.855165 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963777c-eecf-412a-86b8-6c7002f1ac23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:49.855437 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963777c-eecf-412a-86b8-6c7002f1ac23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:49.856228 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963777c-eecf-412a-86b8-6c7002f1ac23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:49.857843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963777c-eecf-412a-86b8-6c7002f1ac23 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:49.869299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1400/2812] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:49.873635 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49047d-c7ca-4406-947d-12bc3b377af8 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:49.885080 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49047d-c7ca-4406-947d-12bc3b377af8 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:49.890520 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32aa544-56c3-4d6c-ac87-c1be562048ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:49.891202 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32aa544-56c3-4d6c-ac87-c1be562048ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:49.891479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32aa544-56c3-4d6c-ac87-c1be562048ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:49.891751 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32aa544-56c3-4d6c-ac87-c1be562048ba admin admin] PATH_INFO: `/v3/projects/16f4ebebd66a455a840ffbd95d04432b/users/4f2ae17d89844fd79d99941e89df784f/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:49.913583 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32aa544-56c3-4d6c-ac87-c1be562048ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f4ebebd66a455a840ffbd95d04432b, user_id=4f2ae17d89844fd79d99941e89df784f, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:49.916980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32aa544-56c3-4d6c-ac87-c1be562048ba admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:49.932004 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1413/2813] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:49 2022] PUT /identity/v3/projects/16f4ebebd66a455a840ffbd95d04432b/users/4f2ae17d89844fd79d99941e89df784f/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:13:49.936188 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963777c-eecf-412a-86b8-6c7002f1ac23 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:49.947156 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963777c-eecf-412a-86b8-6c7002f1ac23 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:50.006472 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19f870-94a4-4816-87a3-b64ed64a4798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:50.007141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19f870-94a4-4816-87a3-b64ed64a4798 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:50.007406 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19f870-94a4-4816-87a3-b64ed64a4798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:50.007681 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19f870-94a4-4816-87a3-b64ed64a4798 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:50.008388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19f870-94a4-4816-87a3-b64ed64a4798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:50.009989 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19f870-94a4-4816-87a3-b64ed64a4798 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:50.020487 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1401/2814] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:50.024787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32aa544-56c3-4d6c-ac87-c1be562048ba admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:50.035381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32aa544-56c3-4d6c-ac87-c1be562048ba admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:50.040244 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de808475-8d54-47cb-b8b2-44d8bbc0e976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:50.040900 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de808475-8d54-47cb-b8b2-44d8bbc0e976 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:50.041180 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de808475-8d54-47cb-b8b2-44d8bbc0e976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:50.041448 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de808475-8d54-47cb-b8b2-44d8bbc0e976 admin admin] PATH_INFO: `/v3/projects/16f4ebebd66a455a840ffbd95d04432b/users/4f2ae17d89844fd79d99941e89df784f/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:50.043431 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de808475-8d54-47cb-b8b2-44d8bbc0e976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f4ebebd66a455a840ffbd95d04432b, user_id=4f2ae17d89844fd79d99941e89df784f, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:50.046115 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de808475-8d54-47cb-b8b2-44d8bbc0e976 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:50.056674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1414/2815] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:50 2022] PUT /identity/v3/projects/16f4ebebd66a455a840ffbd95d04432b/users/4f2ae17d89844fd79d99941e89df784f/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:50.067426 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf454a8e-a8c8-49d8-89ea-f7a503506c29 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:50.067713 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf454a8e-a8c8-49d8-89ea-f7a503506c29 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:50.068022 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf454a8e-a8c8-49d8-89ea-f7a503506c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:50.075496 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:50.099586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-bf454a8e-a8c8-49d8-89ea-f7a503506c29 None None] MFA Rules not processed for user `4f2ae17d89844fd79d99941e89df784f`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:50.100870 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bf454a8e-a8c8-49d8-89ea-f7a503506c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:50.175650 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1402/2816] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:50.187163 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de808475-8d54-47cb-b8b2-44d8bbc0e976 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:50.189309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-de808475-8d54-47cb-b8b2-44d8bbc0e976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:50.228042 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:50.252226 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de808475-8d54-47cb-b8b2-44d8bbc0e976 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:50.257602 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239d2b9-4329-4639-b4b9-c3cf37f9ad03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:50.258227 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239d2b9-4329-4639-b4b9-c3cf37f9ad03 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:50.258499 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239d2b9-4329-4639-b4b9-c3cf37f9ad03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:50.258794 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239d2b9-4329-4639-b4b9-c3cf37f9ad03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:50.269459 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239d2b9-4329-4639-b4b9-c3cf37f9ad03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:50.271098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239d2b9-4329-4639-b4b9-c3cf37f9ad03 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:50.281021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1415/2817] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:13:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:13:50.387517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf454a8e-a8c8-49d8-89ea-f7a503506c29 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:50.397532 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf454a8e-a8c8-49d8-89ea-f7a503506c29 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:50.401652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4f49a-4976-45b3-9466-10b5753a1233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:50.402261 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4f49a-4976-45b3-9466-10b5753a1233 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:50.402536 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4f49a-4976-45b3-9466-10b5753a1233 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:50.402835 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4f49a-4976-45b3-9466-10b5753a1233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:50.461052 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4f49a-4976-45b3-9466-10b5753a1233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:50.462698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4f49a-4976-45b3-9466-10b5753a1233 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:50.472313 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1403/2818] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:13:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:13:53.144006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239d2b9-4329-4639-b4b9-c3cf37f9ad03 service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:53.209461 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239d2b9-4329-4639-b4b9-c3cf37f9ad03 service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:53.218522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a41f1c-252d-4cff-ac2d-5f3ba51d0ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:53.219312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a41f1c-252d-4cff-ac2d-5f3ba51d0ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:53.219651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a41f1c-252d-4cff-ac2d-5f3ba51d0ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:53.219973 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a41f1c-252d-4cff-ac2d-5f3ba51d0ce4 admin admin] PATH_INFO: `/v3/users/ddef9d55706b43aeb7b1c425b91e5501` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:53.221363 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a41f1c-252d-4cff-ac2d-5f3ba51d0ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddef9d55706b43aeb7b1c425b91e5501)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:53.223381 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a41f1c-252d-4cff-ac2d-5f3ba51d0ce4 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:53.273331 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b9a41f1c-252d-4cff-ac2d-5f3ba51d0ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddef9d55706b43aeb7b1c425b91e5501'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:53.286336 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b9a41f1c-252d-4cff-ac2d-5f3ba51d0ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddef9d55706b43aeb7b1c425b91e5501'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:53.296864 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b9a41f1c-252d-4cff-ac2d-5f3ba51d0ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddef9d55706b43aeb7b1c425b91e5501'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:53.309354 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b9a41f1c-252d-4cff-ac2d-5f3ba51d0ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddef9d55706b43aeb7b1c425b91e5501'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:53.310069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b9a41f1c-252d-4cff-ac2d-5f3ba51d0ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddef9d55706b43aeb7b1c425b91e5501'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:53.315972 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1416/2819] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:13:53 2022] DELETE /identity/v3/users/ddef9d55706b43aeb7b1c425b91e5501 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:53.320684 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44dce2-d252-4387-87dd-5bfe73498652 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:53.321215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44dce2-d252-4387-87dd-5bfe73498652 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:53.321215 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44dce2-d252-4387-87dd-5bfe73498652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:53.342363 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-eb44dce2-d252-4387-87dd-5bfe73498652 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:53.343634 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-eb44dce2-d252-4387-87dd-5bfe73498652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:53.412542 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1404/2820] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:53.422744 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a41f1c-252d-4cff-ac2d-5f3ba51d0ce4 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:53.424328 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-b9a41f1c-252d-4cff-ac2d-5f3ba51d0ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:53.484874 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a41f1c-252d-4cff-ac2d-5f3ba51d0ce4 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:53.488824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a58fd5-d794-4585-82ca-c287e31db199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:53.489435 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a58fd5-d794-4585-82ca-c287e31db199 service neutron] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:53.489712 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a58fd5-d794-4585-82ca-c287e31db199 service neutron] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:53.489980 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a58fd5-d794-4585-82ca-c287e31db199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:53.499387 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a58fd5-d794-4585-82ca-c287e31db199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:53.500831 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a58fd5-d794-4585-82ca-c287e31db199 service neutron] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:53.506094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:53.512070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1417/2821] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:13:53.800104 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44dce2-d252-4387-87dd-5bfe73498652 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:53.801549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-eb44dce2-d252-4387-87dd-5bfe73498652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:53.814737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44dce2-d252-4387-87dd-5bfe73498652 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:53.820057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:53.820748 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:53.821015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:53.821284 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] PATH_INFO: `/v3/projects/7712eeb3e3244a1aaa3da068f86141ae` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:53.823185 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7712eeb3e3244a1aaa3da068f86141ae)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:53.825326 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:53.850293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:53.878378 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7712eeb3e3244a1aaa3da068f86141ae', 'request_id': 'req-f50d3134-c4cd-49d0-94f1-0273543391a2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:53.886808 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7712eeb3e3244a1aaa3da068f86141ae', 'request_id': 'req-f50d3134-c4cd-49d0-94f1-0273543391a2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:53.895868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7712eeb3e3244a1aaa3da068f86141ae', 'request_id': 'req-f50d3134-c4cd-49d0-94f1-0273543391a2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:53.909661 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] The token cache is being invalidate because project 7712eeb3e3244a1aaa3da068f86141ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:13:53.909920 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:53.910558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:53.912412 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1405/2822] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:13:53 2022] DELETE /identity/v3/projects/7712eeb3e3244a1aaa3da068f86141ae => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:53.916853 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a58fd5-d794-4585-82ca-c287e31db199 service neutron] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:53.928444 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a58fd5-d794-4585-82ca-c287e31db199 service neutron] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:54.001940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6426105-c55d-43ee-b93a-71c4d10e4ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:54.002579 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6426105-c55d-43ee-b93a-71c4d10e4ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:54.002894 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6426105-c55d-43ee-b93a-71c4d10e4ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:54.003166 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6426105-c55d-43ee-b93a-71c4d10e4ab1 admin admin] PATH_INFO: `/v3/users/4f2ae17d89844fd79d99941e89df784f` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:54.004418 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6426105-c55d-43ee-b93a-71c4d10e4ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2ae17d89844fd79d99941e89df784f)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:54.006367 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6426105-c55d-43ee-b93a-71c4d10e4ab1 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:54.061297 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c6426105-c55d-43ee-b93a-71c4d10e4ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2ae17d89844fd79d99941e89df784f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:54.073824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c6426105-c55d-43ee-b93a-71c4d10e4ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2ae17d89844fd79d99941e89df784f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:54.082889 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c6426105-c55d-43ee-b93a-71c4d10e4ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2ae17d89844fd79d99941e89df784f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:54.090574 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c6426105-c55d-43ee-b93a-71c4d10e4ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2ae17d89844fd79d99941e89df784f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:54.091363 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-c6426105-c55d-43ee-b93a-71c4d10e4ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2ae17d89844fd79d99941e89df784f'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:54.098132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1418/2823] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:13:53 2022] DELETE /identity/v3/users/4f2ae17d89844fd79d99941e89df784f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:54.397339 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:54.398917 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:54.412714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d3134-c4cd-49d0-94f1-0273543391a2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:54.477855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d36b05-6be2-447c-aa8f-d0849e822635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:54.477855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d36b05-6be2-447c-aa8f-d0849e822635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:54.477855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d36b05-6be2-447c-aa8f-d0849e822635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:54.477855 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d36b05-6be2-447c-aa8f-d0849e822635 admin admin] PATH_INFO: `/v3/projects/16f4ebebd66a455a840ffbd95d04432b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:54.478389 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d36b05-6be2-447c-aa8f-d0849e822635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f4ebebd66a455a840ffbd95d04432b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:54.480087 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d36b05-6be2-447c-aa8f-d0849e822635 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:54.534246 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a3d36b05-6be2-447c-aa8f-d0849e822635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f4ebebd66a455a840ffbd95d04432b', 'request_id': 'req-a3d36b05-6be2-447c-aa8f-d0849e822635'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:54.540833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a3d36b05-6be2-447c-aa8f-d0849e822635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f4ebebd66a455a840ffbd95d04432b', 'request_id': 'req-a3d36b05-6be2-447c-aa8f-d0849e822635'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:54.550720 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a3d36b05-6be2-447c-aa8f-d0849e822635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f4ebebd66a455a840ffbd95d04432b', 'request_id': 'req-a3d36b05-6be2-447c-aa8f-d0849e822635'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:54.563514 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a3d36b05-6be2-447c-aa8f-d0849e822635 admin admin] The token cache is being invalidate because project 16f4ebebd66a455a840ffbd95d04432b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:13:54.563793 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a3d36b05-6be2-447c-aa8f-d0849e822635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:54.564489 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a3d36b05-6be2-447c-aa8f-d0849e822635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:54.566034 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1406/2824] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:13:54 2022] DELETE /identity/v3/projects/16f4ebebd66a455a840ffbd95d04432b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:54.571205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509bdf1-c712-4f08-82d2-59893f3e1071 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:54.571748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509bdf1-c712-4f08-82d2-59893f3e1071 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:54.571748 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509bdf1-c712-4f08-82d2-59893f3e1071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:54.593547 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-0509bdf1-c712-4f08-82d2-59893f3e1071 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:54.594847 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-0509bdf1-c712-4f08-82d2-59893f3e1071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:54.661017 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1419/2825] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:54.669388 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dc6bd-5bd5-4e10-9b6f-957d746d56d6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:54.669676 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dc6bd-5bd5-4e10-9b6f-957d746d56d6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:54.669945 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dc6bd-5bd5-4e10-9b6f-957d746d56d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:54.690191 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c60dc6bd-5bd5-4e10-9b6f-957d746d56d6 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:54.691449 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c60dc6bd-5bd5-4e10-9b6f-957d746d56d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:54.700069 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1407/2826] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:54.704434 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509bdf1-c712-4f08-82d2-59893f3e1071 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:54.714852 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509bdf1-c712-4f08-82d2-59893f3e1071 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:54.720371 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f1d97-1b13-49e3-9293-137666deedb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:54.720990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f1d97-1b13-49e3-9293-137666deedb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:54.721263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f1d97-1b13-49e3-9293-137666deedb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:54.721534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f1d97-1b13-49e3-9293-137666deedb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:54.722197 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f1d97-1b13-49e3-9293-137666deedb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81660) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:13:54.722499 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f1d97-1b13-49e3-9293-137666deedb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:54.724140 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f1d97-1b13-49e3-9293-137666deedb9 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:54.737026 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1420/2827] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:13:54.741380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dc6bd-5bd5-4e10-9b6f-957d746d56d6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:54.751152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dc6bd-5bd5-4e10-9b6f-957d746d56d6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:54.756183 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4f4f0-0871-4503-9929-8e72b8181daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:54.756791 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4f4f0-0871-4503-9929-8e72b8181daf admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:54.757067 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4f4f0-0871-4503-9929-8e72b8181daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:54.757338 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4f4f0-0871-4503-9929-8e72b8181daf admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:54.757980 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4f4f0-0871-4503-9929-8e72b8181daf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:54.759959 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4f4f0-0871-4503-9929-8e72b8181daf admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:54.789434 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1408/2828] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:13:54 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:13:54.794697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f1d97-1b13-49e3-9293-137666deedb9 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:54.801413 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:54.805813 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f1d97-1b13-49e3-9293-137666deedb9 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:54.867979 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed23bb9-1d0a-409e-9294-2894742d9ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:54.868587 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed23bb9-1d0a-409e-9294-2894742d9ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:54.868866 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed23bb9-1d0a-409e-9294-2894742d9ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:54.869132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed23bb9-1d0a-409e-9294-2894742d9ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:54.869787 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed23bb9-1d0a-409e-9294-2894742d9ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:54.871818 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed23bb9-1d0a-409e-9294-2894742d9ba2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:54.894802 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1421/2829] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:13:54 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:13:54.899168 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4f4f0-0871-4503-9929-8e72b8181daf admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:54.910244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4f4f0-0871-4503-9929-8e72b8181daf admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:54.915873 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65fcba-3eec-49c5-8890-cecbf28c9475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:54.916517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65fcba-3eec-49c5-8890-cecbf28c9475 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:54.916792 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65fcba-3eec-49c5-8890-cecbf28c9475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:54.917060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65fcba-3eec-49c5-8890-cecbf28c9475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:54.917735 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65fcba-3eec-49c5-8890-cecbf28c9475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:54.919423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65fcba-3eec-49c5-8890-cecbf28c9475 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:54.925092 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:54.930738 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1409/2830] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:54.934892 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed23bb9-1d0a-409e-9294-2894742d9ba2 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:54.945516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed23bb9-1d0a-409e-9294-2894742d9ba2 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:54.950628 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8c322-c82d-47c3-aed0-becb1dda6a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:54.951254 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8c322-c82d-47c3-aed0-becb1dda6a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:54.951536 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8c322-c82d-47c3-aed0-becb1dda6a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:54.951781 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8c322-c82d-47c3-aed0-becb1dda6a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:54.952453 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8c322-c82d-47c3-aed0-becb1dda6a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:54.954095 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8c322-c82d-47c3-aed0-becb1dda6a0f admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:54.965606 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1422/2831] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:54.970356 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65fcba-3eec-49c5-8890-cecbf28c9475 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:54.981017 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65fcba-3eec-49c5-8890-cecbf28c9475 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:54.986471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52affcb9-af35-4daf-874d-f6708cf7664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:54.987236 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52affcb9-af35-4daf-874d-f6708cf7664b admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:54.987400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52affcb9-af35-4daf-874d-f6708cf7664b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:54.987700 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52affcb9-af35-4daf-874d-f6708cf7664b admin admin] PATH_INFO: `/v3/projects/6e2ef7b8b15942eea7ea2ba983a926c5/users/311f1fb2d45f4758a55354e8f747ea32/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:55.003461 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52affcb9-af35-4daf-874d-f6708cf7664b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2ef7b8b15942eea7ea2ba983a926c5, user_id=311f1fb2d45f4758a55354e8f747ea32, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:55.006142 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52affcb9-af35-4daf-874d-f6708cf7664b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:55.022216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1410/2832] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:54 2022] PUT /identity/v3/projects/6e2ef7b8b15942eea7ea2ba983a926c5/users/311f1fb2d45f4758a55354e8f747ea32/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:55.093805 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f69e07-0aad-4af3-9c39-cb1a545b31e8 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:55.094098 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f69e07-0aad-4af3-9c39-cb1a545b31e8 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:55.094403 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f69e07-0aad-4af3-9c39-cb1a545b31e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:55.122809 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-f2f69e07-0aad-4af3-9c39-cb1a545b31e8 None None] MFA Rules not processed for user `311f1fb2d45f4758a55354e8f747ea32`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:55.124019 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-f2f69e07-0aad-4af3-9c39-cb1a545b31e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:55.191647 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1423/2833] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:13:55.196572 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52affcb9-af35-4daf-874d-f6708cf7664b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:55.261041 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52affcb9-af35-4daf-874d-f6708cf7664b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:55.265825 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a22a6-877a-45c0-b109-1b197c4c498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:55.266440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a22a6-877a-45c0-b109-1b197c4c498a admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:55.266760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a22a6-877a-45c0-b109-1b197c4c498a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:55.267032 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a22a6-877a-45c0-b109-1b197c4c498a admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:55.267670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a22a6-877a-45c0-b109-1b197c4c498a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:55.269608 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a22a6-877a-45c0-b109-1b197c4c498a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:55.302038 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1411/2834] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:13:55 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:13:55.306658 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f69e07-0aad-4af3-9c39-cb1a545b31e8 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:55.318144 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f69e07-0aad-4af3-9c39-cb1a545b31e8 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:55.378468 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a87c9-c44f-457a-9f1f-183489b46836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:55.379123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a87c9-c44f-457a-9f1f-183489b46836 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:55.379402 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a87c9-c44f-457a-9f1f-183489b46836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:55.379673 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a87c9-c44f-457a-9f1f-183489b46836 admin admin] PATH_INFO: `/v3/users` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:55.380340 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a87c9-c44f-457a-9f1f-183489b46836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:55.382263 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a87c9-c44f-457a-9f1f-183489b46836 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:55.407374 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1424/2835] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:13:55 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:13:55.408574 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a22a6-877a-45c0-b109-1b197c4c498a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:55.419584 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a22a6-877a-45c0-b109-1b197c4c498a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:55.424324 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1f3dd-dde4-4225-93b8-72b2e78db1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:55.424927 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1f3dd-dde4-4225-93b8-72b2e78db1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:55.425204 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1f3dd-dde4-4225-93b8-72b2e78db1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:55.425484 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1f3dd-dde4-4225-93b8-72b2e78db1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:55.426153 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1f3dd-dde4-4225-93b8-72b2e78db1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:55.427808 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1f3dd-dde4-4225-93b8-72b2e78db1f3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:55.439248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1412/2836] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:55.444050 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a87c9-c44f-457a-9f1f-183489b46836 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:55.449479 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:55.455791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a87c9-c44f-457a-9f1f-183489b46836 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:55.461551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108ffa1-f586-4e13-a99b-b90ede49b2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:55.462201 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108ffa1-f586-4e13-a99b-b90ede49b2ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:55.462483 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108ffa1-f586-4e13-a99b-b90ede49b2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:55.462791 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108ffa1-f586-4e13-a99b-b90ede49b2ad admin admin] PATH_INFO: `/v3/projects/4beb2ed838c44e54854a0991eb79e369/users/1386f8a591d24bada54b8ca47a5576a8/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:55.479055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108ffa1-f586-4e13-a99b-b90ede49b2ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4beb2ed838c44e54854a0991eb79e369, user_id=1386f8a591d24bada54b8ca47a5576a8, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:55.481747 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108ffa1-f586-4e13-a99b-b90ede49b2ad admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:55.496488 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1425/2837] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:55 2022] PUT /identity/v3/projects/4beb2ed838c44e54854a0991eb79e369/users/1386f8a591d24bada54b8ca47a5576a8/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:55.500655 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1f3dd-dde4-4225-93b8-72b2e78db1f3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:55.511802 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1f3dd-dde4-4225-93b8-72b2e78db1f3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:55.570440 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310bf2e-5b50-4bbb-9665-6c0b4452f0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:55.571137 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310bf2e-5b50-4bbb-9665-6c0b4452f0df admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:55.571402 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310bf2e-5b50-4bbb-9665-6c0b4452f0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:55.571670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310bf2e-5b50-4bbb-9665-6c0b4452f0df admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:55.572328 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310bf2e-5b50-4bbb-9665-6c0b4452f0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:55.573954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310bf2e-5b50-4bbb-9665-6c0b4452f0df admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:55.584737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1413/2838] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:55.589041 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108ffa1-f586-4e13-a99b-b90ede49b2ad admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:55.600419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108ffa1-f586-4e13-a99b-b90ede49b2ad admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:55.605373 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786d273-008e-4995-b37f-c20d5d2f90f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:55.606030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786d273-008e-4995-b37f-c20d5d2f90f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:55.606302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786d273-008e-4995-b37f-c20d5d2f90f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:55.606570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786d273-008e-4995-b37f-c20d5d2f90f4 admin admin] PATH_INFO: `/v3/projects/4beb2ed838c44e54854a0991eb79e369/users/1386f8a591d24bada54b8ca47a5576a8/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:55.608561 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786d273-008e-4995-b37f-c20d5d2f90f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4beb2ed838c44e54854a0991eb79e369, user_id=1386f8a591d24bada54b8ca47a5576a8, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:55.611272 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786d273-008e-4995-b37f-c20d5d2f90f4 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:55.624095 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1426/2839] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:55 2022] PUT /identity/v3/projects/4beb2ed838c44e54854a0991eb79e369/users/1386f8a591d24bada54b8ca47a5576a8/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:55.640764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4a040-9c0a-4982-b366-d8ecf4c64d2b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:55.641046 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4a040-9c0a-4982-b366-d8ecf4c64d2b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:55.641323 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4a040-9c0a-4982-b366-d8ecf4c64d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:55.670430 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-60c4a040-9c0a-4982-b366-d8ecf4c64d2b None None] MFA Rules not processed for user `1386f8a591d24bada54b8ca47a5576a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:55.671693 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-60c4a040-9c0a-4982-b366-d8ecf4c64d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:55.704851 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:55.741737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1414/2840] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:13:55.752844 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786d273-008e-4995-b37f-c20d5d2f90f4 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:55.755042 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-d786d273-008e-4995-b37f-c20d5d2f90f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:55.816184 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786d273-008e-4995-b37f-c20d5d2f90f4 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:55.821282 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1598f58-c0cd-42ec-9322-858f2baecb12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:55.822044 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1598f58-c0cd-42ec-9322-858f2baecb12 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:55.822317 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1598f58-c0cd-42ec-9322-858f2baecb12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:55.822588 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1598f58-c0cd-42ec-9322-858f2baecb12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:55.832584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1598f58-c0cd-42ec-9322-858f2baecb12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:55.834033 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1598f58-c0cd-42ec-9322-858f2baecb12 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:55.844542 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1427/2841] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:13:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:13:56.439255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4a040-9c0a-4982-b366-d8ecf4c64d2b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:56.504718 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4a040-9c0a-4982-b366-d8ecf4c64d2b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:56.509932 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fcc60-f092-41ed-931f-2c0f6e477f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:56.510579 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fcc60-f092-41ed-931f-2c0f6e477f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:56.510869 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fcc60-f092-41ed-931f-2c0f6e477f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:56.511138 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fcc60-f092-41ed-931f-2c0f6e477f9b admin admin] PATH_INFO: `/v3/users/311f1fb2d45f4758a55354e8f747ea32` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:56.512299 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fcc60-f092-41ed-931f-2c0f6e477f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=311f1fb2d45f4758a55354e8f747ea32)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:56.514216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fcc60-f092-41ed-931f-2c0f6e477f9b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:56.564384 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-442fcc60-f092-41ed-931f-2c0f6e477f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '311f1fb2d45f4758a55354e8f747ea32'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:56.565035 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-442fcc60-f092-41ed-931f-2c0f6e477f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '311f1fb2d45f4758a55354e8f747ea32'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:56.565616 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-442fcc60-f092-41ed-931f-2c0f6e477f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '311f1fb2d45f4758a55354e8f747ea32'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:56.573105 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-442fcc60-f092-41ed-931f-2c0f6e477f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '311f1fb2d45f4758a55354e8f747ea32'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:56.589081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-442fcc60-f092-41ed-931f-2c0f6e477f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '311f1fb2d45f4758a55354e8f747ea32'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:56.611150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1415/2842] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:13:56 2022] DELETE /identity/v3/users/311f1fb2d45f4758a55354e8f747ea32 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:56.616083 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b764ce-7eae-44eb-970c-07d20d116296 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:56.616596 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b764ce-7eae-44eb-970c-07d20d116296 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:56.616727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b764ce-7eae-44eb-970c-07d20d116296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:56.636200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-b7b764ce-7eae-44eb-970c-07d20d116296 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:56.637419 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-b7b764ce-7eae-44eb-970c-07d20d116296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:56.697410 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1428/2843] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:56.707912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fcc60-f092-41ed-931f-2c0f6e477f9b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:56.709410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-442fcc60-f092-41ed-931f-2c0f6e477f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:56.768146 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fcc60-f092-41ed-931f-2c0f6e477f9b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:56.772090 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf5055-7038-4116-9305-bb3aad4606ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:56.772706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5055-7038-4116-9305-bb3aad4606ec service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:56.772983 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5055-7038-4116-9305-bb3aad4606ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:56.773256 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5055-7038-4116-9305-bb3aad4606ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:56.779446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:56.783529 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf5055-7038-4116-9305-bb3aad4606ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:56.785255 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf5055-7038-4116-9305-bb3aad4606ec service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:56.797423 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1416/2844] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:13:57.070947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b764ce-7eae-44eb-970c-07d20d116296 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:57.072448 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-b7b764ce-7eae-44eb-970c-07d20d116296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:57.087353 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b764ce-7eae-44eb-970c-07d20d116296 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:57.094711 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:57.095347 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:57.095621 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:57.095967 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] PATH_INFO: `/v3/projects/6e2ef7b8b15942eea7ea2ba983a926c5` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:57.097139 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2ef7b8b15942eea7ea2ba983a926c5)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:57.099124 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:57.149125 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2ef7b8b15942eea7ea2ba983a926c5', 'request_id': 'req-67009977-5db2-49be-8b0e-b7c002c1b358'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.156734 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2ef7b8b15942eea7ea2ba983a926c5', 'request_id': 'req-67009977-5db2-49be-8b0e-b7c002c1b358'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.163343 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2ef7b8b15942eea7ea2ba983a926c5', 'request_id': 'req-67009977-5db2-49be-8b0e-b7c002c1b358'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.165390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:57.176552 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] The token cache is being invalidate because project 6e2ef7b8b15942eea7ea2ba983a926c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:13:57.176844 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.177498 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.179077 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1429/2845] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:13:57 2022] DELETE /identity/v3/projects/6e2ef7b8b15942eea7ea2ba983a926c5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:57.183245 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf5055-7038-4116-9305-bb3aad4606ec service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:57.193233 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf5055-7038-4116-9305-bb3aad4606ec service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:57.253158 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e0e39-88f5-486d-8de2-7b99749fe250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:57.253799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e0e39-88f5-486d-8de2-7b99749fe250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:57.254073 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e0e39-88f5-486d-8de2-7b99749fe250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:57.254352 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e0e39-88f5-486d-8de2-7b99749fe250 admin admin] PATH_INFO: `/v3/users/1386f8a591d24bada54b8ca47a5576a8` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:57.255575 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e0e39-88f5-486d-8de2-7b99749fe250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1386f8a591d24bada54b8ca47a5576a8)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:57.257505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e0e39-88f5-486d-8de2-7b99749fe250 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:57.308380 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bb6e0e39-88f5-486d-8de2-7b99749fe250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1386f8a591d24bada54b8ca47a5576a8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.309053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bb6e0e39-88f5-486d-8de2-7b99749fe250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1386f8a591d24bada54b8ca47a5576a8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.309673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bb6e0e39-88f5-486d-8de2-7b99749fe250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1386f8a591d24bada54b8ca47a5576a8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.316682 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bb6e0e39-88f5-486d-8de2-7b99749fe250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1386f8a591d24bada54b8ca47a5576a8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.328248 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bb6e0e39-88f5-486d-8de2-7b99749fe250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1386f8a591d24bada54b8ca47a5576a8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.347509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1417/2846] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:13:57 2022] DELETE /identity/v3/users/1386f8a591d24bada54b8ca47a5576a8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:57.650123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:57.652027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:57.666975 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67009977-5db2-49be-8b0e-b7c002c1b358 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:57.730534 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:57.731358 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:57.731767 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:57.732072 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02 admin admin] PATH_INFO: `/v3/projects/4beb2ed838c44e54854a0991eb79e369` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:57.733783 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4beb2ed838c44e54854a0991eb79e369)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:57.736084 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:57.787122 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4beb2ed838c44e54854a0991eb79e369', 'request_id': 'req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.797258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4beb2ed838c44e54854a0991eb79e369', 'request_id': 'req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.804067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4beb2ed838c44e54854a0991eb79e369', 'request_id': 'req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.815695 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02 admin admin] The token cache is being invalidate because project 4beb2ed838c44e54854a0991eb79e369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:13:57.815983 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.816750 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-a05f9c75-be12-47ce-b4f1-bc3e4cbafd02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:13:57.818472 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1430/2847] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:13:57 2022] DELETE /identity/v3/projects/4beb2ed838c44e54854a0991eb79e369 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:57.823767 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae67838-ee76-48e5-8fa8-5d26df43a2d7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:57.824304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae67838-ee76-48e5-8fa8-5d26df43a2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:57.824416 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae67838-ee76-48e5-8fa8-5d26df43a2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:57.845039 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-cae67838-ee76-48e5-8fa8-5d26df43a2d7 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:57.846260 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cae67838-ee76-48e5-8fa8-5d26df43a2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:57.909141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1418/2848] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:57.917200 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f388-ad35-469f-8e87-0874bf874c84 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:57.917485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f388-ad35-469f-8e87-0874bf874c84 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:57.917890 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f388-ad35-469f-8e87-0874bf874c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:57.939525 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-fa09f388-ad35-469f-8e87-0874bf874c84 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:57.940759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-fa09f388-ad35-469f-8e87-0874bf874c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:57.951311 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1431/2849] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:57.956902 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae67838-ee76-48e5-8fa8-5d26df43a2d7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:57.967857 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae67838-ee76-48e5-8fa8-5d26df43a2d7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:57.973796 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c2fc4-de7e-469b-884d-b001e3324d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:57.974761 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c2fc4-de7e-469b-884d-b001e3324d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:57.975227 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c2fc4-de7e-469b-884d-b001e3324d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:57.975593 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c2fc4-de7e-469b-884d-b001e3324d2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:57.976265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c2fc4-de7e-469b-884d-b001e3324d2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:13:57.976581 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c2fc4-de7e-469b-884d-b001e3324d2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:57.978222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c2fc4-de7e-469b-884d-b001e3324d2a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:57.996981 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:58.000744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1419/2850] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:13:58.005477 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f388-ad35-469f-8e87-0874bf874c84 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:58.018201 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09f388-ad35-469f-8e87-0874bf874c84 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:58.024100 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d77a3-756f-4b27-9370-f953181ceb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:58.024733 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d77a3-756f-4b27-9370-f953181ceb36 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:58.025010 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d77a3-756f-4b27-9370-f953181ceb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:58.025383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d77a3-756f-4b27-9370-f953181ceb36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:58.025923 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d77a3-756f-4b27-9370-f953181ceb36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:58.027928 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d77a3-756f-4b27-9370-f953181ceb36 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:58.057910 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1432/2851] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:13:58 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:13:58.062533 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c2fc4-de7e-469b-884d-b001e3324d2a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:58.073101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c2fc4-de7e-469b-884d-b001e3324d2a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:58.129842 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91517d-dadd-4d7a-a294-3256dd0f12d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:58.130446 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91517d-dadd-4d7a-a294-3256dd0f12d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:58.130757 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91517d-dadd-4d7a-a294-3256dd0f12d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:58.131035 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91517d-dadd-4d7a-a294-3256dd0f12d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:58.131807 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91517d-dadd-4d7a-a294-3256dd0f12d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:58.133888 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91517d-dadd-4d7a-a294-3256dd0f12d5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:58.157345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1420/2852] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:13:58 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:13:58.162329 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d77a3-756f-4b27-9370-f953181ceb36 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:58.174687 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d77a3-756f-4b27-9370-f953181ceb36 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:58.179504 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2786870-d2cb-4a79-bee6-e6b808d38edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:58.180209 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2786870-d2cb-4a79-bee6-e6b808d38edc admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:58.180491 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2786870-d2cb-4a79-bee6-e6b808d38edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:58.181173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2786870-d2cb-4a79-bee6-e6b808d38edc admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:58.181410 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2786870-d2cb-4a79-bee6-e6b808d38edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:58.183068 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2786870-d2cb-4a79-bee6-e6b808d38edc admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:58.193447 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1433/2853] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:58.197787 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91517d-dadd-4d7a-a294-3256dd0f12d5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:58.208559 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91517d-dadd-4d7a-a294-3256dd0f12d5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:58.213985 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba27017-517d-45e1-8f0c-451899c53da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:58.214621 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba27017-517d-45e1-8f0c-451899c53da7 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:58.214905 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba27017-517d-45e1-8f0c-451899c53da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:58.215182 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba27017-517d-45e1-8f0c-451899c53da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:58.215837 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba27017-517d-45e1-8f0c-451899c53da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:58.217848 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba27017-517d-45e1-8f0c-451899c53da7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:58.229101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1421/2854] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:58.233492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2786870-d2cb-4a79-bee6-e6b808d38edc admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:58.243906 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2786870-d2cb-4a79-bee6-e6b808d38edc admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:58.248848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d38c8c-5274-424f-aa60-93ace4be83c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:58.249503 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d38c8c-5274-424f-aa60-93ace4be83c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:58.249780 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d38c8c-5274-424f-aa60-93ace4be83c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:58.250053 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d38c8c-5274-424f-aa60-93ace4be83c2 admin admin] PATH_INFO: `/v3/projects/bedb9e21f19047ccb8b1d06b0e1eb0cf/users/13cee33da56f42f0afeb4e4eb6c91d8a/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:58.266924 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d38c8c-5274-424f-aa60-93ace4be83c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bedb9e21f19047ccb8b1d06b0e1eb0cf, user_id=13cee33da56f42f0afeb4e4eb6c91d8a, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:58.269626 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d38c8c-5274-424f-aa60-93ace4be83c2 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:58.285522 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1434/2855] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:58 2022] PUT /identity/v3/projects/bedb9e21f19047ccb8b1d06b0e1eb0cf/users/13cee33da56f42f0afeb4e4eb6c91d8a/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:58.297057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace36364-a209-4e9b-bba9-21bb987141ad None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:58.297385 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace36364-a209-4e9b-bba9-21bb987141ad None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:58.297644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace36364-a209-4e9b-bba9-21bb987141ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:58.326229 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-ace36364-a209-4e9b-bba9-21bb987141ad None None] MFA Rules not processed for user `13cee33da56f42f0afeb4e4eb6c91d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:58.327520 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ace36364-a209-4e9b-bba9-21bb987141ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:58.411381 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1422/2856] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:58.416585 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d38c8c-5274-424f-aa60-93ace4be83c2 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:58.437482 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:58.483616 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d38c8c-5274-424f-aa60-93ace4be83c2 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:58.488759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417b0ac-7b48-4521-b749-0d7608e4ee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:58.489466 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417b0ac-7b48-4521-b749-0d7608e4ee33 admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:58.489737 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417b0ac-7b48-4521-b749-0d7608e4ee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:58.490001 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417b0ac-7b48-4521-b749-0d7608e4ee33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:58.490655 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417b0ac-7b48-4521-b749-0d7608e4ee33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:58.492625 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417b0ac-7b48-4521-b749-0d7608e4ee33 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:58.522513 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1435/2857] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:13:58 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:13:58.527177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace36364-a209-4e9b-bba9-21bb987141ad None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:58.539220 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace36364-a209-4e9b-bba9-21bb987141ad None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:58.601570 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b407c2-7373-4ca3-bc35-882159e60495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:58.602271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b407c2-7373-4ca3-bc35-882159e60495 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:58.602550 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b407c2-7373-4ca3-bc35-882159e60495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:58.602881 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b407c2-7373-4ca3-bc35-882159e60495 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:58.603509 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b407c2-7373-4ca3-bc35-882159e60495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:58.605460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b407c2-7373-4ca3-bc35-882159e60495 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:58.622387 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:13:58.629606 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1423/2858] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:13:58 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:13:58.634435 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417b0ac-7b48-4521-b749-0d7608e4ee33 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:58.645803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417b0ac-7b48-4521-b749-0d7608e4ee33 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:58.651931 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b5782-0273-45cc-9def-843b7c3ce217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:58.652563 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b5782-0273-45cc-9def-843b7c3ce217 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:58.652803 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b5782-0273-45cc-9def-843b7c3ce217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:58.653069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b5782-0273-45cc-9def-843b7c3ce217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:58.653717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b5782-0273-45cc-9def-843b7c3ce217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:58.655401 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b5782-0273-45cc-9def-843b7c3ce217 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:58.667412 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1436/2859] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:58.672133 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b407c2-7373-4ca3-bc35-882159e60495 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:58.683398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b407c2-7373-4ca3-bc35-882159e60495 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:58.688854 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594290c3-ac68-4005-8434-cdcabb5fa159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:58.689517 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594290c3-ac68-4005-8434-cdcabb5fa159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:58.689786 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594290c3-ac68-4005-8434-cdcabb5fa159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:58.690086 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594290c3-ac68-4005-8434-cdcabb5fa159 admin admin] PATH_INFO: `/v3/projects/82d4d09eb9d64e3d8eff7334aa746792/users/85d693f3836f4269b794d05297478e18/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:58.707877 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594290c3-ac68-4005-8434-cdcabb5fa159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d4d09eb9d64e3d8eff7334aa746792, user_id=85d693f3836f4269b794d05297478e18, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:58.710566 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594290c3-ac68-4005-8434-cdcabb5fa159 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:58.727154 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1424/2860] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:58 2022] PUT /identity/v3/projects/82d4d09eb9d64e3d8eff7334aa746792/users/85d693f3836f4269b794d05297478e18/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:58.731420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b5782-0273-45cc-9def-843b7c3ce217 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:58.743055 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b5782-0273-45cc-9def-843b7c3ce217 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:58.805542 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c34b7-8d12-4b2a-a691-5cdc7ed53fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:58.806192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c34b7-8d12-4b2a-a691-5cdc7ed53fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:58.806471 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c34b7-8d12-4b2a-a691-5cdc7ed53fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:58.806777 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c34b7-8d12-4b2a-a691-5cdc7ed53fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:58.807434 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c34b7-8d12-4b2a-a691-5cdc7ed53fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:58.809069 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c34b7-8d12-4b2a-a691-5cdc7ed53fa8 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:58.819251 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1437/2861] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:13:58.823667 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594290c3-ac68-4005-8434-cdcabb5fa159 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:58.840879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594290c3-ac68-4005-8434-cdcabb5fa159 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:58.846504 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1aafe6-d56b-4985-8ccd-15d296595717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:58.847216 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1aafe6-d56b-4985-8ccd-15d296595717 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:58.847488 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1aafe6-d56b-4985-8ccd-15d296595717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:58.847912 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1aafe6-d56b-4985-8ccd-15d296595717 admin admin] PATH_INFO: `/v3/projects/82d4d09eb9d64e3d8eff7334aa746792/users/85d693f3836f4269b794d05297478e18/roles/41aa3bb5f36a426dbbe80a309d9e5ab7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:58.850067 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1aafe6-d56b-4985-8ccd-15d296595717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82d4d09eb9d64e3d8eff7334aa746792, user_id=85d693f3836f4269b794d05297478e18, role_id=41aa3bb5f36a426dbbe80a309d9e5ab7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:58.852881 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1aafe6-d56b-4985-8ccd-15d296595717 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:58.864510 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1425/2862] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:13:58 2022] PUT /identity/v3/projects/82d4d09eb9d64e3d8eff7334aa746792/users/85d693f3836f4269b794d05297478e18/roles/41aa3bb5f36a426dbbe80a309d9e5ab7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:13:58.875173 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145fca6-db7d-492e-a2bb-1e551de2d7b3 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:58.875451 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145fca6-db7d-492e-a2bb-1e551de2d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:58.875738 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145fca6-db7d-492e-a2bb-1e551de2d7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:58.906213 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-b145fca6-db7d-492e-a2bb-1e551de2d7b3 None None] MFA Rules not processed for user `85d693f3836f4269b794d05297478e18`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:13:58.907996 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-b145fca6-db7d-492e-a2bb-1e551de2d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:58.983692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1438/2863] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:13:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:13:58.996229 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1aafe6-d56b-4985-8ccd-15d296595717 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:13:58.998206 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cf1aafe6-d56b-4985-8ccd-15d296595717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:13:59.064938 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1aafe6-d56b-4985-8ccd-15d296595717 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:13:59.068698 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ebf45-9b27-44a0-b013-83ef7bd1d7a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:13:59.069311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ebf45-9b27-44a0-b013-83ef7bd1d7a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:13:59.069637 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ebf45-9b27-44a0-b013-83ef7bd1d7a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:13:59.069970 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ebf45-9b27-44a0-b013-83ef7bd1d7a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:13:59.131614 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ebf45-9b27-44a0-b013-83ef7bd1d7a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:13:59.133060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ebf45-9b27-44a0-b013-83ef7bd1d7a5 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:13:59.144592 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1426/2864] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:13:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:14:03.538850 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145fca6-db7d-492e-a2bb-1e551de2d7b3 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:03.540623 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-b145fca6-db7d-492e-a2bb-1e551de2d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:03.554239 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145fca6-db7d-492e-a2bb-1e551de2d7b3 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:03.558642 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e44cda-8867-4dbf-974b-fcd37cb3e4d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:03.559274 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e44cda-8867-4dbf-974b-fcd37cb3e4d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:03.559546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e44cda-8867-4dbf-974b-fcd37cb3e4d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:03.559811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e44cda-8867-4dbf-974b-fcd37cb3e4d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:03.571998 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e44cda-8867-4dbf-974b-fcd37cb3e4d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:03.573446 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e44cda-8867-4dbf-974b-fcd37cb3e4d7 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:03.579603 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:03.587807 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1439/2865] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:14:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:14:08.538197 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ebf45-9b27-44a0-b013-83ef7bd1d7a5 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:08.612739 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ebf45-9b27-44a0-b013-83ef7bd1d7a5 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:08.618451 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d9bef-4938-4b4a-921b-355790f70af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:08.619127 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d9bef-4938-4b4a-921b-355790f70af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:08.619410 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d9bef-4938-4b4a-921b-355790f70af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:08.619731 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d9bef-4938-4b4a-921b-355790f70af4 admin admin] PATH_INFO: `/v3/users/13cee33da56f42f0afeb4e4eb6c91d8a` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:08.620962 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d9bef-4938-4b4a-921b-355790f70af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13cee33da56f42f0afeb4e4eb6c91d8a)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:08.622969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d9bef-4938-4b4a-921b-355790f70af4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:08.642501 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:08.675707 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7f9d9bef-4938-4b4a-921b-355790f70af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13cee33da56f42f0afeb4e4eb6c91d8a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:08.676390 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7f9d9bef-4938-4b4a-921b-355790f70af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13cee33da56f42f0afeb4e4eb6c91d8a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:08.677015 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7f9d9bef-4938-4b4a-921b-355790f70af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13cee33da56f42f0afeb4e4eb6c91d8a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:08.684840 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7f9d9bef-4938-4b4a-921b-355790f70af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13cee33da56f42f0afeb4e4eb6c91d8a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:08.694060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7f9d9bef-4938-4b4a-921b-355790f70af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13cee33da56f42f0afeb4e4eb6c91d8a'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:08.713457 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1427/2866] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:14:08 2022] DELETE /identity/v3/users/13cee33da56f42f0afeb4e4eb6c91d8a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:14:08.718759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361619a-fda0-4907-bf52-ac6bec2c037e None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:08.719297 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361619a-fda0-4907-bf52-ac6bec2c037e None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:08.719492 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361619a-fda0-4907-bf52-ac6bec2c037e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:08.739359 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-3361619a-fda0-4907-bf52-ac6bec2c037e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:14:08.740595 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3361619a-fda0-4907-bf52-ac6bec2c037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:08.805498 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1440/2867] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:14:08.816088 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d9bef-4938-4b4a-921b-355790f70af4 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:08.817704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7f9d9bef-4938-4b4a-921b-355790f70af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:08.878172 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d9bef-4938-4b4a-921b-355790f70af4 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:08.882370 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa0785-60f2-4b40-87fa-b1b18a82b902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:08.883024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa0785-60f2-4b40-87fa-b1b18a82b902 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:08.883298 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa0785-60f2-4b40-87fa-b1b18a82b902 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:08.883552 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa0785-60f2-4b40-87fa-b1b18a82b902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:08.893653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa0785-60f2-4b40-87fa-b1b18a82b902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:08.895145 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa0785-60f2-4b40-87fa-b1b18a82b902 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:08.906290 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1428/2868] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:14:09.198325 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361619a-fda0-4907-bf52-ac6bec2c037e None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:09.200152 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-3361619a-fda0-4907-bf52-ac6bec2c037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:09.217341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361619a-fda0-4907-bf52-ac6bec2c037e None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:09.225888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:09.226991 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:09.227535 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:09.228021 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] PATH_INFO: `/v3/projects/bedb9e21f19047ccb8b1d06b0e1eb0cf` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:09.230058 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bedb9e21f19047ccb8b1d06b0e1eb0cf)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:09.234462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:09.293499 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bedb9e21f19047ccb8b1d06b0e1eb0cf', 'request_id': 'req-8d285fa6-41f6-4026-a2de-698eace135f1'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.303705 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bedb9e21f19047ccb8b1d06b0e1eb0cf', 'request_id': 'req-8d285fa6-41f6-4026-a2de-698eace135f1'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.310729 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bedb9e21f19047ccb8b1d06b0e1eb0cf', 'request_id': 'req-8d285fa6-41f6-4026-a2de-698eace135f1'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.322485 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] The token cache is being invalidate because project bedb9e21f19047ccb8b1d06b0e1eb0cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:14:09.322807 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.323512 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.327990 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1441/2869] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:14:09 2022] DELETE /identity/v3/projects/bedb9e21f19047ccb8b1d06b0e1eb0cf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:14:09.329528 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa0785-60f2-4b40-87fa-b1b18a82b902 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:09.341867 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa0785-60f2-4b40-87fa-b1b18a82b902 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:09.401013 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8288c-199e-4671-928c-489f72f0473e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:09.401551 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8288c-199e-4671-928c-489f72f0473e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:09.401827 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8288c-199e-4671-928c-489f72f0473e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:09.402095 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8288c-199e-4671-928c-489f72f0473e admin admin] PATH_INFO: `/v3/users/85d693f3836f4269b794d05297478e18` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:09.403293 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8288c-199e-4671-928c-489f72f0473e admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d693f3836f4269b794d05297478e18)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:09.405227 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8288c-199e-4671-928c-489f72f0473e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:09.448991 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:09.459777 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d4b8288c-199e-4671-928c-489f72f0473e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d693f3836f4269b794d05297478e18'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.460495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d4b8288c-199e-4671-928c-489f72f0473e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d693f3836f4269b794d05297478e18'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.461322 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d4b8288c-199e-4671-928c-489f72f0473e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d693f3836f4269b794d05297478e18'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.471091 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d4b8288c-199e-4671-928c-489f72f0473e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d693f3836f4269b794d05297478e18'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.480571 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d4b8288c-199e-4671-928c-489f72f0473e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d693f3836f4269b794d05297478e18'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.498937 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1429/2870] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:14:09 2022] DELETE /identity/v3/users/85d693f3836f4269b794d05297478e18 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:14:09.800531 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:09.802285 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:09.816578 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d285fa6-41f6-4026-a2de-698eace135f1 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:09.880644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace94da-9fd1-4dc3-9414-27d1905add7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:09.881292 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace94da-9fd1-4dc3-9414-27d1905add7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:09.881569 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace94da-9fd1-4dc3-9414-27d1905add7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:09.881841 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace94da-9fd1-4dc3-9414-27d1905add7e admin admin] PATH_INFO: `/v3/projects/82d4d09eb9d64e3d8eff7334aa746792` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:09.883181 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace94da-9fd1-4dc3-9414-27d1905add7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=82d4d09eb9d64e3d8eff7334aa746792)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:09.885214 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace94da-9fd1-4dc3-9414-27d1905add7e admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:09.928567 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:09.950067 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4ace94da-9fd1-4dc3-9414-27d1905add7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82d4d09eb9d64e3d8eff7334aa746792', 'request_id': 'req-4ace94da-9fd1-4dc3-9414-27d1905add7e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.959243 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4ace94da-9fd1-4dc3-9414-27d1905add7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82d4d09eb9d64e3d8eff7334aa746792', 'request_id': 'req-4ace94da-9fd1-4dc3-9414-27d1905add7e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.966478 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4ace94da-9fd1-4dc3-9414-27d1905add7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82d4d09eb9d64e3d8eff7334aa746792', 'request_id': 'req-4ace94da-9fd1-4dc3-9414-27d1905add7e'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.979679 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4ace94da-9fd1-4dc3-9414-27d1905add7e admin admin] The token cache is being invalidate because project 82d4d09eb9d64e3d8eff7334aa746792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:14:09.979940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4ace94da-9fd1-4dc3-9414-27d1905add7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.980636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-4ace94da-9fd1-4dc3-9414-27d1905add7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:09.982187 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1442/2871] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:14:09 2022] DELETE /identity/v3/projects/82d4d09eb9d64e3d8eff7334aa746792 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 16:14:09.988304 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea1ed7-86e4-406b-b075-bab1544fac0e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:09.988822 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea1ed7-86e4-406b-b075-bab1544fac0e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:09.988822 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea1ed7-86e4-406b-b075-bab1544fac0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:10.011170 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c5ea1ed7-86e4-406b-b075-bab1544fac0e None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:14:10.012530 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c5ea1ed7-86e4-406b-b075-bab1544fac0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:10.084494 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1430/2872] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:14:10.095462 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234d552-b865-45c3-8c99-03ebc3046208 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:10.095732 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234d552-b865-45c3-8c99-03ebc3046208 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:10.096006 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234d552-b865-45c3-8c99-03ebc3046208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:10.118629 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-1234d552-b865-45c3-8c99-03ebc3046208 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:14:10.120132 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-1234d552-b865-45c3-8c99-03ebc3046208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:10.129692 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1443/2873] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:14:10.135646 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea1ed7-86e4-406b-b075-bab1544fac0e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:10.149054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea1ed7-86e4-406b-b075-bab1544fac0e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:10.154719 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ece48-dad6-4473-8afa-413db5a328dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:10.155339 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ece48-dad6-4473-8afa-413db5a328dc admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:10.155615 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ece48-dad6-4473-8afa-413db5a328dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:10.155879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ece48-dad6-4473-8afa-413db5a328dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:10.156537 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ece48-dad6-4473-8afa-413db5a328dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:14:10.156834 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ece48-dad6-4473-8afa-413db5a328dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:10.158436 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ece48-dad6-4473-8afa-413db5a328dc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:10.171704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1431/2874] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:14:10.176947 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234d552-b865-45c3-8c99-03ebc3046208 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:10.187011 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234d552-b865-45c3-8c99-03ebc3046208 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:10.192693 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0edfef-2dbf-433c-9590-9feba0ee19aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:10.193295 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0edfef-2dbf-433c-9590-9feba0ee19aa admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:10.193549 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0edfef-2dbf-433c-9590-9feba0ee19aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:10.193850 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0edfef-2dbf-433c-9590-9feba0ee19aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:10.194486 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0edfef-2dbf-433c-9590-9feba0ee19aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:10.196666 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0edfef-2dbf-433c-9590-9feba0ee19aa admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:10.233681 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1444/2875] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:14:10 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:14:10.237166 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ece48-dad6-4473-8afa-413db5a328dc admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:10.247706 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ece48-dad6-4473-8afa-413db5a328dc admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:10.309652 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbaeaf-bc7f-4693-9070-1f96e2d0a95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:10.310285 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbaeaf-bc7f-4693-9070-1f96e2d0a95f admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:10.310562 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbaeaf-bc7f-4693-9070-1f96e2d0a95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:10.310868 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbaeaf-bc7f-4693-9070-1f96e2d0a95f admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:10.311516 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbaeaf-bc7f-4693-9070-1f96e2d0a95f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:10.313480 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbaeaf-bc7f-4693-9070-1f96e2d0a95f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:10.338431 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1432/2876] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:14:10 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 16:14:10.343180 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0edfef-2dbf-433c-9590-9feba0ee19aa admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:10.355551 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0edfef-2dbf-433c-9590-9feba0ee19aa admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:10.361110 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792608c-0ad2-4a30-a172-84b67fa8fa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:10.361764 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792608c-0ad2-4a30-a172-84b67fa8fa9d admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:10.362043 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792608c-0ad2-4a30-a172-84b67fa8fa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:10.362312 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792608c-0ad2-4a30-a172-84b67fa8fa9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:10.363049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792608c-0ad2-4a30-a172-84b67fa8fa9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:10.364717 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792608c-0ad2-4a30-a172-84b67fa8fa9d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:10.377450 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1445/2877] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:14:10.382316 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbaeaf-bc7f-4693-9070-1f96e2d0a95f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:10.393244 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbaeaf-bc7f-4693-9070-1f96e2d0a95f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:10.398941 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b0e15-e962-4aed-8fbe-0bea3f82b40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:10.399619 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b0e15-e962-4aed-8fbe-0bea3f82b40c admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:10.399909 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b0e15-e962-4aed-8fbe-0bea3f82b40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:10.400188 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b0e15-e962-4aed-8fbe-0bea3f82b40c admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:10.400836 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b0e15-e962-4aed-8fbe-0bea3f82b40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:10.402460 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b0e15-e962-4aed-8fbe-0bea3f82b40c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:10.415820 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1433/2878] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:14:10.421037 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792608c-0ad2-4a30-a172-84b67fa8fa9d admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:10.432697 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792608c-0ad2-4a30-a172-84b67fa8fa9d admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:10.438516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d58c8-d82b-4cfa-8118-81380770eb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:10.439179 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d58c8-d82b-4cfa-8118-81380770eb85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:10.439445 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d58c8-d82b-4cfa-8118-81380770eb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:10.439731 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d58c8-d82b-4cfa-8118-81380770eb85 admin admin] PATH_INFO: `/v3/projects/c3a2e3444bf2416385fbdbda295946ed/users/0839e29be73b4533a3128bec97eeb8fa/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:10.455570 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d58c8-d82b-4cfa-8118-81380770eb85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a2e3444bf2416385fbdbda295946ed, user_id=0839e29be73b4533a3128bec97eeb8fa, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:10.458260 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d58c8-d82b-4cfa-8118-81380770eb85 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:10.473229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1446/2879] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:14:10 2022] PUT /identity/v3/projects/c3a2e3444bf2416385fbdbda295946ed/users/0839e29be73b4533a3128bec97eeb8fa/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:14:10.484641 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6019-c725-4c1f-9a51-6183b3138b83 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:10.484924 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6019-c725-4c1f-9a51-6183b3138b83 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:10.485229 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6019-c725-4c1f-9a51-6183b3138b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:10.518471 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0eed6019-c725-4c1f-9a51-6183b3138b83 None None] MFA Rules not processed for user `0839e29be73b4533a3128bec97eeb8fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:14:10.519823 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0eed6019-c725-4c1f-9a51-6183b3138b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:10.530263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:10.595495 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1434/2880] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:14:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:14:10.607383 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d58c8-d82b-4cfa-8118-81380770eb85 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:10.609501 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-850d58c8-d82b-4cfa-8118-81380770eb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:10.675961 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d58c8-d82b-4cfa-8118-81380770eb85 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:10.680632 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8533d6-3226-488f-a9cf-efb167f321de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:10.681341 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8533d6-3226-488f-a9cf-efb167f321de service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:10.681657 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8533d6-3226-488f-a9cf-efb167f321de service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:10.681940 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8533d6-3226-488f-a9cf-efb167f321de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:10.692559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8533d6-3226-488f-a9cf-efb167f321de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:10.693977 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8533d6-3226-488f-a9cf-efb167f321de service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:10.704218 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1447/2881] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:14:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:14:20.592051 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=22 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:20.699544 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:20.818673 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed6019-c725-4c1f-9a51-6183b3138b83 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:20.883037 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed6019-c725-4c1f-9a51-6183b3138b83 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:20.888271 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccc1da-e265-4aba-bf2e-553c1ce5960f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:20.888916 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccc1da-e265-4aba-bf2e-553c1ce5960f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:20.889273 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccc1da-e265-4aba-bf2e-553c1ce5960f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:20.889447 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccc1da-e265-4aba-bf2e-553c1ce5960f admin admin] PATH_INFO: `/v3/users/0839e29be73b4533a3128bec97eeb8fa` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:20.890653 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccc1da-e265-4aba-bf2e-553c1ce5960f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0839e29be73b4533a3128bec97eeb8fa)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:20.892648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccc1da-e265-4aba-bf2e-553c1ce5960f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:20.942704 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d0ccc1da-e265-4aba-bf2e-553c1ce5960f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0839e29be73b4533a3128bec97eeb8fa'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:20.943372 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d0ccc1da-e265-4aba-bf2e-553c1ce5960f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0839e29be73b4533a3128bec97eeb8fa'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:20.943969 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d0ccc1da-e265-4aba-bf2e-553c1ce5960f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0839e29be73b4533a3128bec97eeb8fa'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:20.951547 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d0ccc1da-e265-4aba-bf2e-553c1ce5960f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0839e29be73b4533a3128bec97eeb8fa'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:20.961573 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d0ccc1da-e265-4aba-bf2e-553c1ce5960f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0839e29be73b4533a3128bec97eeb8fa'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:20.981064 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1435/2882] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:14:20 2022] DELETE /identity/v3/users/0839e29be73b4533a3128bec97eeb8fa => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:14:20.986119 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177eee57-b5f4-41cb-951f-5cfbfb538d96 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:20.986400 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177eee57-b5f4-41cb-951f-5cfbfb538d96 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:20.986693 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177eee57-b5f4-41cb-951f-5cfbfb538d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:21.006718 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-177eee57-b5f4-41cb-951f-5cfbfb538d96 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:14:21.007942 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-177eee57-b5f4-41cb-951f-5cfbfb538d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:21.068557 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1448/2883] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:14:21.079592 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccc1da-e265-4aba-bf2e-553c1ce5960f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:21.081119 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d0ccc1da-e265-4aba-bf2e-553c1ce5960f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:21.140241 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccc1da-e265-4aba-bf2e-553c1ce5960f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:21.144150 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc416ef-0bbb-4d81-9162-b7e6f5edf46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:21.144753 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc416ef-0bbb-4d81-9162-b7e6f5edf46d service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:21.145024 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc416ef-0bbb-4d81-9162-b7e6f5edf46d service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:21.145291 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc416ef-0bbb-4d81-9162-b7e6f5edf46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:21.154960 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc416ef-0bbb-4d81-9162-b7e6f5edf46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:21.156405 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc416ef-0bbb-4d81-9162-b7e6f5edf46d service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:21.165864 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1436/2884] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 16:14:21.442475 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177eee57-b5f4-41cb-951f-5cfbfb538d96 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:21.443708 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-177eee57-b5f4-41cb-951f-5cfbfb538d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:21.459192 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177eee57-b5f4-41cb-951f-5cfbfb538d96 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:21.465420 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57c589-1db0-45df-a89a-78ee14cf1ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:21.466089 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57c589-1db0-45df-a89a-78ee14cf1ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:21.466559 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57c589-1db0-45df-a89a-78ee14cf1ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:21.466963 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57c589-1db0-45df-a89a-78ee14cf1ba3 admin admin] PATH_INFO: `/v3/projects/c3a2e3444bf2416385fbdbda295946ed` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:21.468155 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57c589-1db0-45df-a89a-78ee14cf1ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a2e3444bf2416385fbdbda295946ed)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:21.471042 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57c589-1db0-45df-a89a-78ee14cf1ba3 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:21.522066 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2a57c589-1db0-45df-a89a-78ee14cf1ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a2e3444bf2416385fbdbda295946ed', 'request_id': 'req-2a57c589-1db0-45df-a89a-78ee14cf1ba3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:21.530901 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2a57c589-1db0-45df-a89a-78ee14cf1ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a2e3444bf2416385fbdbda295946ed', 'request_id': 'req-2a57c589-1db0-45df-a89a-78ee14cf1ba3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:21.538138 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2a57c589-1db0-45df-a89a-78ee14cf1ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a2e3444bf2416385fbdbda295946ed', 'request_id': 'req-2a57c589-1db0-45df-a89a-78ee14cf1ba3'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:21.551229 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2a57c589-1db0-45df-a89a-78ee14cf1ba3 admin admin] The token cache is being invalidate because project c3a2e3444bf2416385fbdbda295946ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:14:21.551518 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2a57c589-1db0-45df-a89a-78ee14cf1ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:21.552201 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-2a57c589-1db0-45df-a89a-78ee14cf1ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:21.555925 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1449/2885] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:14:21 2022] DELETE /identity/v3/projects/c3a2e3444bf2416385fbdbda295946ed => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:14:21.561670 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d6c7a-7d54-4d3a-a904-048426cbc85d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:21.561954 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d6c7a-7d54-4d3a-a904-048426cbc85d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:21.562251 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d6c7a-7d54-4d3a-a904-048426cbc85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:21.584302 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-cc3d6c7a-7d54-4d3a-a904-048426cbc85d None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:14:21.585642 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cc3d6c7a-7d54-4d3a-a904-048426cbc85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:21.604386 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:21.648779 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1437/2886] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:14:21.657843 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a4ec7-daa1-4e0c-b5eb-9d1d23445ea3 None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:21.658124 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a4ec7-daa1-4e0c-b5eb-9d1d23445ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:21.658393 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a4ec7-daa1-4e0c-b5eb-9d1d23445ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:21.681390 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-e79a4ec7-daa1-4e0c-b5eb-9d1d23445ea3 None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:14:21.682660 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-e79a4ec7-daa1-4e0c-b5eb-9d1d23445ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:21.692550 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1450/2887] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:14:21.697121 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d6c7a-7d54-4d3a-a904-048426cbc85d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:21.707450 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d6c7a-7d54-4d3a-a904-048426cbc85d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:21.712957 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d7805-32a1-480a-b5f5-672648155bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:21.713602 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d7805-32a1-480a-b5f5-672648155bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:21.713879 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d7805-32a1-480a-b5f5-672648155bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:21.714151 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d7805-32a1-480a-b5f5-672648155bf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:21.714849 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d7805-32a1-480a-b5f5-672648155bf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 16:14:21.715152 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d7805-32a1-480a-b5f5-672648155bf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:21.716760 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d7805-32a1-480a-b5f5-672648155bf7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:21.729702 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1438/2888] 10.222.0.77 () {58 vars in 1153 bytes} [Mon Aug 22 16:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 16:14:21.734359 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a4ec7-daa1-4e0c-b5eb-9d1d23445ea3 None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:21.744205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a4ec7-daa1-4e0c-b5eb-9d1d23445ea3 None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:21.749016 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46a296-44c4-4ee2-a219-998c984daf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:21.749620 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46a296-44c4-4ee2-a219-998c984daf6d admin admin] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:21.749893 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46a296-44c4-4ee2-a219-998c984daf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:21.750172 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46a296-44c4-4ee2-a219-998c984daf6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:21.750811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46a296-44c4-4ee2-a219-998c984daf6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:21.752740 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46a296-44c4-4ee2-a219-998c984daf6d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:21.781565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1451/2889] 10.222.0.77 () {60 vars in 1153 bytes} [Mon Aug 22 16:14:21 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:14:21.786003 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d7805-32a1-480a-b5f5-672648155bf7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:21.796335 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d7805-32a1-480a-b5f5-672648155bf7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:21.856750 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d99e8b-208d-4d10-8f8a-f3736d7b4b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:21.857370 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99e8b-208d-4d10-8f8a-f3736d7b4b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:21.857648 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99e8b-208d-4d10-8f8a-f3736d7b4b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:21.857918 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99e8b-208d-4d10-8f8a-f3736d7b4b1e admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:21.858549 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d99e8b-208d-4d10-8f8a-f3736d7b4b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:21.860524 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d99e8b-208d-4d10-8f8a-f3736d7b4b1e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:21.884010 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1439/2890] 10.222.0.77 () {60 vars in 1144 bytes} [Mon Aug 22 16:14:21 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 16:14:21.888258 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46a296-44c4-4ee2-a219-998c984daf6d admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:21.899065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46a296-44c4-4ee2-a219-998c984daf6d admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:21.904754 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd3338-8fb2-4820-af9c-3356698ed762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:21.905370 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd3338-8fb2-4820-af9c-3356698ed762 admin admin] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:21.905651 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd3338-8fb2-4820-af9c-3356698ed762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:21.905921 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd3338-8fb2-4820-af9c-3356698ed762 admin admin] PATH_INFO: `/v3/roles` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:21.906575 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd3338-8fb2-4820-af9c-3356698ed762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:21.908242 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd3338-8fb2-4820-af9c-3356698ed762 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:21.919106 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1452/2891] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 16:14:21.923277 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d99e8b-208d-4d10-8f8a-f3736d7b4b1e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:21.934657 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d99e8b-208d-4d10-8f8a-f3736d7b4b1e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:21.940558 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b48377-1443-4335-9e5d-2fa23a6b6399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:21.941111 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b48377-1443-4335-9e5d-2fa23a6b6399 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:21.941407 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b48377-1443-4335-9e5d-2fa23a6b6399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:21.941843 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b48377-1443-4335-9e5d-2fa23a6b6399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:21.942505 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b48377-1443-4335-9e5d-2fa23a6b6399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:21.944163 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b48377-1443-4335-9e5d-2fa23a6b6399 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:21.955746 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1440/2892] 10.222.0.77 () {58 vars in 1122 bytes} [Mon Aug 22 16:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 16:14:21.960148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd3338-8fb2-4820-af9c-3356698ed762 admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:21.971588 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd3338-8fb2-4820-af9c-3356698ed762 admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:21.976584 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f358b-b602-48ef-bea8-d300a7d2d34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:21.977240 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f358b-b602-48ef-bea8-d300a7d2d34d admin admin] REQUEST_METHOD: `PUT` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:21.977546 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f358b-b602-48ef-bea8-d300a7d2d34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:21.977820 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f358b-b602-48ef-bea8-d300a7d2d34d admin admin] PATH_INFO: `/v3/projects/26e36f92f85c4fe6b86c58f6195072aa/users/afd6fb8e47184c4aa5d81e3362bff237/roles/f866ebebacd841168b26ac7ec2c7461b` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:21.993164 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f358b-b602-48ef-bea8-d300a7d2d34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e36f92f85c4fe6b86c58f6195072aa, user_id=afd6fb8e47184c4aa5d81e3362bff237, role_id=f866ebebacd841168b26ac7ec2c7461b)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:21.996028 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f358b-b602-48ef-bea8-d300a7d2d34d admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:22.010918 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1453/2893] 10.222.0.77 () {60 vars in 1483 bytes} [Mon Aug 22 16:14:21 2022] PUT /identity/v3/projects/26e36f92f85c4fe6b86c58f6195072aa/users/afd6fb8e47184c4aa5d81e3362bff237/roles/f866ebebacd841168b26ac7ec2c7461b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:14:22.021591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd3b43-2455-4e3b-ae40-c2f7cbb551a1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:22.022042 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd3b43-2455-4e3b-ae40-c2f7cbb551a1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:22.022431 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd3b43-2455-4e3b-ae40-c2f7cbb551a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:22.051737 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-07cd3b43-2455-4e3b-ae40-c2f7cbb551a1 None None] MFA Rules not processed for user `afd6fb8e47184c4aa5d81e3362bff237`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:14:22.052975 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-07cd3b43-2455-4e3b-ae40-c2f7cbb551a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:22.120365 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1441/2894] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:14:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:14:22.131448 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f358b-b602-48ef-bea8-d300a7d2d34d admin admin] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:22.133385 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-2e2f358b-b602-48ef-bea8-d300a7d2d34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:22.156929 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:22.196759 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f358b-b602-48ef-bea8-d300a7d2d34d admin admin] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:22.200553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf4b28-5e92-4717-9833-64f988cbf569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80b255bd61e3445ab154f01fea9a95b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:22.201165 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf4b28-5e92-4717-9833-64f988cbf569 service cinder] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:22.201439 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf4b28-5e92-4717-9833-64f988cbf569 service cinder] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:22.201722 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf4b28-5e92-4717-9833-64f988cbf569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:22.210517 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf4b28-5e92-4717-9833-64f988cbf569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:22.212036 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf4b28-5e92-4717-9833-64f988cbf569 service cinder] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:22.221643 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1454/2895] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:14:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:14:23.591247 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3315-8ab0-43e9-9c86-52f68563c09a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:23.591833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3315-8ab0-43e9-9c86-52f68563c09a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:23.591833 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3315-8ab0-43e9-9c86-52f68563c09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:23.612930 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-600b3315-8ab0-43e9-9c86-52f68563c09a None None] MFA Rules not processed for user `afd6fb8e47184c4aa5d81e3362bff237`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:14:23.614143 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-600b3315-8ab0-43e9-9c86-52f68563c09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:23.622033 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1442/2896] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:14:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:14:24.113293 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf4b28-5e92-4717-9833-64f988cbf569 service cinder] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:24.115309 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-89cf4b28-5e92-4717-9833-64f988cbf569 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:24.188884 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf4b28-5e92-4717-9833-64f988cbf569 service cinder] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:24.193799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883ed55-5f01-4c8f-bfa5-6bcf8513ead0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be9a664d10d438382b9e359b26ba86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:24.194411 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883ed55-5f01-4c8f-bfa5-6bcf8513ead0 service placement] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:24.194736 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883ed55-5f01-4c8f-bfa5-6bcf8513ead0 service placement] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:24.194993 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883ed55-5f01-4c8f-bfa5-6bcf8513ead0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:24.197027 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5883ed55-5f01-4c8f-bfa5-6bcf8513ead0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:24.208888 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883ed55-5f01-4c8f-bfa5-6bcf8513ead0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:24.210515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883ed55-5f01-4c8f-bfa5-6bcf8513ead0 service placement] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:24.221267 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1455/2897] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:14:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:14:26.253060 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b3315-8ab0-43e9-9c86-52f68563c09a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:26.254665 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-600b3315-8ab0-43e9-9c86-52f68563c09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:26.269141 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:26.326486 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b3315-8ab0-43e9-9c86-52f68563c09a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:26.330398 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d49a7-e856-4e5d-8b2a-afc3605db14e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:26.331053 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d49a7-e856-4e5d-8b2a-afc3605db14e service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:26.331340 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d49a7-e856-4e5d-8b2a-afc3605db14e service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:26.331591 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d49a7-e856-4e5d-8b2a-afc3605db14e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:26.334929 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c08d49a7-e856-4e5d-8b2a-afc3605db14e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:26.345441 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d49a7-e856-4e5d-8b2a-afc3605db14e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:26.346905 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d49a7-e856-4e5d-8b2a-afc3605db14e service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:26.356055 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1443/2898] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:14:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:14:32.279811 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883ed55-5f01-4c8f-bfa5-6bcf8513ead0 service placement] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:32.282675 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-5883ed55-5f01-4c8f-bfa5-6bcf8513ead0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:32.395814 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883ed55-5f01-4c8f-bfa5-6bcf8513ead0 service placement] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:32.401437 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933beb52-3fb8-4cd6-ab6c-3bf6231bd56b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e4a18ab77642baa9adb9a4b49fbcc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:32.402070 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933beb52-3fb8-4cd6-ab6c-3bf6231bd56b service nova] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:32.402350 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933beb52-3fb8-4cd6-ab6c-3bf6231bd56b service nova] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:32.402644 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933beb52-3fb8-4cd6-ab6c-3bf6231bd56b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:32.404476 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-933beb52-3fb8-4cd6-ab6c-3bf6231bd56b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:32.417511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933beb52-3fb8-4cd6-ab6c-3bf6231bd56b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:32.419232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933beb52-3fb8-4cd6-ab6c-3bf6231bd56b service nova] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:32.434778 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1456/2899] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:14:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:14:36.352402 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=21 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:38.623636 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b0fdf-66f4-4f6d-b56b-f3cb60751ee8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:38.624227 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b0fdf-66f4-4f6d-b56b-f3cb60751ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:38.624227 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b0fdf-66f4-4f6d-b56b-f3cb60751ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:38.678860 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a03b0fdf-66f4-4f6d-b56b-f3cb60751ee8 None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:14:38.680637 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a03b0fdf-66f4-4f6d-b56b-f3cb60751ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:38.753400 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1444/2900] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 16:14:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:14:38.804302 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933beb52-3fb8-4cd6-ab6c-3bf6231bd56b service nova] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:38.806049 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-933beb52-3fb8-4cd6-ab6c-3bf6231bd56b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:38.858123 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=100 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:38.918327 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933beb52-3fb8-4cd6-ab6c-3bf6231bd56b service nova] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:38.924056 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc71cc-54c7-4a71-93cf-96c85e79098d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:38.924674 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc71cc-54c7-4a71-93cf-96c85e79098d service swift] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:38.924943 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc71cc-54c7-4a71-93cf-96c85e79098d service swift] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:38.925212 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc71cc-54c7-4a71-93cf-96c85e79098d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:38.934669 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc71cc-54c7-4a71-93cf-96c85e79098d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:38.936301 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc71cc-54c7-4a71-93cf-96c85e79098d service swift] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:38.944709 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1457/2901] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:14:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:14:39.474458 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f288e-8f2f-4956-845d-566e97ac1eee None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:39.474782 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f288e-8f2f-4956-845d-566e97ac1eee None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:39.475057 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f288e-8f2f-4956-845d-566e97ac1eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:39.499893 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-fa7f288e-8f2f-4956-845d-566e97ac1eee None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:14:39.501280 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fa7f288e-8f2f-4956-845d-566e97ac1eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:39.515601 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1445/2902] 10.222.0.77 () {58 vars in 967 bytes} [Mon Aug 22 16:14:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 16:14:39.528148 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc71cc-54c7-4a71-93cf-96c85e79098d service swift] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:39.539365 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc71cc-54c7-4a71-93cf-96c85e79098d service swift] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:39.545205 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb836e-f48a-41e9-865c-d7ada2b170b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:39.545813 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb836e-f48a-41e9-865c-d7ada2b170b6 service swift] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:39.546104 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb836e-f48a-41e9-865c-d7ada2b170b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:39.550553 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb836e-f48a-41e9-865c-d7ada2b170b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:39.555898 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb836e-f48a-41e9-865c-d7ada2b170b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:39.557516 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb836e-f48a-41e9-865c-d7ada2b170b6 service swift] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:39.566954 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1458/2903] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:14:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:14:39.800461 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9475-eb7d-4755-bcad-f2100ecccb2e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:39.801198 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9475-eb7d-4755-bcad-f2100ecccb2e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:39.801714 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9475-eb7d-4755-bcad-f2100ecccb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:39.826580 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a6de9475-eb7d-4755-bcad-f2100ecccb2e None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:14:39.827801 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a6de9475-eb7d-4755-bcad-f2100ecccb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:39.835222 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1446/2904] 10.222.0.77 () {58 vars in 1009 bytes} [Mon Aug 22 16:14:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:14:39.847969 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb836e-f48a-41e9-865c-d7ada2b170b6 service swift] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:39.859521 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb836e-f48a-41e9-865c-d7ada2b170b6 service swift] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:39.866161 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11cc77-27c8-4457-9762-2eb8698db9d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:39.866817 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11cc77-27c8-4457-9762-2eb8698db9d1 service swift] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:39.867094 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11cc77-27c8-4457-9762-2eb8698db9d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:39.867441 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11cc77-27c8-4457-9762-2eb8698db9d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:39.876911 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11cc77-27c8-4457-9762-2eb8698db9d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:39.878710 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11cc77-27c8-4457-9762-2eb8698db9d1 service swift] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:39.888756 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1459/2905] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:14:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:14:40.255515 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898ff79-af4a-436b-890e-523dda841016 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:40.255799 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898ff79-af4a-436b-890e-523dda841016 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:40.256062 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898ff79-af4a-436b-890e-523dda841016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:40.276806 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a898ff79-af4a-436b-890e-523dda841016 None None] MFA Rules not processed for user `68876ef8dc62494996c1497819e980d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:14:40.278034 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a898ff79-af4a-436b-890e-523dda841016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:40.285419 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1447/2906] 10.222.0.77 () {58 vars in 967 bytes} [Mon Aug 22 16:14:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:14:40.298511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11cc77-27c8-4457-9762-2eb8698db9d1 service swift] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:40.310158 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11cc77-27c8-4457-9762-2eb8698db9d1 service swift] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:40.315716 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5f37b-84e5-42fe-9b21-1c38be0bed43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d8a49035be2479b87c797bf53c9919b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:40.316324 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5f37b-84e5-42fe-9b21-1c38be0bed43 service swift] REQUEST_METHOD: `GET` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:40.316603 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5f37b-84e5-42fe-9b21-1c38be0bed43 service swift] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:40.316848 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5f37b-84e5-42fe-9b21-1c38be0bed43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:40.325511 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5f37b-84e5-42fe-9b21-1c38be0bed43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:40.327176 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5f37b-84e5-42fe-9b21-1c38be0bed43 service swift] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:40.336280 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1460/2907] 10.222.0.77 () {60 vars in 1384 bytes} [Mon Aug 22 16:14:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 16:14:42.492890 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898ff79-af4a-436b-890e-523dda841016 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:42.568644 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898ff79-af4a-436b-890e-523dda841016 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:42.574635 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3a53c-c8ae-4db9-b69c-a4f9ab35eb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:42.575265 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a53c-c8ae-4db9-b69c-a4f9ab35eb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:42.575539 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a53c-c8ae-4db9-b69c-a4f9ab35eb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:42.575805 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3a53c-c8ae-4db9-b69c-a4f9ab35eb9f admin admin] PATH_INFO: `/v3/users/afd6fb8e47184c4aa5d81e3362bff237` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:42.577114 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3a53c-c8ae-4db9-b69c-a4f9ab35eb9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd6fb8e47184c4aa5d81e3362bff237)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:42.579101 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f3a53c-c8ae-4db9-b69c-a4f9ab35eb9f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:42.634541 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-69f3a53c-c8ae-4db9-b69c-a4f9ab35eb9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd6fb8e47184c4aa5d81e3362bff237'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:42.635345 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-69f3a53c-c8ae-4db9-b69c-a4f9ab35eb9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd6fb8e47184c4aa5d81e3362bff237'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:42.635942 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-69f3a53c-c8ae-4db9-b69c-a4f9ab35eb9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd6fb8e47184c4aa5d81e3362bff237'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:42.641811 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:42.644305 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-69f3a53c-c8ae-4db9-b69c-a4f9ab35eb9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd6fb8e47184c4aa5d81e3362bff237'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:42.655409 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-69f3a53c-c8ae-4db9-b69c-a4f9ab35eb9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd6fb8e47184c4aa5d81e3362bff237'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:42.673565 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1448/2908] 10.222.0.77 () {58 vars in 1224 bytes} [Mon Aug 22 16:14:42 2022] DELETE /identity/v3/users/afd6fb8e47184c4aa5d81e3362bff237 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:14:42.678342 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11180b04-f537-4585-8a81-1cd4fe20e66a None None] REQUEST_METHOD: `POST` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:42.678880 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11180b04-f537-4585-8a81-1cd4fe20e66a None None] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:42.678880 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11180b04-f537-4585-8a81-1cd4fe20e66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:42.699568 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.auth.core [None req-11180b04-f537-4585-8a81-1cd4fe20e66a None None] MFA Rules not processed for user `ee071968090a43639b3c920bae3fb546`. Rule list: `[]` (Enabled: `True`). {{(pid=81660) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 16:14:42.700867 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-11180b04-f537-4585-8a81-1cd4fe20e66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:42.762824 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1461/2909] 10.222.0.77 () {58 vars in 958 bytes} [Mon Aug 22 16:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 16:14:42.773645 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3a53c-c8ae-4db9-b69c-a4f9ab35eb9f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:42.775762 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-69f3a53c-c8ae-4db9-b69c-a4f9ab35eb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:42.843054 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3a53c-c8ae-4db9-b69c-a4f9ab35eb9f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:42.847586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a335cd-0e8e-47ac-a4bc-a1f8eb49126f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '104abc0b38524a2f95ffe96c5872362c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:42.848196 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a335cd-0e8e-47ac-a4bc-a1f8eb49126f service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:42.848485 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a335cd-0e8e-47ac-a4bc-a1f8eb49126f service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:42.848764 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a335cd-0e8e-47ac-a4bc-a1f8eb49126f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:42.858577 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a335cd-0e8e-47ac-a4bc-a1f8eb49126f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:42.860081 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a335cd-0e8e-47ac-a4bc-a1f8eb49126f service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:42.870633 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1449/2910] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:14:43.053515 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11180b04-f537-4585-8a81-1cd4fe20e66a None None] Authenticating user token {{(pid=81660) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:14:43.055035 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.fernet_utils [None req-11180b04-f537-4585-8a81-1cd4fe20e66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81660) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:14:43.067636 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11180b04-f537-4585-8a81-1cd4fe20e66a None None] Validating token access rules against request {{(pid=81660) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:14:43.073030 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ac8d7-fddf-433f-89f2-ab046d990417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee071968090a43639b3c920bae3fb546', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29b6132ef8cb45a795d9be0f08083084', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81660) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:14:43.073676 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ac8d7-fddf-433f-89f2-ab046d990417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:14:43.073948 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ac8d7-fddf-433f-89f2-ab046d990417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:14:43.074223 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ac8d7-fddf-433f-89f2-ab046d990417 admin admin] PATH_INFO: `/v3/projects/26e36f92f85c4fe6b86c58f6195072aa` {{(pid=81660) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:14:43.075565 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ac8d7-fddf-433f-89f2-ab046d990417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e36f92f85c4fe6b86c58f6195072aa)` {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:14:43.077494 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ac8d7-fddf-433f-89f2-ab046d990417 admin admin] RBAC: Authorization granted {{(pid=81660) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:14:43.128079 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b46ac8d7-fddf-433f-89f2-ab046d990417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e36f92f85c4fe6b86c58f6195072aa', 'request_id': 'req-b46ac8d7-fddf-433f-89f2-ab046d990417'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:43.138232 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b46ac8d7-fddf-433f-89f2-ab046d990417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e36f92f85c4fe6b86c58f6195072aa', 'request_id': 'req-b46ac8d7-fddf-433f-89f2-ab046d990417'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:43.144987 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b46ac8d7-fddf-433f-89f2-ab046d990417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e36f92f85c4fe6b86c58f6195072aa', 'request_id': 'req-b46ac8d7-fddf-433f-89f2-ab046d990417'} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:43.147065 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:43.157430 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b46ac8d7-fddf-433f-89f2-ab046d990417 admin admin] The token cache is being invalidate because project 26e36f92f85c4fe6b86c58f6195072aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81660) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 16:14:43.157727 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b46ac8d7-fddf-433f-89f2-ab046d990417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:43.158694 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG keystone.notifications [None req-b46ac8d7-fddf-433f-89f2-ab046d990417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81660) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 16:14:43.160469 dv-cinder-854004-1-smb devstack@keystone.service[81660]: [pid: 81660|app: 0|req: 1462/2911] 10.222.0.77 () {58 vars in 1233 bytes} [Mon Aug 22 16:14:43 2022] DELETE /identity/v3/projects/26e36f92f85c4fe6b86c58f6195072aa => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 16:14:52.865744 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=35,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:14:53.161799 dv-cinder-854004-1-smb devstack@keystone.service[81660]: DEBUG dbcounter [-] [81660] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=81660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 16:15:51.703252 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a335cd-0e8e-47ac-a4bc-a1f8eb49126f service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 16:15:51.704747 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-36a335cd-0e8e-47ac-a4bc-a1f8eb49126f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:15:51.778263 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a335cd-0e8e-47ac-a4bc-a1f8eb49126f service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 16:15:51.841680 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c333770-8eba-4ac6-b20e-3d135c310aa2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4be9a664d10d438382b9e359b26ba86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '318c7f21f9d14e149f668863f748e89f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 16:15:51.842311 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c333770-8eba-4ac6-b20e-3d135c310aa2 service placement] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 16:15:51.842586 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c333770-8eba-4ac6-b20e-3d135c310aa2 service placement] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 16:15:51.842889 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c333770-8eba-4ac6-b20e-3d135c310aa2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 16:15:51.844844 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9c333770-8eba-4ac6-b20e-3d135c310aa2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 16:15:51.857177 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c333770-8eba-4ac6-b20e-3d135c310aa2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 16:15:51.858817 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c333770-8eba-4ac6-b20e-3d135c310aa2 service placement] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 16:15:51.868771 dv-cinder-854004-1-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1450/2912] 10.222.0.77 () {60 vars in 1365 bytes} [Mon Aug 22 16:15:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 16:16:01.864544 dv-cinder-854004-1-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=58 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}